I have no idea how to do this
Its non-trivial, but: https://zohaib.me/a-beginners-guide-to-fine-tuning-llm-using-lora/