llama.cpp

Local supervised fine-tuning

Fine-tuned Llama and OpenChat-class models locally with llama.cpp: preparing the training data, training, and checking the results.

llama.cpp, SFT, LoRA, Dataset engineering, Local inference

Notes & links

From my own notes. Link to this entry