Local supervised fine-tuning
Fine-tuned Llama and OpenChat-class models locally with llama.cpp: preparing the training data, training, and checking the results.
llama.cpp, SFT, LoRA, Dataset engineering, Local inference
Skill
4 entries mention it. All skills →
Fine-tuned Llama and OpenChat-class models locally with llama.cpp: preparing the training data, training, and checking the results.
llama.cpp, SFT, LoRA, Dataset engineering, Local inference
Studied how small models learn when given reasoning scaffolds, and compared the insides of base and fine-tuned models.
GRPO, LoRA, MLX, Mechanistic interpretability, Experiment design
Developed training tooling for Apple Silicon, with configurable tasks, evaluators, rewards, supervised modes and guided reasoning experiments.
MLX, Python, GRPO, LoRA, SFT, Reward design, Training infrastructure
Kept training small models at home: guided-reasoning runs, quantisation and tooling to make runs repeatable.
MLX, GRPO, LoRA, Quantization, Dataset engineering, Experiment tracking