Explaining LLMs and Transformers
Prepared presentation material on Transformers, attention, fine-tuning, prompts, agents and plugins.
Transformers, Attention, Fine-tuning, Prompting, Agents, Technical teaching
Skill
5 entries mention it. All skills →
Prepared presentation material on Transformers, attention, fine-tuning, prompts, agents and plugins.
Transformers, Attention, Fine-tuning, Prompting, Agents, Technical teaching
Shared experiments fine-tuning small GPT-NeoX models for one task, such as drafting email, and running them on ordinary hardware.
GPT-NeoX, Fine-tuning, Local inference, Small models
Tried a loop where a model helps write and clean up training data for one task, then gets fine-tuned and quantized, and the cycle repeats.
Synthetic data, Fine-tuning, Quantization, Model evaluation
Shared what I saw inside models after fine-tuning, and suggested checking whether it holds for other model families.
Activation analysis, Model evaluation, Cross-model evaluation, Fine-tuning
Wrote a look back from early fastText and local-model work to later fine-tuning and defensive tool design.
fastText, Local inference, Fine-tuning, Defensive tool design