Writing about open language models
Wrote about open models like Falcon, which can be adapted and run outside a single vendor’s service.
Skill
6 entries mention it. All skills →
Wrote about open models like Falcon, which can be adapted and run outside a single vendor’s service.
Tried a loop where a model helps write and clean up training data for one task, then gets fine-tuned and quantized, and the cycle repeats.
Synthetic data, Fine-tuning, Quantization, Model evaluation
Asked how models behave when given serialized or binary data, and what security risks that opens.
Serialization security, Model evaluation
Wrote about the security risks that come with more capable models and agents, and the trade-offs of using smaller, task-specific models.
Agent security, Risk analysis, Model evaluation
Shared what I saw inside models after fine-tuning, and suggested checking whether it holds for other model families.
Activation analysis, Model evaluation, Cross-model evaluation, Fine-tuning
Wrote up a research idea about guiding small models to reason better without retraining all of their weights.
Reasoning-model training, Expert scaffolding, Model evaluation