Things I've written, newest first. Each first appeared on Medium; the copies here stay readable without an account. All posts on Medium ↗
I trained a 4-billion-parameter language model on a laptop with 8 gigabytes of RAM. It took a few hours and produced an adapter file smaller than most photographs. Every standard evaluation metric — cosine similarity, CKA, benchmark scores, perplexity — says the model did not…
the wisdom required to cheat is the wisdom you were supposed to learn Think about how a person actually goes from knowing nothing to becoming an expert. As a young child, you learn everything in an unstructured way. You absorb language, shapes, colors, social cues…
After 18 months of engineering a 4B reasoning model, I ran a simple test: “Who was the starting shortstop for the 1974 Pittsburgh Pirates, and what was his batting average?” This is a factual question outside the training data. Most models would either: Hallucinate an…
In a memorable interview, Steve Jobs once described the computer as a “bicycle for the mind.” He recalled an article from his youth that compared the energy efficiency of various species moving from point A to point B. The condor topped the list, with humans…
promising an unprecedented paradigm shift in how we interact with technology, envision possibilities, and solve complex problems. #GenerativeAI #QuantumComputing #TechInnovation #FutureOfAI #QuantumLeap Generative AI and the advancements in Large Language Models (LLMs) are not just technological marvels of our time; they are the harbinger of…
The tech industry’s rapid evolution towards open-source is compelling, especially as major tech giants like Google, Apple, Microsoft, and AWS actively contribute to and embrace open-source projects. This shift, while promoting innovation, also presents significant challenges for both these giants and traditional corporate entities. Even…
Machine Learning 2.0 In the rapidly evolving world of machine learning, a new player is making waves — generative AI. This advanced form of AI is not just an incremental improvement; it’s a game changer that’s rendering many traditional machine learning methodologies obsolete. Traditional machine…
In the ever-evolving landscape of Artificial Intelligence (AI), the quest for solving complex problems efficiently is an ongoing journey. Traditional approaches often involve feeding colossal problem statements to massive AI models, hoping for solutions. However, this approach presents formidable challenges: Large AI models demand substantial…