March 2024
Teaching
Public talk: a generative AI second brain on AWS serverless
Gave a talk at a Serverless Melbourne meetup on building a personal "second brain" on AWS serverless while keeping the cost low. Most of it does not need a large model or real-time answers, so documents are stored in S3, organised with small keyword and topic models, and searched with a vector database that sits on S3. Small quantized models handle the cheap steps, and retrieval with a larger model runs only for content I pick.
AWS Lambda, Step Functions, Amazon S3, LanceDB, RAG, Quantized models, Knowledge management, Cost-aware architecture
Notes & links
Public recording and my slides. Talk recording ↗ · Link to this entry