Welcome to DaiYi AGI
About This Site DaiYi AGI is my personal AI learning notebook and knowledge management system. Here, I document my learn...
Featured
View All →2024 LLM Annual Review
The Scaling Race Cools Down 2024 saw the industry shift from "bigger is better" to "smarter training." Smaller models wi...
Transformer Architecture Explained
What is Transformer Transformer was proposed by Google in 2017 and completely revolutionized NLP. It is based entirely o...
Implementing Transformer in PyTorch
Project Structure We'll implement an EncoderDecoder Transformer including Embedding, Positional Encoding, MultiHead Atte...
Study Notes
View All →Tech Practice
View All →Building AI Agent Workflows
The ReAct Pattern ReAct interleaves Reasoning and Acting, letting the Agent alternate between thinking and executing. Im...
Building RAG Apps with LangChain
RAG Architecture Overview RAG combines retrieval and generation: store documents in a vector database, retrieve relevant...
Agent Framework Comparison
AutoGPT Decomposes tasks into subgoals, calling LLMs iteratively. High autonomy but prone to loops. MetaGPT Borrows soft...
Tutorials
View All →Building GPT From Scratch
Overview Following Andrej Karpathy's nanoGPT, we build a small GPT that can generate text. Model Architecture python cla...
Vector Database: Pinecone vs Milvus
Pinecone Fully managed vector database, zero operational burden. Ideal for rapid prototyping. python import pinecone pin...