Welcome to DaiYi AGI
About This Site DaiYi AGI is my personal AI learning notebook and knowledge management system. Here, I document my learn...
All Articles
13 articles2024 LLM Annual Review
The Scaling Race Cools Down 2024 saw the industry shift from "bigger is better" to "smarter training." Smaller models wi...
Building AI Agent Workflows
The ReAct Pattern ReAct interleaves Reasoning and Acting, letting the Agent alternate between thinking and executing. Im...
Transformer Architecture Explained
What is Transformer Transformer was proposed by Google in 2017 and completely revolutionized NLP. It is based entirely o...
Understanding Attention Mechanism
Intuitive Understanding Attention mimics human attention — when we look at a painting, we don't focus equally on every p...
Implementing Transformer in PyTorch
Project Structure We'll implement an EncoderDecoder Transformer including Embedding, Positional Encoding, MultiHead Atte...
Building RAG Apps with LangChain
RAG Architecture Overview RAG combines retrieval and generation: store documents in a vector database, retrieve relevant...
Agent Framework Comparison
AutoGPT Decomposes tasks into subgoals, calling LLMs iteratively. High autonomy but prone to loops. MetaGPT Borrows soft...
How Far Are We From AGI
Optimists vs Skeptics OpenAI's Sam Altman believes AGI could arrive within 510 years. Yann LeCun argues we're much furth...
Building GPT From Scratch
Overview Following Andrej Karpathy's nanoGPT, we build a small GPT that can generate text. Model Architecture python cla...
Prompt Engineering Complete Guide
Basic Techniques ZeroShot Ask directly without examples. FewShot Provide 25 examples for the model to learn patterns. Ch...
Vector Database: Pinecone vs Milvus
Pinecone Fully managed vector database, zero operational burden. Ideal for rapid prototyping. python import pinecone pin...
RAG Technology Survey
RAG Development Timeline From Lewis et al.'s original RAG proposal in 2020 to becoming the standard enterprise LLM archi...