Welcome to DaiYi AGI
About This Site DaiYi AGI is my personal AI learning notebook and knowledge management system. Here, I document my learn...
Featured
6 articles2024 LLM Annual Review
The Scaling Race Cools Down 2024 saw the industry shift from "bigger is better" to "smarter training." Smaller models wi...
Transformer Architecture Explained
What is Transformer Transformer was proposed by Google in 2017 and completely revolutionized NLP. It is based entirely o...
Implementing Transformer in PyTorch
Project Structure We'll implement an EncoderDecoder Transformer including Embedding, Positional Encoding, MultiHead Atte...
How Far Are We From AGI
Optimists vs Skeptics OpenAI's Sam Altman believes AGI could arrive within 510 years. Yann LeCun argues we're much furth...
Prompt Engineering Complete Guide
Basic Techniques ZeroShot Ask directly without examples. FewShot Provide 25 examples for the model to learn patterns. Ch...