Jay's Blog

Here I document my learning/research notes, as well as some of my calligraphy stuff.

A Survey on In-Context Learning

Survey notes on in-context learning (ICL) - a paradigm for LLMs to learn tasks from few examples without parameter updates. Covers ICL mechanisms, prompt engineering, and comparison of causalLM vs prefixLM.

6 min read · December 18, 2025

2025 · in-context-learning icl llm prompt-engineering few-shot-learning · paper-reading
Transformer Basics: Architecture and Data Flow

Understanding the transformer architecture from model layers and token sequence perspectives

18 min read · December 13, 2025

2025 · transformer llm architecture attention deep-learning · technical-notes
HippoRAG: Neurobiologically Inspired Long-Term Memory for LLMs

Paper reading notes on HippoRAG - using knowledge graphs and PageRank for better RAG retrieval

11 min read · November 23, 2025

2025 · paper-notes rag llm knowledge-graph pagerank · paper-reading