Sliding-Window Prefix Caches Need Physical Proof
Hybrid attention turns prefix caching into a memory-consistency problem across KV pools with different lifetimes.
Read
Resources
Guides & Resources
Field notes, comparisons, and implementation guides for building AI-powered software.
Framework leaderboard
Compare actively maintained frameworks and the signals behind their adoption.
LLM Framework Leaderboard
1k+
1k+
2k+
2k+
2k+
All guides
Speculative Agents Need a Commit Boundary
Speculative execution cuts agent latency only when prediction and commitment are separate operations.
Read
Loop / Harness Engineering
Agent loops turn prompts into one part of a production harness: tools, state, checks, approvals, and exit conditions.
Read
Plain-Text Context Files for LLMs
Plain-text context files are the git-native, zero-ops way to steer AI agents.
Read
How to Build an MCP Server
A guide to building an MCP server for Markdown note taking
Read
Structuring tools for AI Agents
A short conceptual guide to organising tools in agentic workflows
Read
The Modern Document Processing Stack
A simple engine for converting any file type to Markdown.
Read
Decoding Methods for LLMs
A verbose explanation of common auto-regressive decoding methods: temperature, top k and top p.
Read
Structured Generation Shoot-out
A comparison of some of the most popular libraries that constrain LLM generation.
Read