Blog
Notes from the RedKnot team
Plain-language posts on long-context LLM serving.
RedKnot, explained: most attention heads can reuse their cache
Why long prompts are slow, why only a few attention heads need the whole prompt, and how that gives a 1.6–5.2× faster first token.