RedKnot

rednote-machine-learning

Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention