Long Context Isn’t Free — I Built a Safe Prompt-Pruning Layer That Makes LLM Systems Work
I’ve worked on, conversation state tends to grow quickly over time. It’s common to resend large portions of the history on each turn—including older tool outputs, repeated RAG retrievals, and…