Learn/Core Concept What is token compression? Token compression reduces the number of tokens sent to language models by intelligently summarising or encoding input data without losing essential information. It's particularly useful for CLI outputs, logs, and structured data where raw content often contains redundancy. Tools like RTK demonstrate this practically, achieving 60-90% token savings on command outputs through compression algorithms. This matters because it directly cuts API costs and fits more context into model limits, making complex workflows more feasible. Context WindowTokenisation |