Skip to content

Conversation

@rasmus-u
Copy link
Contributor

@rasmus-u rasmus-u commented Jan 25, 2026

Summary

Adds TTC Compression plugin - an LLM input compression middleware by The Token Company.

Features:

  • Semantic compression using bear-1 model to reduce token usage
  • Increases effective context window by compressing prompts
  • Configurable aggressiveness (0.1-0.9)
  • Optional max/min output token limits
  • JSON structure protection option

Plugin Details:

Test Plan

  • Plugin packages successfully
  • Plugin installs via remote debug
  • Compression API calls work correctly
  • All parameters (aggressiveness, max/min tokens, protect_json) function properly

LLM input compression middleware that reduces token usage and increases
context windows before sending prompts to any LLM provider.

Features:
- Semantic compression using bear-1 model
- Configurable aggressiveness (0.1-0.9)
- Optional max/min output token limits
- JSON structure protection option

https://thetokencompany.com
@crazywoola
Copy link
Member

Please fix the errors in the CI

@rasmus-u
Copy link
Contributor Author

Should be fixed now

@crazywoola crazywoola merged commit 3b4e9f2 into langgenius:main Jan 29, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants