Add skill6...

Discover / Category

⚡ Token & Cost Optimization

Explore token & cost optimization tools with transparent adoption, freshness, maturity, and install evidence. Downloads and stars are ranked separately because they measure different things.

37 VERIFIED ENTRIES6 subcategories
LLM GatewaysModel RoutingPrompt CachingContext CompressionCheaper-Model AgentsObservability & Cost

Registry adoption, npm or PyPI

Token & Cost Optimization - ranked by monthly package downloads

21 tracked
  1. #1LiteLLMBerriAITrust pending661.3Mmonthly downloads
  2. #2SGLangsgl-projectTrust pending100.4Mmonthly downloads
  3. #3LangfuselangfuseTrust pending7.1Mmonthly downloads
  4. #4vLLMvllm-projectTrust pending5.6Mmonthly downloads
  5. #5Hugging Face OptimumhuggingfaceTrust pending2.0Mmonthly downloads
  6. #6SkyPilotskypilot-orgTrust pending1.7Mmonthly downloads
  7. #7AiderAider-AITrust pending813Kmonthly downloads
  8. #8llama-cpp-pythonabetlenTrust pending698Kmonthly downloads
  9. #9Semantic Routeraurelio-labsTrust pending441Kmonthly downloads
  10. #10GPTCachezilliztechTrust pending437Kmonthly downloads
  11. #11AgentOpsAgentOps-AITrust pending287Kmonthly downloads
  12. #12LLMLinguamicrosoftTrust pending93Kmonthly downloads
  13. #13OpenMeteropenmeterioTrust pending74Kmonthly downloads
  14. #14LMCacheLMCacheTrust pending68Kmonthly downloads
  15. #15FastChatlm-sysTrust pending45Kmonthly downloads
  16. #16TensorRT-LLMNVIDIATrust pending12Kmonthly downloads
  17. #17RouteLLMlm-sysTrust pending9.3Kmonthly downloads
  18. #18Portkey GatewayPortkey-AITrust pending4.1Kmonthly downloads
  19. #19HeliconeHeliconeTrust pending3.9Kmonthly downloads
  20. #20Token.jstoken-jsTrust pending3.7Kmonthly downloads
  21. #21OpenLLMbentomlTrust pending1.8Kmonthly downloads

Community interest, no registry download data

Token & Cost Optimization - ranked by github stars

16 tracked
  1. #1OllamaollamaTrust pending182KGitHub stars
  2. #2llama.cppggerganovTrust pending130KGitHub stars
  3. #3Headroomheadroomlabs-aiTrust pending74KGitHub stars
  4. #4Anthropic Prompt CachinganthropicsTrust pending53KGitHub stars
  5. #5DeepSpeedmicrosoftTrust pending43KGitHub stars
  6. #6Vercel AI GatewayvercelTrust pending27KGitHub stars
  7. #7llamafileMozilla-OchoTrust pending26KGitHub stars
  8. #8TensorZerotensorzeroTrust pending12KGitHub stars
  9. #9Text Generation InferencehuggingfaceTrust pending11KGitHub stars
  10. #10BifrostmaximhqTrust pending8.4KGitHub stars
  11. #11LangWatchlangwatchTrust pending4.9KGitHub stars
  12. #12ExLlamaV2turboderpTrust pending4.6KGitHub stars
  13. #13OptiLLMcodelionTrust pending4.3KGitHub stars
  14. #14LoRAXpredibaseTrust pending3.8KGitHub stars
  15. #15Prompt CachemesskanTrust pending409GitHub stars
  16. #16LLMstudioTensorOpsAITrust pending388GitHub stars