Add skill6

Discover / Category

⚡ Token & Cost Optimization

Explore token & cost optimization tools with transparent adoption, freshness, maturity, and install evidence. Downloads and stars are ranked separately because they measure different things.

37 VERIFIED ENTRIES6 subcategories
LLM GatewaysModel RoutingPrompt CachingContext CompressionCheaper-Model AgentsObservability & Cost

Registry adoption, npm or PyPI

Token & Cost Optimization - ranked by monthly package downloads

21 tracked
  1. #1LiteLLMBerriAITrust pending661.3Mmonthly downloads
  2. #2SGLangsgl-projectTrust pending100.4Mmonthly downloads
  3. #3LangfuselangfuseTrust pending7.1Mmonthly downloads
  4. #4vLLMvllm-projectTrust pending5.6Mmonthly downloads
  5. #5Hugging Face OptimumhuggingfaceTrust pending2.0Mmonthly downloads
  6. #6SkyPilotskypilot-orgTrust pending1.7Mmonthly downloads
  7. #7AiderAider-AITrust pending813Kmonthly downloads
  8. #8llama-cpp-pythonabetlenTrust pending698Kmonthly downloads
  9. #9Semantic Routeraurelio-labsTrust pending441Kmonthly downloads
  10. #10GPTCachezilliztechTrust pending437Kmonthly downloads
  11. #11AgentOpsAgentOps-AITrust pending287Kmonthly downloads
  12. #12LLMLinguamicrosoftTrust pending93Kmonthly downloads
  13. #13OpenMeteropenmeterioTrust pending74Kmonthly downloads
  14. #14LMCacheLMCacheTrust pending68Kmonthly downloads
  15. #15FastChatlm-sysTrust pending45Kmonthly downloads
  16. #16TensorRT-LLMNVIDIATrust pending12Kmonthly downloads
  17. #17RouteLLMlm-sysTrust pending9.3Kmonthly downloads
  18. #18Portkey GatewayPortkey-AITrust pending4.1Kmonthly downloads
  19. #19HeliconeHeliconeTrust pending3.9Kmonthly downloads
  20. #20Token.jstoken-jsTrust pending3.7Kmonthly downloads
  21. #21OpenLLMbentomlTrust pending1.8Kmonthly downloads

Community interest, no registry download data

Token & Cost Optimization - ranked by github stars

16 tracked
  1. #1OllamaollamaTrust pending178KGitHub stars
  2. #2llama.cppggerganovTrust pending122KGitHub stars
  3. #3Headroomheadroomlabs-aiTrust pending64KGitHub stars
  4. #4Anthropic Prompt CachinganthropicsTrust pending51KGitHub stars
  5. #5DeepSpeedmicrosoftTrust pending43KGitHub stars
  6. #6Vercel AI GatewayvercelTrust pending26KGitHub stars
  7. #7llamafileMozilla-OchoTrust pending25KGitHub stars
  8. #8TensorZerotensorzeroTrust pending12KGitHub stars
  9. #9Text Generation InferencehuggingfaceTrust pending11KGitHub stars
  10. #10BifrostmaximhqTrust pending7.0KGitHub stars
  11. #11ExLlamaV2turboderpTrust pending4.6KGitHub stars
  12. #12OptiLLMcodelionTrust pending4.2KGitHub stars
  13. #13LoRAXpredibaseTrust pending3.8KGitHub stars
  14. #14LangWatchlangwatchTrust pending3.5KGitHub stars
  15. #15LLMstudioTensorOpsAITrust pending388GitHub stars
  16. #16Prompt CachemesskanTrust pending243GitHub stars