Nexus

OmniRoute

1 min

Unified multi-provider LLM gateway with smart routing and token compression

diegosouzapw/OmniRoute on GitHub

Properties

Repository
diegosouzapw/OmniRoute ↗
Stars
78k
Updated
Language
TypeScript
License
MIT
Category
Model Routing, Context Optimization

Also in Model Routing

Also in Context Optimization

Contents

Features

  • Unified AI gateway for multi-provider LLM access
  • Quota-aware routing, auto-fallback & provider health management
  • Cost, context, cache & latency-aware model selection
  • Token compression (RTK, Caveman, LLMLingua-2)
  • Centralized configuration, telemetry & MCP/A2A interfaces

Notes

Local graph 0 backlinks