Higress AI Gateway (direct)

Self-hosted Higress AI Gateway spend tracking via customer-side instrumentation. Higress (github.com/alibaba/higress) is an open-source (Apache-2.0), Envoy/Istio-based cloud-native API gateway that originated at Alibaba and is now a CNCF Sandbox project; deployed by the customer via Docker or Helm, never embedded by Telara. Its AI-proxy plugin does OpenAI protocol conversion in front of 100+ model providers, so a customer's OpenAI-compatible client pointed at their own Higress base_url (there is no single shared URL — customers supply their own) is instrumented the same way as any OpenAI-compatible endpoint. No first-party Higress wrapper exists in telara-observability; use the generic OpenAI wrapper against the customer's Higress base_url. pip extra: pip install telara-observability[openai] Because Higress is self-hosted with no Telara-visible vendor invoice, there is no bulk usage/billing API to pull at all — OTLP push from customer instrumentation is the only signal Telara can see. Higress sits between the customer and whichever underlying model vendor it proxies to, so cost attribution lands on the gateway hop as instrumented, not on the origin model provider — a real chargeback limitation, and here also an availability limitation: if the customer does not instrument, there is nothing to attribute.