TensorZero is an open-source LLM gateway that collects production inference data and uses it to continuously optimize prompts, route to better models, and generate fine-tuning datasets. It wraps existing LLM APIs and learns from real user feedback and outcomes to improve quality over time. Built for ML teams who want to systematically improve production AI systems.
TensorZero
tensorzero.com
Paid tool. Visit the site to view current pricing plans.