Buoyant has released Kinference, an Apache 2.0 inference control plane for vLLM on Kubernetes. It adds declarative routing policies, KV-cache-aware load balancing and per-tenant metrics, and cut median TTFT 95% in Buoya…
Open-weights releases pressure closed pricing and widen access, changing the build-vs-buy math for the whole ecosystem.
Summaries are aggregated for information only — follow the source link for the full story. Demo entries are illustrative.