Tenant-Centric Quota Management with Manual Overrides
Managing resource quotas across multiple tenants can be challenging, especially when the need for manual overrides arises. This post explores how we refactored our token usage service to implement a tenant-centric quota system with support for manual adjustments.
The Challenge
Previously, our token quota management was user-based. This created inefficiencies when the context already provided