Tag: Multi Tenant

2 articles

• LLM LoRA Adapter Cache in Production: Reducing Dynamic Loading Jitter with Hot/Cold Tiering and Eviction Strategies

  This article covers production governance for LoRA adapter caches in multi-tenant LLM serving, including dynamic loading, hot/cold tiering, eviction strategies, tenant quotas, version releases, and go-live checks to reduce first-token latency and GPU memory jitter.

  07/05/2026 LLM Serving / LoRA / Adapter Cache / Inference Infrastructure / Hot/Cold Tiering / Multi-Tenant / Dynamic Loading / Eviction Strategy

• Multi-LoRA Production Practices: Stable Multi-Tenant Inference with Adapter Caching and Hot/Cold Tiering

  A systematic guide to Multi-LoRA serving in production: adapter caching, hot/cold tiering, rank-aware scheduling, eviction strategies, and deployment checks to stably serve hundreds of custom LoRA adapters under GPU memory constraints.

  07/01/2026 LLM Serving / LoRA / Inference / GPU / Multi Tenant / Adapter Cache / vLLM