Tag: LoRA

3 articles

• LLM LoRA Adapter Cache in Production: Reducing Dynamic Loading Jitter with Hot/Cold Tiering and Eviction Strategies

  This article covers production governance for LoRA adapter caches in multi-tenant LLM serving, including dynamic loading, hot/cold tiering, eviction strategies, tenant quotas, version releases, and go-live checks to reduce first-token latency and GPU memory jitter.

  07/05/2026 LLM Serving / LoRA / Adapter Cache / Inference Infrastructure / Hot/Cold Tiering / Multi-Tenant / Dynamic Loading / Eviction Strategy

• Multi-LoRA Production Practices: Stable Multi-Tenant Inference with Adapter Caching and Hot/Cold Tiering

  A systematic guide to Multi-LoRA serving in production: adapter caching, hot/cold tiering, rank-aware scheduling, eviction strategies, and deployment checks to stably serve hundreds of custom LoRA adapters under GPU memory constraints.

  07/01/2026 LLM Serving / LoRA / Inference / GPU / Multi Tenant / Adapter Cache / vLLM

• Multi-LoRA Serving in Practice: Serving Multiple Business Adapters with One Base Model

  A practical guide to Multi-LoRA Serving: how to share one base model across multiple LoRA adapters for cost-effective, multi-tenant LLM inference.

  06/30/2026 LLM Serving / LoRA / PEFT / Inference Optimization