LLM GPU Multi-Tenant Isolation in Production: Sharing Inference Stably with MIG Profiles, Time-Slicing Layering, and Reconfiguration Gates
A systematic guide to MIG, Time-Slicing, and MPS isolation differences for LLM inference on shared GPUs. Covers profile selection, Kubernetes scheduling, reconfiguration gates, monitoring, and rollback to build a verifiable production plan balancing utilization, latency, and fault boundaries.