LLM μP Hyperparameter Cross-Scale Transfer in Production: Reducing Large Model Tuning Costs with Base Shape Fingerprints, Coord Checks, and Proxy Sweeps
A systematic breakdown of μP hyperparameter cross-scale transfer principles and engineering boundaries, covering how to solidify Base Shapes, run Coord Checks, organize proxy model sweeps with regression gates, and avoid misapplying width transfer to training duration, batch size, or architectural changes.