Tag: SFT

2 articles

• LLM SFT Sequence Packing in Production: Boosting Throughput with Sample Boundaries, Loss Mask, and Length Buckets

  A practical guide to implementing safe Sequence Packing for SFT training, covering attention isolation, loss masking, position IDs, length bucketing, and validation gates to eliminate padding waste without cross-sample contamination.

  07/14/2026 LLM Training / SFT / Sequence Packing / FlashAttention / Data Collator

• LLM Fine-tuning Dataset Version Governance in Production: Using Data Lineage, Evaluation Gates, and Rollback Strategies to Prevent SFT Degradation

  A practical guide to versioning LLM fine-tuning datasets in production, covering sample lineage, train-test splits, evaluation gates, experiment tracking, rollback strategies, and pre-release checklists to prevent SFT degradation from dirty data, biased samples, or incorrect labels.

  07/07/2026 LLM Fine-tuning / SFT / Dataset Governance / MLOps / Evals