Models - Aug 4, 2026

SageMaker Full Fine-Tuning vs. LoRA

Quick answer

In SageMaker model customization, full fine-tuning (FFT) updates all model parameters; LoRA is parameter-efficient and updates a smaller adaptation. AWS now supports FFT for more than 25 open-source models, but the exact model-and-technique matrix is not uniform.

Start with LoRA when you want a smaller, faster experiment for a bounded behavior change. Test FFT when the use case needs deeper adaptation to terminology, task structure, output formats, reasoning patterns, or domain knowledge—and when you can support the larger training and regression burden.

Neither method is automatically more accurate, cheaper, or deployable for your workload.

Decision table

QuestionLoRA starting pointFull fine-tuning starting point
Change depthNarrow style or behavior adaptationBroader model adaptation
Experiment speedPrefer a lower-scope first testAccept a larger training job
Data maturityLimited but curated task dataLarger, diverse, rights-cleared corpus
Regression tolerancePreserve more base behaviorMeasure broad capability drift
Artifact strategyManage an adapter and compatible baseManage a complete customized model
SupportCheck LoRA cell for model + techniqueCheck FFT cell for model + technique

AWS’s matrix separates SFT, DPO, RLVR, and RLAIF, each with LoRA and FFT columns. A model supporting SFT with FFT does not prove it supports DPO or RLVR with FFT.

Run a fair comparison

  1. Pin one base model, Region, dataset, and evaluation holdout.
  2. Choose the same customization objective and acceptance threshold.
  3. Use documented starting recipes; record every hyperparameter difference.
  4. Measure task quality, regressions, safety, training usage, artifact size, and serving behavior.
  5. Compare total cost per approved output, not job duration alone.
  6. Repeat enough runs to distinguish a stable result from sampling noise.
  7. Approve the simplest method meeting the task and governance requirements.

Do not use training loss as the deployment decision. Include human-reviewed cases, base-model comparisons, adversarial examples, and production-like latency and throughput tests.

Check the current models and Regions guide before designing the experiment. Use the setup guide for IAM and submission, and the deployment guide after evaluation.

Frequently asked questions

What is the difference between full fine-tuning and LoRA in SageMaker?

Full fine-tuning updates all model parameters, while LoRA is parameter-efficient and updates a smaller learned adaptation. The available choice depends on the exact model and customization technique in AWS’s current support matrix.

When should I test full fine-tuning first?

Test it when the workload requires deeper adaptation and you have enough high-quality data, evaluation coverage, budget, and regression controls to justify changing all parameters.

Is LoRA always cheaper or better?

No universal result follows from the method name. Compare both supported configurations on the same data, evaluation set, training budget, deployment target, and accepted-output metric.

Official sources

Source check: August 4, 2026. Verify the current model-by-technique matrix, training recipes, prices, quotas, licenses, and deployment compatibility before choosing a method.