Search Results
3 results for “LoRA”
Applications
Fine-Tuning
The process of further training a pre-trained machine learning model on a smaller, task-specific dataset to adapt its weights for a particular domain, task, or desired behaviour.
6 min readUpdated May 2026
Applications
LoRA (Low-Rank Adaptation)
LoRA is a parameter-efficient fine-tuning technique that adapts large pre-trained models by injecting small trainable low-rank matrices into transformer layers, drastically reducing the number of trainable parameters without sacrificing performance.
6 min readUpdated May 2026
Infrastructure
Parameter-Efficient Fine-Tuning
A family of techniques that adapts a pretrained language or vision model to a downstream task by training only a small fraction of its parameters, dramatically reducing compute, memory, and storage requirements compared to full fine-tuning.
5 min readUpdated May 2026