Search Results
2 results for “parameter-efficient”
Applications
LoRA (Low-Rank Adaptation)
LoRA is a parameter-efficient fine-tuning technique that adapts large pre-trained models by injecting small trainable low-rank matrices into transformer layers, drastically reducing the number of trainable parameters without sacrificing performance.
6 min readUpdated May 2026
Infrastructure
Parameter-Efficient Fine-Tuning
A family of techniques that adapts a pretrained language or vision model to a downstream task by training only a small fraction of its parameters, dramatically reducing compute, memory, and storage requirements compared to full fine-tuning.
5 min readUpdated May 2026