PEFT#

Documentation from PEFT — Hugging Face’s Parameter-Efficient Fine-Tuning library.

Methods like LoRA, QLoRA, and prompt tuning that adapt large models by training a small number of extra parameters, drastically cutting the compute and storage cost of fine-tuning.