Releases: zetavg/LLaMA-LoRA-Tuner
Releases · zetavg/LLaMA-LoRA-Tuner
v0.0.20230421
New Features
Fine-tuning
- "Continue from model" now supports using a remote model from Hugging Face Hub.

- New advanced fine-tune arg:
lora_modules_to_save
- New advanced fine-tune arg:
8bit,FP16,BF16,gradient_checkpointing
- Support passing additional LoraConfig and TrainingArguments.
- "Load training parameters from selected model" will now also load the prompt template and dataset.
- Model
trainalbe%will be logged to wandb under configmodel.trainable%,model.all_paramsandmodel.trainable_params.
Initial Release
v0.0.20230420 fix