We use llama-factory for finetuning and running prediction of our models.
First, download the open-source code: https://github.com/hiyouga/LLaMA-Factory
llamafactory-cli train examples/paper_sft.yaml
./run_prediction.sh
After obtaining the prediction files, we need to ensure the format is suitable for alpaca_eval to process.
./run_converter.sh