When I run the command bash scripts/streaming/eval.sh full, it shows "Loading model from lmsys/vicuna-13b-v1.3 ...". After a while, an error is reported: ValueError: The current 'device_map' had weights offloaded to the disk. I would like to know why this is the case and how to solve this problem. I guarantee that I have already installed safetensors.
Thank you very much.
When I run the command bash
scripts/streaming/eval.sh full, it shows"Loading model from lmsys/vicuna-13b-v1.3 ...". After a while, an error is reported:ValueError: The current 'device_map' had weights offloaded to the disk.I would like to know why this is the case and how to solve this problem. I guarantee that I have already installedsafetensors.Thank you very much.