finetuning_config = model.finetuning_config()
finetuning_config.output_dir = "model_cp/"
Changing the model's output directory as above (mentioned in https://xturing.stochastic.ai/configuration/finetune_configure/ ).
This is having no effect in Databricks and the model checkpoints are still getting stored in the default location "saved_model".