Issues

• The use of quality value and weighted reward.

  THUDM/ReST-MCTS#28 · Filter by author OneCoin123 opened on Mar 3, 2026

• What dataset is D_G for policy SFT in 0-th iteration and further MCTS* ?

  THUDM/ReST-MCTS#26 · Filter by author RewindL opened on Feb 7, 2025

• The training of policy model

  THUDM/ReST-MCTS#25 · Filter by author RewindL opened on Feb 5, 2025

• Quality of VM

  THUDM/ReST-MCTS#24 · Filter by author RewindL opened on Jan 21, 2025

• Some Problem about PRM model

  THUDM/ReST-MCTS#22 · Filter by author Alex-Dou123 opened on Jan 19, 2025

• How to verify the string answer for MATH dataset?

  THUDM/ReST-MCTS#21 · Filter by author yuxiaooye opened on Jan 17, 2025
  3

• What is the difference between reward_model_type=='vm' and reward_model_type=='prm'?

  THUDM/ReST-MCTS#20 · Filter by author shawnye2000 opened on Jan 10, 2025
  1

• code for generate data for policy and PRM?

  about dataset
  THUDM/ReST-MCTS#19 · Filter by author Xccanxin opened on Dec 31, 2024
  5

• 是否有实际使用的产品应用此算法？

  THUDM/ReST-MCTS#18 · Filter by author RyanOvO opened on Dec 28, 2024

• sft training

  about training
  THUDM/ReST-MCTS#17 · Filter by author wangxichi opened on Dec 26, 2024
  7

• Issue: FileNotFoundError when running self_train_dpo.py

  about dataset
  THUDM/ReST-MCTS#15 · Filter by author KaiyuHu2001 opened on Dec 18, 2024
  1

• About the synthetic data generation

  about dataset
  THUDM/ReST-MCTS#14 · Filter by author yeppp27 opened on Dec 8, 2024
  3

• safetensors_rust.SafetensorError: Error while deserializing header: MetadataIncompleteBuffer

  about training
  THUDM/ReST-MCTS#13 · Filter by author LYZ-123-XYZ opened on Dec 6, 2024

• Formula 2 & Observation 2

  about PRM
  THUDM/ReST-MCTS#12 · Filter by author renmengjie7 opened on Dec 4, 2024
  2

• Coding style & details of README

  about readme
  THUDM/ReST-MCTS#11 · Filter by author Wloner0809 opened on Dec 1, 2024

• The difference between 'vm' and 'prm' in 'reward_model_type'?

  about PRM
  THUDM/ReST-MCTS#10 · Filter by author Aurora-slz opened on Nov 28, 2024
  2

• Why is the response truncated[:5]?

  about training
  THUDM/ReST-MCTS#9 · Filter by author wphtrying opened on Oct 25, 2024
  1

• distributed training of VM

  about training
  THUDM/ReST-MCTS#8 · Filter by author skepsun opened on Oct 18, 2024
  1

• Hope for a more detailed README!

  about readme
  THUDM/ReST-MCTS#6 · Filter by author PKUfreshman opened on Oct 11, 2024
  5

• What is VALUE_MODEL_STATE_DICT?

  about readme
  THUDM/ReST-MCTS#5 · Filter by author dszpr opened on Oct 11, 2024
  3

• Could you release the weights of PRM?

  about datasetabout PRM
  THUDM/ReST-MCTS#4 · Filter by author cybisolated opened on Sep 30, 2024
  7

• PRM "True" probability

  about PRM
  THUDM/ReST-MCTS#3 · Filter by author rawsh opened on Sep 20, 2024
  1

• Utilization of negative samples

  about dataset
  THUDM/ReST-MCTS#2 · Filter by author HillZhang1999 opened on Jun 25, 2024
  1

• Environment is missing

  environment setup
  THUDM/ReST-MCTS#1 · Filter by author XuweiyiChen opened on Jun 20, 2024
  4