github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Browse Source

update readme (#6116)

pull/5294/merge
Tong Li 2 weeks ago committed by GitHub
parent
a15ab139ad
commit
7a60161035
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Whitespace
Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL
Unified View
Diff Options
Show Stats Download Patch File Download Diff File
  1. 2
      applications/ColossalChat/README.md

2
applications/ColossalChat/README.md
Unescape View File

@ -284,7 +284,7 @@ For more details, see [`inference/`](https://github.com/hpcaitech/ColossalAI/tre
## O1 Journey ## O1 Journey
### Inference with Self-refined MCTS ### Inference with Self-refined MCTS
We provide the implementation of MCT Self-Refine (MCTSr) algorithm, an innovative integration of Large Language Models with Monte Carlo Tree Search. We provide the implementation of MCT Self-Refine (MCTSr) algorithm, an innovative integration of Large Language Models with Monte Carlo Tree Search.
To run inference with MCTS, simply use the following script. You can serve model using vLLM and update the config file in `Qwen32B_prompt_CFG` and then run the following script.
```python ```python
from coati.reasoner.guided_search.mcts import MCTS from coati.reasoner.guided_search.mcts import MCTS
from coati.reasoner.guided_search.prompt_store.qwen import Qwen32B_prompt_CFG from coati.reasoner.guided_search.prompt_store.qwen import Qwen32B_prompt_CFG

Write Preview
Loading…
Cancel
Save