github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

Merge pull request #4858 from Shawlleyw/main 

[doc]: typo in document of booster low_level_zero plugin
pull/4887/head
ppt0011 2023-10-06 09:27:54 +08:00 committed by GitHub
parent d1fcc0fa4d c97a3523db
commit 81ee91f2ca
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/booster/plugin/low_level_zero_plugin.py
View File

@ -226,7 +226,7 @@ class LowLevelZeroPlugin(DPPluginBase):
```
Args:
strage (int, optional): ZeRO stage. Defaults to 1.
stage (int, optional): ZeRO stage. Defaults to 1.
precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'.
initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32.
min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1.