github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Browse Source

Merge pull request #4858 from Shawlleyw/main 

[doc]: typo in document of booster low_level_zero plugin
pull/4887/head
ppt0011 1 year ago committed by GitHub
parent
d1fcc0fa4d c97a3523db
commit
81ee91f2ca
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Whitespace
Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL
Split View
Diff Options
Show Stats Download Patch File Download Diff File
  1. 2
      colossalai/booster/plugin/low_level_zero_plugin.py

2
colossalai/booster/plugin/low_level_zero_plugin.py
Unescape View File

@ -226,7 +226,7 @@ class LowLevelZeroPlugin(DPPluginBase):
```
Args:
strage (int, optional): ZeRO stage. Defaults to 1.
stage (int, optional): ZeRO stage. Defaults to 1.
precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'.
initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32.
min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1.

Write Preview
Loading…
Cancel
Save