github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

Merge pull request #4858 from Shawlleyw/main

Browse Source 
[doc]: typo in document of booster low_level_zero plugin
pull/4887/head
ppt0011 1 year ago committed by GitHub
parent d1fcc0fa4d c97a3523db
commit 81ee91f2ca
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File

2
colossalai/booster/plugin/low_level_zero_plugin.py
Unescape View File

@ -226,7 +226,7 @@ class LowLevelZeroPlugin(DPPluginBase):
``` ```
Args: Args:
strage (int, optional): ZeRO stage. Defaults to 1. stage (int, optional): ZeRO stage. Defaults to 1.
precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'. precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'.
initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32. initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32.
min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1. min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1.

Write Preview
Loading…
Cancel
Save