ver217 fc8e6db005 [doc] Update docstring for ZeRO (#459) ... * polish sharded model docstr * polish sharded optim docstr * polish zero docstr * polish shard strategy docstr		2022-03-18 16:48:20 +08:00
..
amp	[hotfix] fix initialize bug with zero (#442)	2022-03-17 13:16:22 +08:00
builder	…
communication	fix format (#332)	2022-03-11 15:50:28 +08:00
context	add moe context, moe utilities and refactor gradient handler (#455)	2022-03-18 16:38:32 +08:00
engine	add moe context, moe utilities and refactor gradient handler (#455)	2022-03-18 16:38:32 +08:00
kernel	…
logging	[log] better logging display with rich (#426)	2022-03-16 09:51:15 +08:00
nn	[test] make zero engine test really work (#447)	2022-03-17 17:24:25 +08:00
registry	…
testing	optimized context test time consumption (#446)	2022-03-17 14:40:52 +08:00
trainer	…
utils	add moe context, moe utilities and refactor gradient handler (#455)	2022-03-18 16:38:32 +08:00
zero	[doc] Update docstring for ZeRO (#459)	2022-03-18 16:48:20 +08:00
__init__.py	…
constants.py	fix format constants.py (#358)	2022-03-11 15:50:28 +08:00
core.py	add moe context, moe utilities and refactor gradient handler (#455)	2022-03-18 16:38:32 +08:00
global_variables.py	…
initialize.py	[zero] Update initialize for ZeRO (#458)	2022-03-18 16:18:31 +08:00