HELSON 077a5cdde4 [zero] fix gradient clipping in hybrid parallelism (#2521) ... * [zero] fix gradient clipping in hybrid parallelism * [testing] change model name to avoid pytest warning * [hotfix] fix unit testing		2023-01-29 15:09:57 +08:00
..
init_ctx	[moe] fix MoE bugs (#1628)	2022-09-22 13:56:30 +08:00
shard_utils	[gemini] add GeminiMemoryManger (#832)	2022-04-24 13:08:48 +08:00
sharded_model	[Gemini] update API of the chunkmemstatscollector. (#2129)	2022-12-14 00:47:06 +08:00
sharded_optim	[zero] fix gradient clipping in hybrid parallelism (#2521)	2023-01-29 15:09:57 +08:00
sharded_param	[NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717)	2022-10-19 12:20:51 +08:00
utils	[ddp] add is_ddp_ignored (#2434)	2023-01-11 12:22:45 +08:00
__init__.py	[Gemini] add GeminiAdamOptimizer (#1960)	2022-11-16 14:44:28 +08:00