You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/zero
HELSON b528eea0f0
[zero] add zero wrappers (#2523)
2 years ago
..
init_ctx [moe] fix MoE bugs (#1628) 2 years ago
shard_utils [gemini] add GeminiMemoryManger (#832) 3 years ago
sharded_model [Gemini] update API of the chunkmemstatscollector. (#2129) 2 years ago
sharded_optim [zero] add zero wrappers (#2523) 2 years ago
sharded_param [NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717) 2 years ago
utils [ddp] add is_ddp_ignored (#2434) 2 years ago
__init__.py [Gemini] add GeminiAdamOptimizer (#1960) 2 years ago