Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
HELSON d565a24849
[zero] add unit testings for hybrid parallelism (#2486)
2 years ago
..
init_ctx
shard_utils
sharded_model [Gemini] update API of the chunkmemstatscollector. (#2129) 2 years ago
sharded_optim [zero] add unit testings for hybrid parallelism (#2486) 2 years ago
sharded_param [NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717) 2 years ago
utils [ddp] add is_ddp_ignored (#2434) 2 years ago
__init__.py [Gemini] add GeminiAdamOptimizer (#1960) 2 years ago