ColossalAI/colossalai/zero
Jiarui Fang 2938edf446
[Gemini] update the non model data record method in runtime memory tracer (#2128)
2022-12-13 17:11:31 +08:00
..
init_ctx [moe] fix MoE bugs (#1628) 2022-09-22 13:56:30 +08:00
shard_utils [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
sharded_model [Gemini] use MemStats to store the tracing data. Seperate it from Collector. (#2084) 2022-12-06 16:43:06 +08:00
sharded_optim [zero] test gradient accumulation (#1964) 2022-11-29 13:00:30 +08:00
sharded_param [NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717) 2022-10-19 12:20:51 +08:00
utils [Gemini] update the non model data record method in runtime memory tracer (#2128) 2022-12-13 17:11:31 +08:00
__init__.py [Gemini] add GeminiAdamOptimizer (#1960) 2022-11-16 14:44:28 +08:00