ColossalAI/colossalai/zero
HELSON 6e51d296f0
[zero] migrate zero1&2 (#1878)
* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test
2022-11-11 09:26:40 +08:00
..
init_ctx [moe] fix MoE bugs (#1628) 2022-09-22 13:56:30 +08:00
shard_utils [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
sharded_model MemStatsCollectorStatic (#1765) 2022-11-07 16:49:03 +08:00
sharded_optim [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
sharded_param [NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717) 2022-10-19 12:20:51 +08:00
utils [zero] add constant placement policy (#1705) 2022-10-14 17:53:16 +08:00
__init__.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
zero_optimizer.py [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786) 2022-11-02 16:11:34 +08:00