ColossalAI/colossalai/zero
ver217 be01db37c8
[tensor] refactor chunk mgr and impl MemStatsCollectorV2 (#1077)
* polish chunk manager

* polish unit test

* impl add_extern_static_tensor for chunk mgr

* add mem stats collector v2

* polish code

* polish unit test

* polish code

* polish get chunks
2022-06-09 20:56:34 +08:00
..
init_ctx [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
shard_utils [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
sharded_model fix import error in sharded model v2 (#1053) 2022-06-02 13:48:22 +08:00
sharded_optim [gemini] accelerate adjust_layout() (#878) 2022-04-26 18:08:31 +08:00
sharded_param [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
utils [tensor] refactor chunk mgr and impl MemStatsCollectorV2 (#1077) 2022-06-09 20:56:34 +08:00
__init__.py [zero] add zero optimizer for ColoTensor (#1046) 2022-06-02 12:13:15 +08:00
zero_optimizer.py [tensor] refactor chunk mgr and impl MemStatsCollectorV2 (#1077) 2022-06-09 20:56:34 +08:00