ColossalAI/colossalai/utils/memory_tracer
HELSON e6d50ec107
[zero] adapt zero for unsharded parameters (#561)
* support existing sharded and unsharded parameters in zero

* add unitest for moe-zero model init

* polish moe gradient handler
2022-03-31 18:34:11 +08:00
..
__init__.py move async memory to an individual directory (#345) 2022-03-11 15:50:28 +08:00
async_memtracer.py html refactor (#555) 2022-03-31 11:36:56 +08:00
memstats_collector.py [zero] dump memory stats for sharded model (#548) 2022-03-30 09:38:44 +08:00
model_data_memtracer.py [zero] adapt zero for unsharded parameters (#561) 2022-03-31 18:34:11 +08:00
test_async_memtracer.py move async memory to an individual directory (#345) 2022-03-11 15:50:28 +08:00
test_memstats_collector.py [zero] refactor model data tracing (#537) 2022-03-28 16:38:18 +08:00