ColossalAI/colossalai/zero/low_level/bookkeeping
Hanks cc40fe0e6f
[fix] multi-node backward slowdown (#6134)
* remove redundant memcpy during backward

* get back record_stream
2024-11-14 17:45:49 +08:00
..
__init__.py [MoE/ZeRO] Moe refactor with zero refactor (#5821) 2024-06-28 14:00:08 +08:00
base_store.py [zero] support extra dp (#6123) 2024-11-12 11:20:46 +08:00
bucket_store.py [fix] multi-node backward slowdown (#6134) 2024-11-14 17:45:49 +08:00
gradient_store.py [FP8] rebase main (#5963) 2024-08-06 16:29:37 +08:00
tensor_bucket.py [zero] support extra dp (#6123) 2024-11-12 11:20:46 +08:00