You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/cluster
Edenzzzz 43995ee436
[Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694)
7 months ago
..
__init__.py
device_mesh_manager.py
dist_coordinator.py
process_group_manager.py
process_group_mesh.py [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 7 months ago