Edenzzzz 8ec24b6a4d [Hoxfix] Fix CUDA_DEVICE_MAX_CONNECTIONS for comm overlap ... Co-authored-by: Edenzzzz <wtan45@wisc.edu>		2024-07-05 20:02:36 +08:00
..
__init__.py	[shardformer, pipeline] add `gradient_checkpointing_ratio` and heterogenous shard policy for llama (#5508)	2024-04-01 11:34:58 +08:00
grad_ckpt_config.py	[shardformer] refactor pipeline grad ckpt config (#5646)	2024-04-25 15:19:30 +08:00
shard_config.py	[MoE/ZeRO] Moe refactor with zero refactor (#5821)	2024-06-28 14:00:08 +08:00
sharder.py	[nfc] fix typo colossalai/shardformer/ (#5133)	2024-01-04 16:21:55 +08:00
shardformer.py	[Hoxfix] Fix CUDA_DEVICE_MAX_CONNECTIONS for comm overlap	2024-07-05 20:02:36 +08:00
utils.py	[pipeline] update shardformer policy	2023-08-15 23:25:14 +08:00