hxwang cb01c0d5ce [moe] refactor mesh assignment		2024-08-01 10:06:59 +08:00
..
__init__.py	[shardformer, pipeline] add `gradient_checkpointing_ratio` and heterogenous shard policy for llama (#5508)	2024-04-01 11:34:58 +08:00
grad_ckpt_config.py	[shardformer] refactor pipeline grad ckpt config (#5646)	2024-04-25 15:19:30 +08:00
shard_config.py	[moe] refactor mesh assignment	2024-08-01 10:06:59 +08:00
sharder.py	[nfc] fix typo colossalai/shardformer/ (#5133)	2024-01-04 16:21:55 +08:00
shardformer.py	[Hoxfix] Fix CUDA_DEVICE_MAX_CONNECTIONS for comm overlap	2024-07-05 20:02:36 +08:00
utils.py	[pipeline] update shardformer policy	2023-08-15 23:25:14 +08:00