You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/examples/language/openmoe/model
Yuanheng Zhao 12e7c28d5e
[hotfix] fix OpenMOE example import path (#5697)
7 months ago
..
__init__.py
convert_openmoe_ckpt.py [devops] remove post commit ci (#5566) 8 months ago
convert_openmoe_ckpt.sh
modeling_openmoe.py [hotfix] fix OpenMOE example import path (#5697) 7 months ago
openmoe_8b_config.json
openmoe_base_config.json
openmoe_policy.py [shardformer, pipeline] add `gradient_checkpointing_ratio` and heterogenous shard policy for llama (#5508) 8 months ago