ColossalAI/examples/language/openmoe/model
傅剑寒 279300dc5f
[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613)
* refactor compilation mechanism and unified multi hw

* fix file path bug

* add init.py to make pybind a module to avoid relative path error caused by softlink

* delete duplicated micros

* fix micros bug in gcc
2024-04-24 14:17:54 +08:00
..
__init__.py
convert_openmoe_ckpt.py [devops] remove post commit ci (#5566) 2024-04-08 15:09:40 +08:00
convert_openmoe_ckpt.sh
modeling_openmoe.py [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613) 2024-04-24 14:17:54 +08:00
openmoe_8b_config.json
openmoe_base_config.json
openmoe_policy.py [shardformer, pipeline] add `gradient_checkpointing_ratio` and heterogenous shard policy for llama (#5508) 2024-04-01 11:34:58 +08:00