ColossalAI/examples/language/openmoe/benchmark
Wenhao Chen bb0a668fee
[hotfix] set return_outputs=False in examples and polish code (#5404)
* fix: simplify merge_batch

* fix: use return_outputs=False to eliminate extra memory consumption

* feat: add return_outputs warning

* style: remove `return_outputs=False` as it is the default value
2024-03-25 12:31:09 +08:00
..
benchmark_cai.py [hotfix] set return_outputs=False in examples and polish code (#5404) 2024-03-25 12:31:09 +08:00
benchmark_cai.sh [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
benchmark_cai_dist.sh [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
benchmark_fsdp.py [hotfix] fix typo of openmoe model source (#5403) 2024-03-05 21:44:38 +08:00
benchmark_fsdp.sh [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
hostfile.txt [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
utils.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00