ColossalAI/tests/test_moe
Wenhao Chen bb0a668fee
[hotfix] set return_outputs=False in examples and polish code (#5404)
* fix: simplify merge_batch

* fix: use return_outputs=False to eliminate extra memory consumption

* feat: add return_outputs warning

* style: remove `return_outputs=False` as it is the default value
2024-03-25 12:31:09 +08:00
..
moe_utils.py [moe] init mixtral impl 2024-02-07 19:21:02 +08:00
test_grad_handler.py [npu] change device to accelerator api (#5239) 2024-01-09 10:20:05 +08:00
test_kernel.py [npu] change device to accelerator api (#5239) 2024-01-09 10:20:05 +08:00
test_moe_checkpoint.py [hotfix] set return_outputs=False in examples and polish code (#5404) 2024-03-25 12:31:09 +08:00
test_moe_ep_tp.py [npu] change device to accelerator api (#5239) 2024-01-09 10:20:05 +08:00
test_moe_group.py [npu] change device to accelerator api (#5239) 2024-01-09 10:20:05 +08:00
test_moe_hybrid_zero.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_load_balance.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_router.py [moe] fix tests 2024-02-08 12:46:37 +08:00
test_moe_zero_fwd_bwd.py [moe] init mixtral impl 2024-02-07 19:21:02 +08:00
test_moe_zero_optim.py [moe] init mixtral impl 2024-02-07 19:21:02 +08:00