InternLM/internlm/initialize
Wenwen Qu 2c5395fdfd
Doc(moe): add documentation for moe training (#411)
* add doc for moe

* fix moe and zero1 check in args_sanity_check

* restore moe config file
2023-10-19 10:01:12 +08:00
..
legacy feat(ckpt): fix checkpoint bugs and add feature enhancements. (#259) 2023-09-05 17:40:48 +08:00
__init__.py feat(numa): bind numa if possible (#320) 2023-09-25 19:34:52 +08:00
initialize_tensor.py feat(model): implement uniform_init for tensor. (#252) 2023-09-01 01:12:53 +08:00
initialize_trainer.py docs(*): add documentation and reST files for readthedocs (#272) 2023-09-06 15:36:03 +08:00
launch.py Doc(moe): add documentation for moe training (#411) 2023-10-19 10:01:12 +08:00