ColossalAI/examples/tutorial/sequence_parallel/model/layers
Hongxin Liu 554aa9592e
[legacy] move communication and nn to legacy and refactor logger (#4671)
* [legacy] move communication to legacy (#4640)

* [legacy] refactor logger and clean up legacy codes (#4654)

* [legacy] make logger independent to gpc

* [legacy] make optim independent to registry

* [legacy] move test engine to legacy

* [legacy] move nn to legacy (#4656)

* [legacy] move nn to legacy

* [checkpointio] fix save hf config

* [test] remove useledd rpc pp test

* [legacy] fix nn init

* [example] skip tutorial hybriad parallel example

* [devops] test doc check

* [devops] test doc check
2023-09-11 16:24:28 +08:00
..
__init__.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00
bert_layer.py [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
dropout.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00
embedding.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00
head.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00
init_method.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00
linear.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00
mlp.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00
pooler.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00
preprocess.py [tutorial] edited hands-on practices (#1899) 2022-11-11 17:08:17 +08:00