ColossalAI/colossalai/nn/layer
Frank Lee 7cfed5f076
[feat] refactored extension module (#5298)
* [feat] refactored extension module

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish
2024-01-25 17:01:48 +08:00
..
__init__.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
colo_attention.py [feat] refactored extension module (#5298) 2024-01-25 17:01:48 +08:00
layernorm.py [feat] refactored extension module (#5298) 2024-01-25 17:01:48 +08:00
scaled_softmax.py [feat] refactored extension module (#5298) 2024-01-25 17:01:48 +08:00
utils.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00