InternLM/internlm/model
ytxiong d67be17f96
refactor(*): refactor the code with no-apex (#170)
* support no-apex

* add default for use_apex

* fix lint

* modify the RMSNormTorch

* remove some comments

* remove use_apex parameter

* remove some unnecessary code

* optimize the code including import

* remove the import RMSNorm

* remove warnings
2023-08-03 11:24:12 +08:00
..
__init__.py feat(model/metrics.py): support calculating accuracy and perplexity m… (#91) 2023-07-26 16:22:10 +08:00
embedding.py [Dev] Pull Main (#139) 2023-07-27 10:20:21 +08:00
linear.py initial commit 2023-07-06 12:55:23 +08:00
loss.py initial commit 2023-07-06 12:55:23 +08:00
metrics.py feat(*): support not-flash-attn for pp and no-pp (#145) 2023-07-28 16:13:04 +08:00
modeling_internlm.py refactor(*): refactor the code with no-apex (#170) 2023-08-03 11:24:12 +08:00
multi_head_attention.py feat(*): support not-flash-attn for pp and no-pp (#145) 2023-07-28 16:13:04 +08:00
norm.py feat(*): support no apex (#166) 2023-08-02 20:32:38 +08:00
utils.py refactor(*): refactor the code with no-apex (#170) 2023-08-03 11:24:12 +08:00