InternLM/internlm/model
YWMditto 8464425a7b
feat(mdoel): add DynamicNTKScalingRotaryEmbedding (#339)
* add dynamic ntk rope

* update dynamic ntk rope

* fix lint check

* fix lint check

* add more desc

---------

Co-authored-by: YWMditto <862779238@qq.com>
2023-09-20 23:31:47 +08:00
..
__init__.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
embedding.py feat(mdoel): add DynamicNTKScalingRotaryEmbedding (#339) 2023-09-20 23:31:47 +08:00
linear.py feat(linear): optimize mlp by using jit (#321) 2023-09-19 14:57:43 +08:00
loss.py initial commit 2023-07-06 12:55:23 +08:00
metrics.py fix(metric): argument missing in getting loss metrics. (#256) 2023-08-31 17:44:39 +08:00
modeling_internlm.py feat(mdoel): add DynamicNTKScalingRotaryEmbedding (#339) 2023-09-20 23:31:47 +08:00
multi_head_attention.py feat(mdoel): add DynamicNTKScalingRotaryEmbedding (#339) 2023-09-20 23:31:47 +08:00
norm.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
utils.py feat(linear): optimize mlp by using jit (#321) 2023-09-19 14:57:43 +08:00