InternLM/internlm/model
Wenwen Qu bf6dbf07fa add share embedding weight support for moe 2023-10-18 11:39:04 +08:00
..
__init__.py feat(moe): add moe module (#182) 2023-09-27 15:54:53 +08:00
embedding.py fix(model/embedding.py): ci lint check error (#345) 2023-09-21 14:46:22 +08:00
linear.py add share embedding weight support for moe 2023-10-18 11:39:04 +08:00
loss.py initial commit 2023-07-06 12:55:23 +08:00
metrics.py feat(train): add fsdp training option (#293) 2023-10-09 18:59:31 +08:00
modeling_internlm.py feat(mdoel): add DynamicNTKScalingRotaryEmbedding (#339) 2023-09-20 23:31:47 +08:00
modeling_moe.py add share embedding weight support for moe 2023-10-18 11:39:04 +08:00
moe.py feat(moe): add moe module (#182) 2023-09-27 15:54:53 +08:00
multi_head_attention.py fix(model): fix errant inference_forward (#396) 2023-10-09 08:29:11 -05:00
norm.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
utils.py feat(moe): add moe module (#182) 2023-09-27 15:54:53 +08:00