mirror of https://github.com/hpcaitech/ColossalAI
![]() * Adapted to the baichuan2-7B model * modified according to the review comments. * Modified the method of obtaining random weights. * modified according to the review comments. * change mlp layewr 'NOTE' |
||
---|---|---|
.. | ||
test_attention.py | ||
test_baichuan.py |