Commit Graph

8 Commits (ab8c6b4a0ec35613618ce1e96d5d9ad7a7320a1b)

Author SHA1 Message Date
LuGY 13ed4b6441
[model zoo] add activation offload for gpt model (#582)
3 years ago
ver217 d70f43dd7a
embedding remove attn mask (#474)
3 years ago
ver217 1559c0df41
fix attn mask shape of gpt (#472)
3 years ago
ver217 304263c2ce
fix gpt attention mask (#461)
3 years ago
Frank Lee 0f5f5dd556
fixed gpt attention mask in pipeline (#430)
3 years ago
アマデウス 9ee197d0e9 moved env variables to global variables; (#215)
3 years ago
ver217 7904baf6e1
fix layers/schedule for hybrid parallelization (#111) (#112)
3 years ago
アマデウス e5b9f9a08d
added gpt model & benchmark (#95)
3 years ago