9 Commits (afb239bbf83737655bf6b6baef2e261768d5c60f)

Author SHA1 Message Date
Frank Lee 80eba05b0a
[test] refactor tests with spawn (#3452) 2 years ago
ver217 26b7aac0be
[zero] reorganize zero/gemini folder structure (#3424) 2 years ago
Jiarui Fang 52c6ad26e0
[ColoTensor] reconfig ColoInitContext, decouple default_pg and default_dist_spec. (#1953) 2 years ago
Jiarui Fang 9f4fb3f28a
[ColoTensor] ColoInitContext initialize parameters in shard mode. (#1937) 2 years ago
Jiarui Fang 3ce4463fe6
[utils] remove lazy_memory_allocate from ColoInitContext (#1844) 2 years ago
Jiarui Fang 49832b2344
[refactory] add nn.parallel module (#1068) 3 years ago
ver217 ad536e308e
[tensor] refactor colo-tensor (#992) 3 years ago
Jiarui Fang d01d3b8cb0
colo init context add device attr. (#866) 3 years ago
Jiarui Fang 8789850eea
Init Conext supports lazy allocate model memory (#842) 3 years ago