Frank Lee
|
80eba05b0a
|
[test] refactor tests with spawn (#3452)
* [test] added spawn decorator
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
|
2 years ago |
ver217
|
26b7aac0be
|
[zero] reorganize zero/gemini folder structure (#3424)
* [zero] refactor low-level zero folder structure
* [zero] fix legacy zero import path
* [zero] fix legacy zero import path
* [zero] remove useless import
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] fix test import path
* [zero] fix test
* [zero] fix circular import
* [zero] update import
|
2 years ago |
Jiarui Fang
|
52c6ad26e0
|
[ColoTensor] reconfig ColoInitContext, decouple default_pg and default_dist_spec. (#1953)
|
2 years ago |
Jiarui Fang
|
9f4fb3f28a
|
[ColoTensor] ColoInitContext initialize parameters in shard mode. (#1937)
|
2 years ago |
Jiarui Fang
|
3ce4463fe6
|
[utils] remove lazy_memory_allocate from ColoInitContext (#1844)
|
2 years ago |
Jiarui Fang
|
49832b2344
|
[refactory] add nn.parallel module (#1068)
|
3 years ago |
ver217
|
ad536e308e
|
[tensor] refactor colo-tensor (#992)
* refactor colo-tensor and update linear op
* polish code
* polish code
* update ops and unit tests
* update unit tests
* polish code
* rename dist_spec module
* polish code
* polish code
* remove unneeded import
* fix pipelinable
|
3 years ago |
Jiarui Fang
|
d01d3b8cb0
|
colo init context add device attr. (#866)
|
3 years ago |
Jiarui Fang
|
8789850eea
|
Init Conext supports lazy allocate model memory (#842)
|
3 years ago |