ColossalAI/colossalai/utils/model
ver217 f8289d4221
[lazyinit] combine lazy tensor with dtensor (#3204)
* [lazyinit] lazy tensor add distribute

* [lazyinit] refactor distribute

* [lazyinit] add test dist lazy init

* [lazyinit] add verbose info for dist lazy init

* [lazyinit] fix rnn flatten weight op

* [lazyinit] polish test

* [lazyinit] polish test

* [lazyinit] fix lazy tensor data setter

* [lazyinit] polish test

* [lazyinit] fix clean

* [lazyinit] make materialize inplace

* [lazyinit] refactor materialize

* [lazyinit] refactor test distribute

* [lazyinit] fix requires_grad

* [lazyinit] fix tolist after materialization

* [lazyinit] refactor distribute module

* [lazyinit] polish docstr

* [lazyinit] polish lazy init context

* [lazyinit] temporarily skip test

* [lazyinit] polish test

* [lazyinit] add docstr
2023-03-23 10:53:06 +08:00
..
__init__.py fix import error (#880) 2022-04-26 19:28:40 +08:00
colo_init_context.py [gemini] fix colo_init_context (#2683) 2023-02-13 17:53:15 +08:00
experimental.py [lazyinit] combine lazy tensor with dtensor (#3204) 2023-03-23 10:53:06 +08:00
lazy_init_context.py [utils] fixed lazy init context (#1867) 2022-11-10 15:17:20 +08:00
utils.py [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00