ColossalAI/colossalai
ver217 6ae8ed0407
[lazyinit] add correctness verification (#3147)
* [lazyinit] fix shared module

* [tests] add lazy init test utils

* [tests] add torchvision for lazy init

* [lazyinit] fix pre op fn

* [lazyinit] handle legacy constructor

* [tests] refactor lazy init test models

* [tests] refactor lazy init test utils

* [lazyinit] fix ops don't support meta

* [tests] lazy init test timm models

* [lazyinit] fix set data

* [lazyinit] handle apex layers

* [tests] lazy init test transformers models

* [tests] lazy init test torchaudio models

* [lazyinit] fix import path

* [tests] lazy init test torchrec models

* [tests] update torch version in CI

* [tests] revert torch version in CI

* [tests] skip lazy init test
2023-03-17 13:49:04 +08:00
..
_C
_analyzer [analyzer] a minimal implementation of static graph analyzer (#2852) 2023-03-10 13:21:05 +08:00
amp
auto_parallel [hotfix] add shard dim to aviod backward communication error (#2954) 2023-03-01 11:41:53 +08:00
autochunk [autochunk] support vit (#3084) 2023-03-10 10:23:26 +08:00
booster [booster] implemented mixed precision class (#3151) 2023-03-17 11:00:15 +08:00
builder
cli
communication
context
device
engine [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00
fx [analyzer] a minimal implementation of static graph analyzer (#2852) 2023-03-10 13:21:05 +08:00
gemini [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00
kernel [kernel] added kernel loader to softmax autograd function (#3093) 2023-03-10 14:27:09 +08:00
logging
nn [format] applied code formatting on changed files in pull request 2997 (#3008) 2023-03-06 10:42:22 +08:00
pipeline [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
registry
tensor [DTensor] refactor dtensor with new components (#3089) 2023-03-14 16:25:47 +08:00
testing
trainer
utils [lazyinit] add correctness verification (#3147) 2023-03-17 13:49:04 +08:00
zero [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00
__init__.py
constants.py
core.py
global_variables.py
initialize.py