ColossalAI/colossalai
Frank Lee 89f45eda5a [shardformer] added development protocol for standardization (#4149) 2023-07-04 16:05:01 +08:00
..
_C
_analyzer
amp
auto_parallel [test] fixed tests failed due to dtensor change (#4082) 2023-07-04 16:05:01 +08:00
autochunk
booster
builder
checkpoint_io [test] fixed tests failed due to dtensor change (#4082) 2023-07-04 16:05:01 +08:00
cli
cluster
communication
context
device [device] support init device mesh from process group (#3990) 2023-07-04 16:05:01 +08:00
engine
fx
interface
kernel
lazy [test] fixed tests failed due to dtensor change (#4082) 2023-07-04 16:05:01 +08:00
logging
nn [shardformer] integrated linear 1D with dtensor (#3996) 2023-07-04 16:05:01 +08:00
pipeline
registry
shardformer [shardformer] added development protocol for standardization (#4149) 2023-07-04 16:05:01 +08:00
tensor [test] fixed tests failed due to dtensor change (#4082) 2023-07-04 16:05:01 +08:00
testing [shardformer] adapted T5 and LLaMa test to use kit (#4049) 2023-07-04 16:05:01 +08:00
trainer
utils
zero
__init__.py
constants.py
core.py
global_variables.py
initialize.py