ColossalAI/colossalai/tensor
Boyuan Yao 24246f7aa5
[autoparallel] Attach input, buffer and output tensor to MetaInfo class (#2162)
* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler

* [fx] add relu metainfo class

* [fx] restore profiler

* [autoparallel] modify metainfo input

* [autoparallel] add pooling metainfo

* [autoparallel] add F.linear metainfo generator

* [autoparallel] add binary elementwise metainfo

* [fx] recover profiler

* [autoparallel] fix forward memory calculation

* [autoparallel] modify constants.py

* [autoparallel] remove redundant print

* [autoparallel] add F.conv metainfo

* [autoparallel] linear fix

* [autoparallel] memory estimation for communication actions

* [autoparallel] fix docstring

* [autoparallel] fix variables name

* [autoparallel] attach tensor to metainfo class

* [autoparallel] fix dangerous try except

* [autoparallel] attach memory cost to shape consistency node

* [autoparallel] attach shape consistency node's metainfo to the node

* [autoparallel] remove todo in shape consistency memory estimation

* [autoparallel] fix the annotation
2022-12-28 13:37:40 +08:00
..
__init__.py [Gemini] ParamOpHook -> ColoParamOpHook (#2080) 2022-12-05 17:11:06 +08:00
colo_parameter.py [zero] fix error for BEiT models (#2169) 2022-12-26 15:03:54 +08:00
colo_tensor.py [zero] fix error for BEiT models (#2169) 2022-12-26 15:03:54 +08:00
comm_spec.py [autoparallel] add experimental permute handler (#2029) 2022-11-27 20:26:52 +08:00
compute_spec.py [NFC] polish doc style for ColoTensor (#1457) 2022-08-16 09:21:05 +08:00
const.py [Tensor] init ColoParameter (#914) 2022-05-06 12:57:14 +08:00
dist_spec_mgr.py [autoparallel] fix bugs caused by negative dim key (#1808) 2022-11-08 17:03:50 +08:00
distspec.py [Doc] add more doc for ColoTensor. (#1458) 2022-08-16 10:38:41 +08:00
op_wrapper.py [doc] update rst and docstring (#1351) 2022-07-21 15:54:53 +08:00
param_op_hook.py [zero] fix error for BEiT models (#2169) 2022-12-26 15:03:54 +08:00
process_group.py [doc] update docstring in ProcessGroup (#1468) 2022-08-19 13:41:57 +08:00
shape_consistency.py [autoparallel] Attach input, buffer and output tensor to MetaInfo class (#2162) 2022-12-28 13:37:40 +08:00
sharding_spec.py [autoparallel] fix bugs caused by negative dim key (#1808) 2022-11-08 17:03:50 +08:00
tensor_spec.py [autoparallel] fix bugs caused by negative dim key (#1808) 2022-11-08 17:03:50 +08:00
utils.py [autoparallel] mix gather (#1977) 2022-11-23 21:49:17 +08:00