ColossalAI/colossalai/tensor
ver217 67c33f57eb
[tensor] design DistSpec and DistSpecManager for ColoTensor (#934)
* add dist spec

* update linear op

* polish code

* polish code

* update embedding op

* polish unit tests

* polish unit tests

* polish comments

* polish code

* add test_dist_spec_mgr

* polish code

* refactor folder structure

* polish unit tests

* add get_process_group() for TensorSpec

* polish code
2022-05-13 15:13:52 +08:00
..
_ops [tensor] design DistSpec and DistSpecManager for ColoTensor (#934) 2022-05-13 15:13:52 +08:00
graph [Graph] building computing graph with ColoTensor, Linear only (#917) 2022-05-07 17:10:37 +08:00
optim [Tensor] initialize the ColoOptimizer (#898) 2022-04-28 15:23:40 +08:00
__init__.py [tensor] design DistSpec and DistSpecManager for ColoTensor (#934) 2022-05-13 15:13:52 +08:00
colo_parameter.py [Tensor] init ColoParameter (#914) 2022-05-06 12:57:14 +08:00
colo_tensor.py [tensor] design DistSpec and DistSpecManager for ColoTensor (#934) 2022-05-13 15:13:52 +08:00
const.py [Tensor] init ColoParameter (#914) 2022-05-06 12:57:14 +08:00
dist_spec.py [tensor] design DistSpec and DistSpecManager for ColoTensor (#934) 2022-05-13 15:13:52 +08:00
dist_spec_mgr.py [tensor] design DistSpec and DistSpecManager for ColoTensor (#934) 2022-05-13 15:13:52 +08:00
op_wrapper.py [tensor] reorganize files (#820) 2022-04-21 14:15:48 +08:00
spec.py [tensor] design DistSpec and DistSpecManager for ColoTensor (#934) 2022-05-13 15:13:52 +08:00
utils.py [Tensor] get named parameters for model using ColoTensors (#874) 2022-04-26 14:08:01 +08:00