ColossalAI/colossalai/tensor
ver217 ffa025e120
[tensor] dist spec s2s uses all-to-all (#1136)
* dist spec s2s uses all-to-all

* update unit test

* add sanity check

* polish unitest test with titans

* add sanity check for DistMgr

* add sanity check

Co-authored-by: jiaruifang <fangjiarui123@gmail.com>
2022-06-22 11:32:38 +08:00
..
graph [Graph] building computing graph with ColoTensor, Linear only (#917) 2022-05-07 17:10:37 +08:00
__init__.py [tensor] refactor param op hook (#1097) 2022-06-13 16:11:53 +08:00
chunk.py [gemini] gemini mgr supports "cpu" placement policy (#1118) 2022-06-15 15:05:19 +08:00
colo_parameter.py [ColoTensor] improves init functions. (#1150) 2022-06-21 18:28:38 +08:00
colo_tensor.py [ColoTensor] improves init functions. (#1150) 2022-06-21 18:28:38 +08:00
const.py [Tensor] init ColoParameter (#914) 2022-05-06 12:57:14 +08:00
dist_spec_mgr.py [tensor] dist spec s2s uses all-to-all (#1136) 2022-06-22 11:32:38 +08:00
distspec.py [Tensor] add module check and bert test (#1031) 2022-05-26 18:15:42 +08:00
op_wrapper.py [tensor] refactor colo-tensor (#992) 2022-05-19 12:44:59 +08:00
param_op_hook.py [hotfix] fix param op hook (#1131) 2022-06-17 16:12:05 +08:00
spec.py [ColoTensor] improves init functions. (#1150) 2022-06-21 18:28:38 +08:00
utils.py reorgnize colotensor directory (#1062) 2022-06-03 18:04:22 +08:00