ColossalAI/colossalai/auto_parallel/tensor_shard/node_handler/strategy
YuliangLiu0306 47fb214b3b
[hotfix] add shard dim to aviod backward communication error (#2954)
2023-03-01 11:41:53 +08:00
..
__init__.py [autoparallel] refactor handlers which reshape input tensors (#2615) 2023-02-08 15:02:49 +08:00
batch_norm_generator.py [autoparallel] adapt handlers with attention block (#1990) 2022-11-21 10:44:11 +08:00
binary_elementwise_generator.py [autoparallel] added binary elementwise node handler (#1758) 2022-10-25 14:32:01 +08:00
conv_strategy_generator.py [autoparallel] fix conv handler numerical test (#1771) 2022-11-01 10:43:44 +08:00
embedding_generator.py [autoparallel]add embedding handler (#2089) 2022-12-07 09:41:46 +08:00
getattr_generator.py [autoparallel] update_getattr_handler (#2193) 2022-12-26 21:57:39 +08:00
getitem_generator.py [autoparallel] update getitem handler (#2207) 2022-12-27 19:58:32 +08:00
layer_norm_generator.py [autoparallel] complete gpt block searching (#2065) 2022-12-06 10:17:10 +08:00
matmul_strategy_generator.py [autoparallel] distinguish different parallel strategies (#2699) 2023-02-15 22:28:28 +08:00
normal_pooling_generator.py [autoparallel] fix bugs caused by negative dim key (#1808) 2022-11-08 17:03:50 +08:00
output_generator.py [autoparallel] add split handler (#2032) 2022-11-29 11:03:51 +08:00
placeholder_generator.py [autoparallel] support distributed dataloader option (#1906) 2022-11-17 20:11:53 +08:00
reshape_generator.py [hotfix] add shard dim to aviod backward communication error (#2954) 2023-03-01 11:41:53 +08:00
softmax_generator.py [autoparallel] implement softmax handler (#2132) 2022-12-14 16:09:53 +08:00
strategy_generator.py [autoparallel] use pytree map style to process data (#1989) 2022-11-21 10:44:22 +08:00
sum_generator.py [autoparallel] add sum handler (#2101) 2022-12-08 17:02:54 +08:00
tensor_constructor_generator.py [autoparallel] add tensor constructor handler (#2082) 2022-12-06 10:20:10 +08:00
unary_elementwise_generator.py [autoparallel] handled illegal sharding strategy (#1728) 2022-10-19 12:53:06 +08:00
where_generator.py [autoparallel] adapt handlers with attention block (#1990) 2022-11-21 10:44:11 +08:00