アマデウス 9ee197d0e9 moved env variables to global variables; (#215) ... added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs		2022-02-15 11:31:13 +08:00
..
__init__.py	moved env variables to global variables; (#215)	2022-02-15 11:31:13 +08:00
_base_gradient_handler.py	Migrated project	2021-10-28 18:21:23 +02:00
_data_parallel_gradient_handler.py	add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)	2021-12-20 23:26:19 +08:00
_moe_gradient_handler.py	Fixed docstring in colossalai (#171)	2022-01-21 10:44:30 +08:00
_pipeline_parallel_gradient_handler.py	Optimize pipeline schedule (#94)	2021-12-30 15:56:46 +08:00
_sequence_parallel_gradient_handler.py	adapted for sequence parallel (#163)	2022-01-20 13:44:51 +08:00
_zero_gradient_handler.py	Migrated project	2021-10-28 18:21:23 +02:00