You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

アマデウス 9ee197d0e9 moved env variables to global variables; (#215) ... added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs		3 years ago
..
__init__.py	moved env variables to global variables; (#215)	3 years ago
_base_gradient_handler.py	…
_data_parallel_gradient_handler.py	…
_moe_gradient_handler.py	Fixed docstring in colossalai (#171)	3 years ago
_pipeline_parallel_gradient_handler.py	…
_sequence_parallel_gradient_handler.py	adapted for sequence parallel (#163)	3 years ago
_zero_gradient_handler.py	…