ColossalAI

Author	SHA1	Message	Date
zbian	e94c79f15b	improved allgather & reducescatter for 3d	2 years ago
kurisusnowdeng	0b8161fab8	updated tp layers	2 years ago
lucasliunju	912eb58ea0	[NFC] polish tests/test_layers/test_3d/checks_3d/common.py code style (#1733 )	2 years ago
Xue Fuzhao	754aa7c81f	[NFC] polish tests/test_layers/test_3d/checks_3d/check_layer_3d.py code style (#1731 )	2 years ago
zbian	3dba070580	fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial	3 years ago
アマデウス	9ee197d0e9	moved env variables to global variables; (#215 ) added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs	3 years ago
アマデウス	0fedef4f3c	Layer integration (#83 ) * integrated parallel layers for ease of building models * integrated 2.5d layers * cleaned codes and unit tests * added log metric by step hook; updated imagenet benchmark; fixed some bugs * reworked initialization; cleaned codes Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>	3 years ago
Frank Lee	cd9c28e055	added CI for unit testing (#69 )	3 years ago