ColossalAI

Commit Graph

Author	SHA1	Message	Date
GuangyaoZhang	6a20f07b80	remove all to all	2024-07-17 07:14:55 +00:00
GuangyaoZhang	5a310b9ee1	fix rebase	2024-07-17 03:43:23 +00:00
GuangyaoZhang	457a0de79f	shardformer fp8	2024-07-16 06:56:51 +00:00
pre-commit-ci[bot]	51f916b11d	[pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci	2024-07-12 07:33:45 +00:00
BurkeHulk	1f1b856354	Merge remote-tracking branch 'origin/feature/fp8_comm' into feature/fp8_comm # Conflicts: # colossalai/quantization/fp8.py	2024-07-12 15:29:41 +08:00
BurkeHulk	e88190184a	support fp8 communication in pipeline parallelism	2024-07-12 15:25:25 +08:00
BurkeHulk	1e1959467e	fix scaling algorithm in FP8 casting	2024-07-12 15:23:37 +08:00
GuangyaoZhang	dbfa7d39fc	fix typo	2024-07-10 08:13:26 +00:00
pre-commit-ci[bot]	e17f835df7	[pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci	2024-07-04 12:47:17 +00:00
Hanks	6991819a97	Merge branch 'hpcaitech:main' into feature/fp8_comm	2024-07-04 20:34:41 +08:00
Hongxin Liu	7afbc81d62	[quant] fix bitsandbytes version check (#5882 ) * [quant] fix bitsandbytes version check * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	2024-07-04 11:33:23 +08:00
HangXu	f5a52e1600	fp8 operators for compressed communication cast_to_fp8, cast_from_fp8, all_reduce_fp8	2024-07-01 13:44:21 +08:00
linsj20	91fa553775	[Feature] qlora support (#5586 ) * [feature] qlora support * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * qlora follow commit * migrate qutization folder to colossalai/ * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * minor fixes --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	2024-04-28 10:51:27 +08:00

13 Commits (6a20f07b8090b2fe801eb0bc0b33b397beb6d1fd)