5 Commits (457a0de79fd2d3602eba0ac78e606acb6401fc60)

Author	SHA1	Message	Date
GuangyaoZhang	457a0de79f	shardformer fp8	2024-07-16 06:56:51 +00:00
pre-commit-ci[bot]	51f916b11d	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2024-07-12 07:33:45 +00:00
BurkeHulk	e88190184a	support fp8 communication in pipeline parallelism	2024-07-12 15:25:25 +08:00
BurkeHulk	1e1959467e	fix scaling algorithm in FP8 casting	2024-07-12 15:23:37 +08:00
HangXu	f5a52e1600	fp8 operators for compressed communication ... cast_to_fp8, cast_from_fp8, all_reduce_fp8	2024-07-01 13:44:21 +08:00