Guangyao Zhang bdb125f83f [doc] FP8 training and communication document (#6050) ... * Add FP8 training and communication document * add fp8 docstring for plugins * fix typo * fix typo		2024-09-14 11:01:05 +08:00
..
1D_tensor_parallel.md	[doc] clean up outdated docs (#4765)	2023-09-21 11:36:20 +08:00
2D_tensor_parallel.md	[doc] clean up outdated docs (#4765)	2023-09-21 11:36:20 +08:00
2p5D_tensor_parallel.md	[doc] clean up outdated docs (#4765)	2023-09-21 11:36:20 +08:00
3D_tensor_parallel.md	[doc] clean up outdated docs (#4765)	2023-09-21 11:36:20 +08:00
cluster_utils.md	[doc] add booster docstring and fix autodoc (#3789)	2023-05-22 10:56:47 +08:00
distributed_optimizers.md	[doc] Update llama + sp compatibility; fix dist optim table	2024-07-01 17:07:22 +08:00
gradient_accumulation_with_booster.md	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
gradient_clipping_with_booster.md	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
lazy_init.md	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
mixed_precision_training_with_booster.md	[doc] FP8 training and communication document (#6050)	2024-09-14 11:01:05 +08:00
nvme_offload.md	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
pipeline_parallel.md	[hotfix] set return_outputs=False in examples and polish code (#5404)	2024-03-25 12:31:09 +08:00
sequence_parallelism.md	[doc] update sp doc (#6055)	2024-09-11 17:25:14 +08:00
shardformer.md	[doc] Update llama + sp compatibility; fix dist optim table	2024-07-01 17:07:22 +08:00
zero_with_chunk.md	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00