ColossalAI/docs/colossalai/colossalai.utils.rst

colossalai.utils
================

.. toctree::
   :maxdepth: 2

   colossalai.utils.activation_checkpoint
   colossalai.utils.checkpointing
   colossalai.utils.common
   colossalai.utils.cuda
   colossalai.utils.data_sampler
   colossalai.utils.gradient_accumulation
   colossalai.utils.memory
   colossalai.utils.multi_tensor_apply
   colossalai.utils.timer


.. automodule:: colossalai.utils
   :members:
Migrated project 2021-10-28 16:21:23 +00:00			`colossalai.utils`
			`================`

			`.. toctree::`
			`:maxdepth: 2`

			`colossalai.utils.activation_checkpoint`
Support TP-compatible Torch AMP and Update trainer API (#27) * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit 2e0b0b76990e8d4e337add483d878c0f61cf5097. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com> 2021-11-18 11:45:06 +00:00			`colossalai.utils.checkpointing`
Migrated project 2021-10-28 16:21:23 +00:00			`colossalai.utils.common`
			`colossalai.utils.cuda`
update examples and sphnix docs for the new api (#63) 2021-12-13 14:07:01 +00:00			`colossalai.utils.data_sampler`
			`colossalai.utils.gradient_accumulation`
Migrated project 2021-10-28 16:21:23 +00:00			`colossalai.utils.memory`
update examples and sphnix docs for the new api (#63) 2021-12-13 14:07:01 +00:00			`colossalai.utils.multi_tensor_apply`
Migrated project 2021-10-28 16:21:23 +00:00			`colossalai.utils.timer`
update examples and sphnix docs for the new api (#63) 2021-12-13 14:07:01 +00:00

			`.. automodule:: colossalai.utils`
			`:members:`