ColossalAI/docs/colossalai/colossalai.utils.rst

colossalai.utils
================

.. automodule:: colossalai.utils
   :members:

.. toctree::
   :maxdepth: 2

   colossalai.utils.data_sampler
   colossalai.utils.gradient_accumulation
   colossalai.utils.memory_tracer
   colossalai.utils.memory_utils
   colossalai.utils.multi_tensor_apply
   colossalai.utils.profiler
   colossalai.utils.tensor_detector


.. toctree::
   :maxdepth: 2

   colossalai.utils.activation_checkpoint
   colossalai.utils.checkpointing
   colossalai.utils.common
   colossalai.utils.cuda
   colossalai.utils.moe
   colossalai.utils.timer
Migrated project 3 years ago			`colossalai.utils`
			`================`

update rst (#615) 3 years ago			`.. automodule:: colossalai.utils`
			`:members:`
removed tutorial markdown and refreshed rst files for consistency 3 years ago
			`.. toctree::`
			`:maxdepth: 2`

			`colossalai.utils.data_sampler`
			`colossalai.utils.gradient_accumulation`
[doc] update rst (#470) * update rst * remove empty rst 3 years ago			`colossalai.utils.memory_tracer`
update rst (#615) 3 years ago			`colossalai.utils.memory_utils`
removed tutorial markdown and refreshed rst files for consistency 3 years ago			`colossalai.utils.multi_tensor_apply`
update rst (#615) 3 years ago			`colossalai.utils.profiler`
[doc] update rst (#470) * update rst * remove empty rst 3 years ago			`colossalai.utils.tensor_detector`
removed tutorial markdown and refreshed rst files for consistency 3 years ago

Migrated project 3 years ago			`.. toctree::`
			`:maxdepth: 2`

			`colossalai.utils.activation_checkpoint`
Support TP-compatible Torch AMP and Update trainer API (#27) * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit 2e0b0b76990e8d4e337add483d878c0f61cf5097. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com> 3 years ago			`colossalai.utils.checkpointing`
Migrated project 3 years ago			`colossalai.utils.common`
			`colossalai.utils.cuda`
[doc] update rst (#470) * update rst * remove empty rst 3 years ago			`colossalai.utils.moe`
Migrated project 3 years ago			`colossalai.utils.timer`