colossalai.utils
================

*This part contains useful utils for colossalai*

.. toctree::
   :maxdepth: 2

   colossalai.utils.data_sampler
   colossalai.utils.gradient_accumulation
   colossalai.utils.memory_tracer
   colossalai.utils.multi_tensor_apply
   colossalai.utils.profile
   colossalai.utils.tensor_detector


.. toctree::
   :maxdepth: 2

   colossalai.utils.activation_checkpoint
   colossalai.utils.checkpointing
   colossalai.utils.common
   colossalai.utils.cuda
   colossalai.utils.memory
   colossalai.utils.moe
   colossalai.utils.timer