colossalai.communication
========================

*This module contains different methods for communication in parallel training.*

.. toctree::
   :maxdepth: 2

   colossalai.communication.collective
   colossalai.communication.p2p
   colossalai.communication.ring
   colossalai.communication.utils