github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

update rst (#615)

pull/616/head
ver217 2022-04-01 15:46:38 +08:00 committed by GitHub
parent 93f14d2a33
commit f69507dd22
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
97 changed files with 490 additions and 127 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
docs/colossalai/colossalai.amp.apex_amp.apex_amp.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.amp.apex\_amp.apex\_amp
==================================
.. automodule:: colossalai.amp.apex_amp.apex_amp
:members:

6
docs/colossalai/colossalai.amp.apex_amp.rst
View File

@ -3,3 +3,9 @@ colossalai.amp.apex\_amp
.. automodule:: colossalai.amp.apex_amp
:members:
.. toctree::
:maxdepth: 2
colossalai.amp.apex_amp.apex_amp

5
docs/colossalai/colossalai.amp.naive_amp.naive_amp.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.amp.naive\_amp.naive\_amp
====================================
.. automodule:: colossalai.amp.naive_amp.naive_amp
:members:

6
docs/colossalai/colossalai.amp.naive_amp.rst
View File

@ -3,3 +3,9 @@ colossalai.amp.naive\_amp
.. automodule:: colossalai.amp.naive_amp
:members:
.. toctree::
:maxdepth: 2
colossalai.amp.naive_amp.naive_amp

6
docs/colossalai/colossalai.amp.rst
View File

@ -1,7 +1,8 @@
colossalai.amp
==============
*This module contains different amp models and optimizers.*
.. automodule:: colossalai.amp
:members:
.. toctree::
:maxdepth: 2
@ -15,6 +16,3 @@ colossalai.amp
:maxdepth: 2
colossalai.amp.amp_type
.. automodule:: colossalai.amp
:members: convert_to_amp

8
docs/colossalai/colossalai.amp.torch_amp.rst
View File

@ -2,4 +2,10 @@ colossalai.amp.torch\_amp
=========================
.. automodule:: colossalai.amp.torch_amp
:members:
:members:
.. toctree::
:maxdepth: 2
colossalai.amp.torch_amp.torch_amp

5
docs/colossalai/colossalai.amp.torch_amp.torch_amp.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.amp.torch\_amp.torch\_amp
====================================
.. automodule:: colossalai.amp.torch_amp.torch_amp
:members:

5
docs/colossalai/colossalai.builder.rst
View File

@ -1,8 +1,9 @@
colossalai.builder
==================
*This module contains different methods to build* ``schedule``, ``model``, ``optimizer``,
``layers`` *and other important classes.*
.. automodule:: colossalai.builder
:members:
.. toctree::
:maxdepth: 2

4
docs/colossalai/colossalai.communication.rst
View File

@ -1,7 +1,9 @@
colossalai.communication
========================
*This module contains different methods for communication in parallel training.*
.. automodule:: colossalai.communication
:members:
.. toctree::
:maxdepth: 2

5
docs/colossalai/colossalai.constants.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.constants
====================
.. automodule:: colossalai.constants
:members:

4
docs/colossalai/colossalai.context.moe_context.rst
View File

@ -1,5 +1,5 @@
colossalai.context.moe\_context
====================================
===============================
.. automodule:: colossalai.context.moe_context
:members:
:members:

2
docs/colossalai/colossalai.context.process_group_initializer.initializer_2d.rst
View File

@ -2,4 +2,4 @@ colossalai.context.process\_group\_initializer.initializer\_2d
==============================================================
.. automodule:: colossalai.context.process_group_initializer.initializer_2d
:members: Initializer_2D_Row, Initializer_2D_Col
:members:

2
docs/colossalai/colossalai.context.process_group_initializer.initializer_2p5d.rst
View File

@ -2,4 +2,4 @@ colossalai.context.process\_group\_initializer.initializer\_2p5d
================================================================
.. automodule:: colossalai.context.process_group_initializer.initializer_2p5d
:members: Initializer_2p5D_ROW, Initializer_2p5D_Col, Initializer_2p5D_Dep, Initializer_2p5D_XZ
:members:

2
docs/colossalai/colossalai.context.process_group_initializer.initializer_3d.rst
View File

@ -2,4 +2,4 @@ colossalai.context.process\_group\_initializer.initializer\_3d
==============================================================
.. automodule:: colossalai.context.process_group_initializer.initializer_3d
:members: Initializer_3D_Input, Initializer_3D_Weight, Initializer_3D_Output
:members:

2
docs/colossalai/colossalai.context.process_group_initializer.initializer_sequence.rst
View File

@ -2,4 +2,4 @@ colossalai.context.process\_group\_initializer.initializer\_sequence
====================================================================
.. automodule:: colossalai.context.process_group_initializer.initializer_sequence
:members: Initializer_Sequence_DP
:members:

1
docs/colossalai/colossalai.context.process_group_initializer.rst
View File

@ -14,7 +14,6 @@ colossalai.context.process\_group\_initializer
colossalai.context.process_group_initializer.initializer_3d
colossalai.context.process_group_initializer.initializer_data
colossalai.context.process_group_initializer.initializer_model
colossalai.context.process_group_initializer.initializer_moe
colossalai.context.process_group_initializer.initializer_pipeline
colossalai.context.process_group_initializer.initializer_sequence
colossalai.context.process_group_initializer.initializer_tensor

10
docs/colossalai/colossalai.context.rst
View File

@ -1,8 +1,8 @@
colossalai.context
==================
*This module is serving for receiving and passing user's configuration to all devices to
initialize and construct parallel training.*
.. automodule:: colossalai.context
:members:
.. toctree::
:maxdepth: 2
@ -15,9 +15,7 @@ initialize and construct parallel training.*
:maxdepth: 2
colossalai.context.config
colossalai.context.parallel_context
colossalai.context.moe_context
colossalai.context.parallel_context
colossalai.context.parallel_mode
.. automodule:: colossalai.context
:members:
colossalai.context.singleton_meta

5
docs/colossalai/colossalai.context.singleton_meta.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.context.singleton\_meta
==================================
.. automodule:: colossalai.context.singleton_meta
:members:

5
docs/colossalai/colossalai.core.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.core
===============
.. automodule:: colossalai.core
:members:

8
docs/colossalai/colossalai.engine.ophooks.rst
View File

@ -1,5 +1,11 @@
colossalai.engine.ophooks
===========================
=========================
.. automodule:: colossalai.engine.ophooks
:members:
.. toctree::
:maxdepth: 2
colossalai.engine.ophooks.zero_hook

5
docs/colossalai/colossalai.engine.ophooks.zero_hook.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.engine.ophooks.zero\_hook
====================================
.. automodule:: colossalai.engine.ophooks.zero_hook
:members:

5
docs/colossalai/colossalai.engine.paramhooks.rst
View File

@ -1,5 +0,0 @@
colossalai.engine.paramhooks
==============================
.. automodule:: colossalai.engine.paramhooks
:members:

3
docs/colossalai/colossalai.engine.rst
View File

@ -8,6 +8,5 @@ colossalai.engine
:maxdepth: 2
colossalai.engine.gradient_handler
colossalai.engine.schedule
colossalai.engine.ophooks
colossalai.engine.paramhooks
colossalai.engine.schedule

5
docs/colossalai/colossalai.global_variables.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.global\_variables
============================
.. automodule:: colossalai.global_variables
:members:

5
docs/colossalai/colossalai.logging.logger.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.logging.logger
=========================
.. automodule:: colossalai.logging.logger
:members:

6
docs/colossalai/colossalai.logging.rst
View File

@ -3,3 +3,9 @@ colossalai.logging
.. automodule:: colossalai.logging
:members:
.. toctree::
:maxdepth: 2
colossalai.logging.logger

5
docs/colossalai/colossalai.nn.layer.colossalai_layer.dropout.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.colossalai\_layer.dropout
=============================================
.. automodule:: colossalai.nn.layer.colossalai_layer.dropout
:members:

5
docs/colossalai/colossalai.nn.layer.colossalai_layer.embedding.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.colossalai\_layer.embedding
===============================================
.. automodule:: colossalai.nn.layer.colossalai_layer.embedding
:members:

5
docs/colossalai/colossalai.nn.layer.colossalai_layer.linear.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.colossalai\_layer.linear
============================================
.. automodule:: colossalai.nn.layer.colossalai_layer.linear
:members:

5
docs/colossalai/colossalai.nn.layer.colossalai_layer.normalization.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.colossalai\_layer.normalization
===================================================
.. automodule:: colossalai.nn.layer.colossalai_layer.normalization
:members:

9
docs/colossalai/colossalai.nn.layer.colossalai_layer.rst
View File

@ -3,3 +3,12 @@ colossalai.nn.layer.colossalai\_layer
.. automodule:: colossalai.nn.layer.colossalai_layer
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.colossalai_layer.dropout
colossalai.nn.layer.colossalai_layer.embedding
colossalai.nn.layer.colossalai_layer.linear
colossalai.nn.layer.colossalai_layer.normalization

5
docs/colossalai/colossalai.nn.layer.moe.experts.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.moe.experts
===============================
.. automodule:: colossalai.nn.layer.moe.experts
:members:

5
docs/colossalai/colossalai.nn.layer.moe.layers.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.moe.layers
==============================
.. automodule:: colossalai.nn.layer.moe.layers
:members:

8
docs/colossalai/colossalai.nn.layer.moe.rst
View File

@ -3,3 +3,11 @@ colossalai.nn.layer.moe
.. automodule:: colossalai.nn.layer.moe
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.moe.experts
colossalai.nn.layer.moe.layers
colossalai.nn.layer.moe.utils

5
docs/colossalai/colossalai.nn.layer.moe.utils.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.moe.utils
=============================
.. automodule:: colossalai.nn.layer.moe.utils
:members:

5
docs/colossalai/colossalai.nn.layer.parallel_1d.layers.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.parallel\_1d.layers
=======================================
.. automodule:: colossalai.nn.layer.parallel_1d.layers
:members:

6
docs/colossalai/colossalai.nn.layer.parallel_1d.rst
View File

@ -3,3 +3,9 @@ colossalai.nn.layer.parallel\_1d
.. automodule:: colossalai.nn.layer.parallel_1d
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.parallel_1d.layers

5
docs/colossalai/colossalai.nn.layer.parallel_2d.layers.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.parallel\_2d.layers
=======================================
.. automodule:: colossalai.nn.layer.parallel_2d.layers
:members:

8
docs/colossalai/colossalai.nn.layer.parallel_2d.rst
View File

@ -2,4 +2,10 @@ colossalai.nn.layer.parallel\_2d
================================
.. automodule:: colossalai.nn.layer.parallel_2d
:members:
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.parallel_2d.layers

5
docs/colossalai/colossalai.nn.layer.parallel_2p5d.layers.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.parallel\_2p5d.layers
=========================================
.. automodule:: colossalai.nn.layer.parallel_2p5d.layers
:members:

6
docs/colossalai/colossalai.nn.layer.parallel_2p5d.rst
View File

@ -3,3 +3,9 @@ colossalai.nn.layer.parallel\_2p5d
.. automodule:: colossalai.nn.layer.parallel_2p5d
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.parallel_2p5d.layers

5
docs/colossalai/colossalai.nn.layer.parallel_3d.layers.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.parallel\_3d.layers
=======================================
.. automodule:: colossalai.nn.layer.parallel_3d.layers
:members:

6
docs/colossalai/colossalai.nn.layer.parallel_3d.rst
View File

@ -3,3 +3,9 @@ colossalai.nn.layer.parallel\_3d
.. automodule:: colossalai.nn.layer.parallel_3d
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.parallel_3d.layers

5
docs/colossalai/colossalai.nn.layer.parallel_sequence.layers.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.parallel\_sequence.layers
=============================================
.. automodule:: colossalai.nn.layer.parallel_sequence.layers
:members:

6
docs/colossalai/colossalai.nn.layer.parallel_sequence.rst
View File

@ -3,3 +3,9 @@ colossalai.nn.layer.parallel\_sequence
.. automodule:: colossalai.nn.layer.parallel_sequence
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.parallel_sequence.layers

5
docs/colossalai/colossalai.nn.layer.utils.common.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.utils.common
================================
.. automodule:: colossalai.nn.layer.utils.common
:members:

6
docs/colossalai/colossalai.nn.layer.utils.rst
View File

@ -3,3 +3,9 @@ colossalai.nn.layer.utils
.. automodule:: colossalai.nn.layer.utils
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.utils.common

5
docs/colossalai/colossalai.nn.layer.vanilla.layers.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.vanilla.layers
==================================
.. automodule:: colossalai.nn.layer.vanilla.layers
:members:

6
docs/colossalai/colossalai.nn.layer.vanilla.rst
View File

@ -3,3 +3,9 @@ colossalai.nn.layer.vanilla
.. automodule:: colossalai.nn.layer.vanilla
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.vanilla.layers

5
docs/colossalai/colossalai.nn.layer.wrapper.lambda_wrapper.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.wrapper.lambda\_wrapper
===========================================
.. automodule:: colossalai.nn.layer.wrapper.lambda_wrapper
:members:

5
docs/colossalai/colossalai.nn.layer.wrapper.pipeline_wrapper.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.nn.layer.wrapper.pipeline\_wrapper
=============================================
.. automodule:: colossalai.nn.layer.wrapper.pipeline_wrapper
:members:

7
docs/colossalai/colossalai.nn.layer.wrapper.rst
View File

@ -3,3 +3,10 @@ colossalai.nn.layer.wrapper
.. automodule:: colossalai.nn.layer.wrapper
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer.wrapper.lambda_wrapper
colossalai.nn.layer.wrapper.pipeline_wrapper

4
docs/colossalai/colossalai.nn.lr_scheduler.rst
View File

@ -1,6 +1,10 @@
colossalai.nn.lr\_scheduler
===========================
.. automodule:: colossalai.nn.lr_scheduler
:members:
.. toctree::
:maxdepth: 2

4
docs/colossalai/colossalai.nn.optimizer.rst
View File

@ -1,6 +1,10 @@
colossalai.nn.optimizer
=======================
.. automodule:: colossalai.nn.optimizer
:members:
.. toctree::
:maxdepth: 2

40
docs/colossalai/colossalai.nn.rst
View File

@ -1,57 +1,21 @@
colossalai.nn
=============
*This part contains different colossalai layers for constructing your model.
You can easily use them as the way of using layers in torch.nn.*
*Now colossalai support layer types below:* ``Linear``, ``Classifier``, ``Embedding``,
``PatchEmbedding``, ``LayerNorm``, ``Dropout`` *for different parallelisms.*
.. automodule:: colossalai.nn
:members:
.. toctree::
:maxdepth: 2
colossalai.nn.layer
*This part contains different loss functions for different parallelisms.*
.. toctree::
:maxdepth: 2
colossalai.nn.loss
*This part contains different learning rate schedules to control your learning rate
in training process*
.. toctree::
:maxdepth: 2
colossalai.nn.lr_scheduler
*This part contains different metric to measure performance of your model.*
.. toctree::
:maxdepth: 2
colossalai.nn.metric
*This part contains some colossalai optimizers*
.. toctree::
:maxdepth: 2
colossalai.nn.model
.. toctree::
:maxdepth: 2
colossalai.nn.optimizer
*This part contains different methods to initialize weights.*
.. toctree::
:maxdepth: 2
colossalai.nn.init
.. automodule:: colossalai.nn
:members:

5
docs/colossalai/colossalai.rst
View File

@ -1,4 +1,4 @@
Colossal-AI
colossalai
==========
.. toctree::
@ -23,6 +23,3 @@ Colossal-AI
:maxdepth: 2
colossalai.initialize
.. automodule:: colossalai
:members:

5
docs/colossalai/colossalai.testing.comparison.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.testing.comparison
=============================
.. automodule:: colossalai.testing.comparison
:members:

11
docs/colossalai/colossalai.testing.rst
View File

@ -1,5 +1,12 @@
colossalai.testing
========================
==================
.. automodule:: colossalai.testing
:members:
:members:
.. toctree::
:maxdepth: 2
colossalai.testing.comparison
colossalai.testing.utils

5
docs/colossalai/colossalai.testing.utils.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.testing.utils
========================
.. automodule:: colossalai.testing.utils
:members:

5
docs/colossalai/colossalai.utils.data_sampler.base_sampler.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.data\_sampler.base\_sampler
============================================
.. automodule:: colossalai.utils.data_sampler.base_sampler
:members:

5
docs/colossalai/colossalai.utils.data_sampler.data_parallel_sampler.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.data\_sampler.data\_parallel\_sampler
======================================================
.. automodule:: colossalai.utils.data_sampler.data_parallel_sampler
:members:

7
docs/colossalai/colossalai.utils.data_sampler.rst
View File

@ -3,3 +3,10 @@ colossalai.utils.data\_sampler
.. automodule:: colossalai.utils.data_sampler
:members:
.. toctree::
:maxdepth: 2
colossalai.utils.data_sampler.base_sampler
colossalai.utils.data_sampler.data_parallel_sampler

5
docs/colossalai/colossalai.utils.memory_tracer.async_memtracer.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.memory\_tracer.async\_memtracer
================================================
.. automodule:: colossalai.utils.memory_tracer.async_memtracer
:members:

5
docs/colossalai/colossalai.utils.memory_tracer.memstats_collector.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.memory\_tracer.memstats\_collector
===================================================
.. automodule:: colossalai.utils.memory_tracer.memstats_collector
:members:

5
docs/colossalai/colossalai.utils.memory_tracer.model_data_memtracer.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.memory\_tracer.model\_data\_memtracer
======================================================
.. automodule:: colossalai.utils.memory_tracer.model_data_memtracer
:members:

12
docs/colossalai/colossalai.utils.memory_tracer.rst
View File

@ -1,5 +1,13 @@
colossalai.utils.memory\_tracer
=======================
===============================
.. automodule:: colossalai.utils.memory_tracer
:members:
:members:
.. toctree::
:maxdepth: 2
colossalai.utils.memory_tracer.async_memtracer
colossalai.utils.memory_tracer.memstats_collector
colossalai.utils.memory_tracer.model_data_memtracer

5
docs/colossalai/colossalai.utils.memory_utils.memory_monitor.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.memory\_utils.memory\_monitor
==============================================
.. automodule:: colossalai.utils.memory_utils.memory_monitor
:members:

12
docs/colossalai/colossalai.utils.memory_utils.rst Normal file
View File

@ -0,0 +1,12 @@
colossalai.utils.memory\_utils
==============================
.. automodule:: colossalai.utils.memory_utils
:members:
.. toctree::
:maxdepth: 2
colossalai.utils.memory_utils.memory_monitor
colossalai.utils.memory_utils.utils

5
docs/colossalai/colossalai.utils.memory_utils.utils.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.memory\_utils.utils
====================================
.. automodule:: colossalai.utils.memory_utils.utils
:members:

4
docs/colossalai/colossalai.utils.moe.rst
View File

@ -1,5 +1,5 @@
colossalai.utils.moe
=======================
====================
.. automodule:: colossalai.utils.moe
:members:
:members:

5
docs/colossalai/colossalai.utils.profiler.comm_profiler.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.profiler.comm\_profiler
========================================
.. automodule:: colossalai.utils.profiler.comm_profiler
:members:

5
docs/colossalai/colossalai.utils.profiler.mem_profiler.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.profiler.mem\_profiler
=======================================
.. automodule:: colossalai.utils.profiler.mem_profiler
:members:

5
docs/colossalai/colossalai.utils.profiler.pcie_profiler.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.profiler.pcie\_profiler
========================================
.. automodule:: colossalai.utils.profiler.pcie_profiler
:members:

5
docs/colossalai/colossalai.utils.profiler.prof_utils.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.profiler.prof\_utils
=====================================
.. automodule:: colossalai.utils.profiler.prof_utils
:members:

13
docs/colossalai/colossalai.utils.profiler.rst
View File

@ -1,5 +1,14 @@
colossalai.utils.profiler
=======================
=========================
.. automodule:: colossalai.utils.profiler
:members:
:members:
.. toctree::
:maxdepth: 2
colossalai.utils.profiler.comm_profiler
colossalai.utils.profiler.mem_profiler
colossalai.utils.profiler.pcie_profiler
colossalai.utils.profiler.prof_utils

7
docs/colossalai/colossalai.utils.rst
View File

@ -1,7 +1,8 @@
colossalai.utils
================
*This part contains useful utils for colossalai*
.. automodule:: colossalai.utils
:members:
.. toctree::
:maxdepth: 2
@ -9,8 +10,9 @@ colossalai.utils
colossalai.utils.data_sampler
colossalai.utils.gradient_accumulation
colossalai.utils.memory_tracer
colossalai.utils.memory_utils
colossalai.utils.multi_tensor_apply
colossalai.utils.profile
colossalai.utils.profiler
colossalai.utils.tensor_detector
@ -21,6 +23,5 @@ colossalai.utils
colossalai.utils.checkpointing
colossalai.utils.common
colossalai.utils.cuda
colossalai.utils.memory
colossalai.utils.moe
colossalai.utils.timer

12
docs/colossalai/colossalai.utils.tensor_detector.rst
View File

@ -1,5 +1,11 @@
colossalai.utils.tensor\_detector
=======================
=================================
.. automodule:: colossalai.utils.tensor_detector.tensor_detector
:members:
.. automodule:: colossalai.utils.tensor_detector
:members:
.. toctree::
:maxdepth: 2
colossalai.utils.tensor_detector.tensor_detector

5
docs/colossalai/colossalai.utils.tensor_detector.tensor_detector.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.utils.tensor\_detector.tensor\_detector
==================================================
.. automodule:: colossalai.utils.tensor_detector.tensor_detector
:members:

5
docs/colossalai/colossalai.zero.init_ctx.init_context.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.init\_ctx.init\_context
=======================================
.. automodule:: colossalai.zero.init_ctx.init_context
:members:

11
docs/colossalai/colossalai.zero.init_ctx.rst
View File

@ -1,8 +1,11 @@
colossalai.zero.init\_ctx
=========================
colossalai.zero.init\_ctx.init\_context
-----------------------------------------
.. automodule:: colossalai.zero.init_ctx.init_context
.. automodule:: colossalai.zero.init_ctx
:members:
.. toctree::
:maxdepth: 2
colossalai.zero.init_ctx.init_context

5
docs/colossalai/colossalai.zero.shard_utils.base_shard_strategy.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.shard\_utils.base\_shard\_strategy
==================================================
.. automodule:: colossalai.zero.shard_utils.base_shard_strategy
:members:

5
docs/colossalai/colossalai.zero.shard_utils.bucket_tensor_shard_strategy.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.shard\_utils.bucket\_tensor\_shard\_strategy
============================================================
.. automodule:: colossalai.zero.shard_utils.bucket_tensor_shard_strategy
:members:

5
docs/colossalai/colossalai.zero.shard_utils.commons.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.shard\_utils.commons
====================================
.. automodule:: colossalai.zero.shard_utils.commons
:members:

10
docs/colossalai/colossalai.zero.shard_utils.rst
View File

@ -3,3 +3,13 @@ colossalai.zero.shard\_utils
.. automodule:: colossalai.zero.shard_utils
:members:
.. toctree::
:maxdepth: 2
colossalai.zero.shard_utils.base_shard_strategy
colossalai.zero.shard_utils.bucket_tensor_shard_strategy
colossalai.zero.shard_utils.commons
colossalai.zero.shard_utils.tensor_shard_strategy
colossalai.zero.shard_utils.tensor_utils

5
docs/colossalai/colossalai.zero.shard_utils.tensor_shard_strategy.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.shard\_utils.tensor\_shard\_strategy
====================================================
.. automodule:: colossalai.zero.shard_utils.tensor_shard_strategy
:members:

5
docs/colossalai/colossalai.zero.shard_utils.tensor_utils.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.shard\_utils.tensor\_utils
==========================================
.. automodule:: colossalai.zero.shard_utils.tensor_utils
:members:

5
docs/colossalai/colossalai.zero.sharded_model.reduce_scatter.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.sharded\_model.reduce\_scatter
==============================================
.. automodule:: colossalai.zero.sharded_model.reduce_scatter
:members:

36
docs/colossalai/colossalai.zero.sharded_model.rst
View File

@ -1,39 +1,13 @@
colossalai.zero.sharded\_model
==============================
colossalai.zero.sharded\_model.sharded\_model\_v2
--------------------------------------------------
.. automodule:: colossalai.zero.sharded_model.sharded_model_v2
:members:
colossalai.zero.sharded\_model.reduce\_scatter
-----------------------------------------------
.. automodule:: colossalai.zero.sharded_model.reduce_scatter
:members:
colossalai.zero.sharded\_model.utils
--------------------------------------
.. automodule:: colossalai.zero.sharded_model.utils
:members:
colossalai.zero.sharded\_model.sharded\_model
--------------------------------------------------
.. automodule:: colossalai.zero.sharded_model
:members:
colossalai.zero.sharded\_model.sharded\_grad
--------------------------------------------------
.. automodule:: colossalai.zero.sharded_grad
:members:
.. toctree::
:maxdepth: 2
colossalai.zero.sharded\_model.param\_manager
----------------------------------------------
.. automodule:: colossalai.zero.sharded_model.param_manager
:members:
colossalai.zero.sharded_model.reduce_scatter
colossalai.zero.sharded_model.sharded_model_v2
colossalai.zero.sharded_model.utils

5
docs/colossalai/colossalai.zero.sharded_model.sharded_model_v2.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.sharded\_model.sharded\_model\_v2
=================================================
.. automodule:: colossalai.zero.sharded_model.sharded_model_v2
:members:

5
docs/colossalai/colossalai.zero.sharded_model.utils.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.sharded\_model.utils
====================================
.. automodule:: colossalai.zero.sharded_model.utils
:members:

8
docs/colossalai/colossalai.zero.sharded_optim.rst
View File

@ -1,5 +1,11 @@
colossalai.zero.sharded\_optim
===============================
==============================
.. automodule:: colossalai.zero.sharded_optim
:members:
.. toctree::
:maxdepth: 2
colossalai.zero.sharded_optim.sharded_optim_v2

5
docs/colossalai/colossalai.zero.sharded_optim.sharded_optim_v2.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.sharded\_optim.sharded\_optim\_v2
=================================================
.. automodule:: colossalai.zero.sharded_optim.sharded_optim_v2
:members:

8
docs/colossalai/colossalai.zero.sharded_param.rst
View File

@ -3,3 +3,11 @@ colossalai.zero.sharded\_param
.. automodule:: colossalai.zero.sharded_param
:members:
.. toctree::
:maxdepth: 2
colossalai.zero.sharded_param.sharded_param
colossalai.zero.sharded_param.sharded_tensor
colossalai.zero.sharded_param.tensorful_state

5
docs/colossalai/colossalai.zero.sharded_param.sharded_param.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.sharded\_param.sharded\_param
=============================================
.. automodule:: colossalai.zero.sharded_param.sharded_param
:members:

5
docs/colossalai/colossalai.zero.sharded_param.sharded_tensor.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.sharded\_param.sharded\_tensor
==============================================
.. automodule:: colossalai.zero.sharded_param.sharded_tensor
:members:

5
docs/colossalai/colossalai.zero.sharded_param.tensorful_state.rst Normal file
View File

@ -0,0 +1,5 @@
colossalai.zero.sharded\_param.tensorful\_state
===============================================
.. automodule:: colossalai.zero.sharded_param.tensorful_state
:members:

5
docs/colossalai/colossalai.zero.sharded_utils.rst
View File

@ -1,5 +0,0 @@
colossalai.zero.sharded\_utils
===============
.. automodule:: colossalai.zero.sharded_utils
:members: