Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Frank Lee be85a0f366 removed tutorial markdown and refreshed rst files for consistency 3 years ago
..
colossalai.amp.amp_type.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.amp.apex_amp.apex_amp.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.amp.apex_amp.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.amp.naive_amp.naive_amp.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.amp.naive_amp.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.amp.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.amp.torch_amp.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.amp.torch_amp.torch_amp.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.builder.builder.rst Migrated project 3 years ago
colossalai.builder.pipeline.rst Migrated project 3 years ago
colossalai.builder.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.communication.collective.rst Migrated project 3 years ago
colossalai.communication.p2p.rst Migrated project 3 years ago
colossalai.communication.ring.rst Migrated project 3 years ago
colossalai.communication.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.communication.utils.rst Migrated project 3 years ago
colossalai.context.config.rst Migrated project 3 years ago
colossalai.context.parallel_context.rst Migrated project 3 years ago
colossalai.context.parallel_mode.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.initializer_1d.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.initializer_2d.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.initializer_2p5d.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.initializer_3d.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.initializer_data.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.initializer_model.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.context.process_group_initializer.initializer_moe.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.context.process_group_initializer.initializer_pipeline.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.initializer_sequence.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.initializer_tensor.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.process_group_initializer.rst Migrated project 3 years ago
colossalai.context.process_group_initializer.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.context.random.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.context.random.seed_manager.rst Migrated project 3 years ago
colossalai.context.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.engine.gradient_handler.rst Migrated project 3 years ago
colossalai.engine.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.engine.schedule.rst Migrated project 3 years ago
colossalai.initialize.rst Migrated project 3 years ago
colossalai.kernel.cuda_native.layer_norm.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.kernel.cuda_native.multihead_attention.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.kernel.cuda_native.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.kernel.cuda_native.scaled_softmax.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.kernel.jit.bias_dropout_add.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.kernel.jit.bias_gelu.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.kernel.jit.option.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.kernel.jit.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.kernel.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.logging.logging.rst Migrated project 3 years ago
colossalai.logging.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.init.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.base_layer.rst Migrated project 3 years ago
colossalai.nn.layer.colossalai_layer.dropout.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.colossalai_layer.embedding.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.colossalai_layer.linear.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.colossalai_layer.normalization.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.colossalai_layer.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.moe.layers.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.moe.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.parallel_1d.layers.rst Migrated project 3 years ago
colossalai.nn.layer.parallel_1d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.parallel_2d.layers.rst Migrated project 3 years ago
colossalai.nn.layer.parallel_2d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.parallel_2p5d.layers.rst Migrated project 3 years ago
colossalai.nn.layer.parallel_2p5d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.parallel_3d.layers.rst Migrated project 3 years ago
colossalai.nn.layer.parallel_3d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.parallel_sequence.layers.rst Migrated project 3 years ago
colossalai.nn.layer.parallel_sequence.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.utils.common.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.utils.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.vanilla.layers.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.vanilla.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.wrapper.lambda_wrapper.rst Migrated project 3 years ago
colossalai.nn.layer.wrapper.pipeline_wrapper.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.layer.wrapper.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.loss.loss_2d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.loss.loss_2p5d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.loss.loss_3d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.loss.loss_moe.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.loss.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.lr_scheduler.cosine.rst Migrated project 3 years ago
colossalai.nn.lr_scheduler.delayed.rst Migrated project 3 years ago
colossalai.nn.lr_scheduler.linear.rst Migrated project 3 years ago
colossalai.nn.lr_scheduler.multistep.rst Migrated project 3 years ago
colossalai.nn.lr_scheduler.onecycle.rst Migrated project 3 years ago
colossalai.nn.lr_scheduler.poly.rst Migrated project 3 years ago
colossalai.nn.lr_scheduler.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.lr_scheduler.torch.rst Migrated project 3 years ago
colossalai.nn.metric.accuracy_2d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.metric.accuracy_2p5d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.metric.accuracy_3d.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.metric.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.model.model_from_config.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.model.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.optimizer.colossalai_optimizer.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.optimizer.fused_adam.rst Migrated project 3 years ago
colossalai.nn.optimizer.fused_lamb.rst Migrated project 3 years ago
colossalai.nn.optimizer.fused_sgd.rst Migrated project 3 years ago
colossalai.nn.optimizer.lamb.rst Migrated project 3 years ago
colossalai.nn.optimizer.lars.rst update documentation 3 years ago
colossalai.nn.optimizer.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.nn.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.registry.registry.rst Migrated project 3 years ago
colossalai.registry.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.trainer.hooks.rst Migrated project 3 years ago
colossalai.trainer.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.utils.activation_checkpoint.rst Migrated project 3 years ago
colossalai.utils.checkpointing.rst Support TP-compatible Torch AMP and Update trainer API (#27) 3 years ago
colossalai.utils.common.rst Migrated project 3 years ago
colossalai.utils.cuda.rst Migrated project 3 years ago
colossalai.utils.data_sampler.base_sampler.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.utils.data_sampler.data_parallel_sampler.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.utils.data_sampler.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.utils.gradient_accumulation.rst update examples and sphnix docs for the new api (#63) 3 years ago
colossalai.utils.memory.rst Migrated project 3 years ago
colossalai.utils.multi_tensor_apply.multi_tensor_apply.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.utils.multi_tensor_apply.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.utils.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.utils.timer.rst Migrated project 3 years ago
colossalai.zero.loss_scaler.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.zero.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.zero.zero_redundancy_optimizer_level_2.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago
colossalai.zero.zero_redundancy_optimizer_level_3.rst removed tutorial markdown and refreshed rst files for consistency 3 years ago