Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Jiarui Fang 4d9332b4c5
[refactor] moving memtracer to gemini (#801)
3 years ago
..
colossalai.amp.amp_type.rst
colossalai.amp.apex_amp.apex_amp.rst update rst (#615) 3 years ago
colossalai.amp.apex_amp.rst update rst (#615) 3 years ago
colossalai.amp.naive_amp.naive_amp.rst update rst (#615) 3 years ago
colossalai.amp.naive_amp.rst update rst (#615) 3 years ago
colossalai.amp.rst update rst (#615) 3 years ago
colossalai.amp.torch_amp.rst update rst (#615) 3 years ago
colossalai.amp.torch_amp.torch_amp.rst update rst (#615) 3 years ago
colossalai.builder.builder.rst
colossalai.builder.pipeline.rst
colossalai.builder.rst update rst (#615) 3 years ago
colossalai.communication.collective.rst
colossalai.communication.p2p.rst
colossalai.communication.ring.rst
colossalai.communication.rst update rst (#615) 3 years ago
colossalai.communication.utils.rst
colossalai.constants.rst update rst (#615) 3 years ago
colossalai.context.config.rst
colossalai.context.moe_context.rst update rst (#615) 3 years ago
colossalai.context.parallel_context.rst
colossalai.context.parallel_mode.rst
colossalai.context.process_group_initializer.initializer_1d.rst
colossalai.context.process_group_initializer.initializer_2d.rst update rst (#615) 3 years ago
colossalai.context.process_group_initializer.initializer_2p5d.rst update rst (#615) 3 years ago
colossalai.context.process_group_initializer.initializer_3d.rst update rst (#615) 3 years ago
colossalai.context.process_group_initializer.initializer_data.rst
colossalai.context.process_group_initializer.initializer_model.rst
colossalai.context.process_group_initializer.initializer_pipeline.rst
colossalai.context.process_group_initializer.initializer_sequence.rst update rst (#615) 3 years ago
colossalai.context.process_group_initializer.initializer_tensor.rst
colossalai.context.process_group_initializer.process_group_initializer.rst
colossalai.context.process_group_initializer.rst update rst (#615) 3 years ago
colossalai.context.random.rst
colossalai.context.random.seed_manager.rst
colossalai.context.rst update rst (#615) 3 years ago
colossalai.context.singleton_meta.rst update rst (#615) 3 years ago
colossalai.core.rst update rst (#615) 3 years ago
colossalai.engine.gradient_handler.rst html refactor (#555) 3 years ago
colossalai.engine.ophooks.rst update rst (#615) 3 years ago
colossalai.engine.ophooks.zero_hook.rst update rst (#615) 3 years ago
colossalai.engine.rst update rst (#615) 3 years ago
colossalai.engine.schedule.rst
colossalai.global_variables.rst update rst (#615) 3 years ago
colossalai.initialize.rst
colossalai.kernel.cuda_native.layer_norm.rst
colossalai.kernel.cuda_native.multihead_attention.rst
colossalai.kernel.cuda_native.rst
colossalai.kernel.cuda_native.scaled_softmax.rst
colossalai.kernel.jit.bias_dropout_add.rst
colossalai.kernel.jit.bias_gelu.rst
colossalai.kernel.jit.option.rst
colossalai.kernel.jit.rst
colossalai.kernel.rst
colossalai.logging.logger.rst update rst (#615) 3 years ago
colossalai.logging.rst update rst (#615) 3 years ago
colossalai.nn.init.rst
colossalai.nn.layer.base_layer.rst
colossalai.nn.layer.colossalai_layer.dropout.rst update rst (#615) 3 years ago
colossalai.nn.layer.colossalai_layer.embedding.rst update rst (#615) 3 years ago
colossalai.nn.layer.colossalai_layer.linear.rst update rst (#615) 3 years ago
colossalai.nn.layer.colossalai_layer.normalization.rst update rst (#615) 3 years ago
colossalai.nn.layer.colossalai_layer.rst update rst (#615) 3 years ago
colossalai.nn.layer.moe.experts.rst update rst (#615) 3 years ago
colossalai.nn.layer.moe.layers.rst update rst (#615) 3 years ago
colossalai.nn.layer.moe.rst update rst (#615) 3 years ago
colossalai.nn.layer.moe.utils.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_1d.layers.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_1d.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_2d.layers.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_2d.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_2p5d.layers.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_2p5d.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_3d.layers.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_3d.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_sequence.layers.rst update rst (#615) 3 years ago
colossalai.nn.layer.parallel_sequence.rst update rst (#615) 3 years ago
colossalai.nn.layer.rst
colossalai.nn.layer.utils.common.rst update rst (#615) 3 years ago
colossalai.nn.layer.utils.rst update rst (#615) 3 years ago
colossalai.nn.layer.vanilla.layers.rst update rst (#615) 3 years ago
colossalai.nn.layer.vanilla.rst update rst (#615) 3 years ago
colossalai.nn.layer.wrapper.lambda_wrapper.rst update rst (#615) 3 years ago
colossalai.nn.layer.wrapper.pipeline_wrapper.rst update rst (#615) 3 years ago
colossalai.nn.layer.wrapper.rst update rst (#615) 3 years ago
colossalai.nn.loss.loss_1d.rst [doc] update rst (#470) 3 years ago
colossalai.nn.loss.loss_2d.rst
colossalai.nn.loss.loss_2p5d.rst
colossalai.nn.loss.loss_3d.rst
colossalai.nn.loss.loss_moe.rst
colossalai.nn.loss.rst [doc] update rst (#470) 3 years ago
colossalai.nn.lr_scheduler.cosine.rst
colossalai.nn.lr_scheduler.delayed.rst
colossalai.nn.lr_scheduler.linear.rst
colossalai.nn.lr_scheduler.multistep.rst
colossalai.nn.lr_scheduler.onecycle.rst
colossalai.nn.lr_scheduler.poly.rst
colossalai.nn.lr_scheduler.rst update rst (#615) 3 years ago
colossalai.nn.lr_scheduler.torch.rst
colossalai.nn.metric.accuracy_2d.rst
colossalai.nn.metric.accuracy_2p5d.rst
colossalai.nn.metric.accuracy_3d.rst
colossalai.nn.metric.rst
colossalai.nn.model.model_from_config.rst
colossalai.nn.model.rst
colossalai.nn.optimizer.colossalai_optimizer.rst
colossalai.nn.optimizer.cpu_adam.rst [doc] update rst (#470) 3 years ago
colossalai.nn.optimizer.fused_adam.rst
colossalai.nn.optimizer.fused_lamb.rst
colossalai.nn.optimizer.fused_sgd.rst
colossalai.nn.optimizer.hybrid_adam.rst [docs] updatad docs of hybrid adam and cpu adam (#552) 3 years ago
colossalai.nn.optimizer.lamb.rst
colossalai.nn.optimizer.lars.rst
colossalai.nn.optimizer.rst update rst (#615) 3 years ago
colossalai.nn.rst update rst (#615) 3 years ago
colossalai.registry.registry.rst
colossalai.registry.rst
colossalai.rst update rst (#615) 3 years ago
colossalai.testing.comparison.rst update rst (#615) 3 years ago
colossalai.testing.rst update rst (#615) 3 years ago
colossalai.testing.utils.rst update rst (#615) 3 years ago
colossalai.trainer.hooks.rst
colossalai.trainer.rst
colossalai.utils.activation_checkpoint.rst
colossalai.utils.checkpointing.rst
colossalai.utils.common.rst
colossalai.utils.cuda.rst
colossalai.utils.data_sampler.base_sampler.rst update rst (#615) 3 years ago
colossalai.utils.data_sampler.data_parallel_sampler.rst update rst (#615) 3 years ago
colossalai.utils.data_sampler.rst update rst (#615) 3 years ago
colossalai.utils.gradient_accumulation.rst
colossalai.utils.memory_tracer.async_memtracer.rst [refactor] moving memtracer to gemini (#801) 3 years ago
colossalai.utils.memory_tracer.memstats_collector.rst [refactor] moving memtracer to gemini (#801) 3 years ago
colossalai.utils.memory_tracer.model_data_memtracer.rst [refactor] moving memtracer to gemini (#801) 3 years ago
colossalai.utils.memory_tracer.rst [refactor] moving memtracer to gemini (#801) 3 years ago
colossalai.utils.memory_utils.memory_monitor.rst update rst (#615) 3 years ago
colossalai.utils.memory_utils.rst update rst (#615) 3 years ago
colossalai.utils.memory_utils.utils.rst update rst (#615) 3 years ago
colossalai.utils.moe.rst update rst (#615) 3 years ago
colossalai.utils.multi_tensor_apply.multi_tensor_apply.rst
colossalai.utils.multi_tensor_apply.rst
colossalai.utils.profiler.comm_profiler.rst update rst (#615) 3 years ago
colossalai.utils.profiler.mem_profiler.rst update rst (#615) 3 years ago
colossalai.utils.profiler.pcie_profiler.rst update rst (#615) 3 years ago
colossalai.utils.profiler.prof_utils.rst update rst (#615) 3 years ago
colossalai.utils.profiler.rst update rst (#615) 3 years ago
colossalai.utils.rst [refactor] moving memtracer to gemini (#801) 3 years ago
colossalai.utils.tensor_detector.rst update rst (#615) 3 years ago
colossalai.utils.tensor_detector.tensor_detector.rst update rst (#615) 3 years ago
colossalai.utils.timer.rst
colossalai.zero.init_ctx.init_context.rst update rst (#615) 3 years ago
colossalai.zero.init_ctx.rst update rst (#615) 3 years ago
colossalai.zero.rst [doc] update rst (#470) 3 years ago
colossalai.zero.shard_utils.base_shard_strategy.rst update rst (#615) 3 years ago
colossalai.zero.shard_utils.bucket_tensor_shard_strategy.rst update rst (#615) 3 years ago
colossalai.zero.shard_utils.commons.rst update rst (#615) 3 years ago
colossalai.zero.shard_utils.rst update rst (#615) 3 years ago
colossalai.zero.shard_utils.tensor_shard_strategy.rst update rst (#615) 3 years ago
colossalai.zero.shard_utils.tensor_utils.rst update rst (#615) 3 years ago
colossalai.zero.sharded_model.reduce_scatter.rst update rst (#615) 3 years ago
colossalai.zero.sharded_model.rst update rst (#615) 3 years ago
colossalai.zero.sharded_model.sharded_model_v2.rst update rst (#615) 3 years ago
colossalai.zero.sharded_model.utils.rst update rst (#615) 3 years ago
colossalai.zero.sharded_optim.rst update rst (#615) 3 years ago
colossalai.zero.sharded_optim.sharded_optim_v2.rst update rst (#615) 3 years ago
colossalai.zero.sharded_param.rst update rst (#615) 3 years ago
colossalai.zero.sharded_param.sharded_param.rst update rst (#615) 3 years ago
colossalai.zero.sharded_param.sharded_tensor.rst update rst (#615) 3 years ago
colossalai.zero.sharded_param.tensorful_state.rst update rst (#615) 3 years ago