ColossalAI/colossalai/utils
HELSON 7a8702c06d
[colotensor] add Tensor.view op and its unit test (#1343)
[colotensor] add megatron initialization for gpt2
2022-07-21 10:53:15 +08:00
..
checkpoint [colotensor] add Tensor.view op and its unit test (#1343) 2022-07-21 10:53:15 +08:00
data_sampler
model [fx] tested the complete workflow for auto-parallel (#1336) 2022-07-20 10:45:17 +08:00
multi_tensor_apply
profiler [hotfix] remove potiential circle import (#1307) 2022-07-14 13:44:26 +08:00
tensor_detector
__init__.py [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
activation_checkpoint.py [util] fixed activation checkpointing on torch 1.9 (#719) 2022-04-12 09:35:45 +08:00
checkpointing.py
common.py [hotfix] fix sharded optim step and clip_grad_norm (#1226) 2022-07-08 13:34:48 +08:00
cuda.py [refactor] refactor the memory utils (#715) 2022-04-11 16:47:57 +08:00
memory.py [gemini] APIs to set cpu memory capacity (#809) 2022-04-19 16:05:22 +08:00
moe.py
timer.py