You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/utils
Hongxin Liu dbb32692d2
[lazy] refactor lazy init (#3891)
2 years ago
..
checkpoint [doc] Fix typo under colossalai and doc(#3618) 2 years ago
checkpoint_io [CheckpointIO] a uniform checkpoint I/O module (#1689) 2 years ago
data_sampler
model [lazy] refactor lazy init (#3891) 2 years ago
multi_tensor_apply [setup] support pre-build and jit-build of cuda kernels (#2374) 2 years ago
profiler [Gemini] clean no used MemTraceOp (#1970) 2 years ago
rank_recorder [pipeline/rank_recorder] fix bug when process data before backward | add a tool for multiple ranks debug (#1681) 2 years ago
tensor_detector [NFC]fix typo colossalai/auto_parallel nn utils etc. (#3779) 2 years ago
__init__.py [test] refactor tests with spawn (#3452) 2 years ago
activation_checkpoint.py [utils] Add use_reetrant=False in utils.activation_checkpoint (#1460) 2 years ago
checkpointing.py [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) 2 years ago
common.py [NFC]fix typo colossalai/auto_parallel nn utils etc. (#3779) 2 years ago
cuda.py
memory.py [gemini] APIs to set cpu memory capacity (#809) 3 years ago
moe.py [doc] Fix typo under colossalai and doc(#3618) 2 years ago
timer.py