mirror of https://github.com/hpcaitech/ColossalAI
7a8702c06d
[colotensor] add megatron initialization for gpt2 |
||
---|---|---|
.. | ||
checkpoint | ||
data_sampler | ||
model | ||
multi_tensor_apply | ||
profiler | ||
tensor_detector | ||
__init__.py | ||
activation_checkpoint.py | ||
checkpointing.py | ||
common.py | ||
cuda.py | ||
memory.py | ||
moe.py | ||
timer.py |