mirror of https://github.com/hpcaitech/ColossalAI
![]() * support existing sharded and unsharded parameters in zero * add unitest for moe-zero model init * polish moe gradient handler |
||
---|---|---|
.. | ||
__init__.py | ||
async_memtracer.py | ||
memstats_collector.py | ||
model_data_memtracer.py | ||
test_async_memtracer.py | ||
test_memstats_collector.py |