ColossalAI/colossalai/nn
ver217 be01db37c8
[tensor] refactor chunk mgr and impl MemStatsCollectorV2 (#1077)
* polish chunk manager

* polish unit test

* impl add_extern_static_tensor for chunk mgr

* add mem stats collector v2

* polish code

* polish unit test

* polish code

* polish get chunks
2022-06-09 20:56:34 +08:00
..
_ops reorgnize colotensor directory (#1062) 2022-06-03 18:04:22 +08:00
layer [Tensor] 1d row embedding (#1075) 2022-06-08 12:04:59 +08:00
loss [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
lr_scheduler
metric [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
model
optimizer reorgnize colotensor directory (#1062) 2022-06-03 18:04:22 +08:00
parallel [tensor] refactor chunk mgr and impl MemStatsCollectorV2 (#1077) 2022-06-09 20:56:34 +08:00
__init__.py [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
init.py