mirror of https://github.com/hpcaitech/ColossalAI
58f6432416
* init shardformer code structure * add implement of sharder (inject and replace) * add implement of replace layer to colossal layer * separate different layer policy, add some notion * implement 1d and 2d slicer, can tell col or row * fix bug when slicing and inject model * fix some bug; add inference test example * add share weight and train example * add train * add docstring and readme * add docstring for other files * pre-commit |
||
|---|---|---|
| .. | ||
| _ops | ||
| layer | ||
| loss | ||
| lr_scheduler | ||
| metric | ||
| optimizer | ||
| parallel | ||
| __init__.py | ||
| init.py | ||