mirror of https://github.com/hpcaitech/ColossalAI
45927d5527
* add dist dropout in model * update docstring and bert policy with dropout * refactor basepolicy and sharded, update bert * update format * update gpt2 policy * update bert policy * remove unused code * update readme for new policy usage |
||
---|---|---|
.. | ||
__init__.py | ||
shard_config.py | ||
sharder.py | ||
slicer.py |