github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/applications/Chat/coati/trainer/strategies/__init__.py

9 lines
208 B
Python
Raw Normal View History

[Coati] first commit (#3283)
2023-03-28 12:25:36 +00:00
from .base import Strategy
[chat] remove naive strategy and split colossalai strategy (#4094) * feat: remove on_learn_epoch fn as not used * revert: add _on_learn_epoch fn * to: remove the use of NaiveStrategy * test: remove NaiveStrategy tests * feat: remove NaiveStrategy * style: modify comments and params * feat: split ColossalAIStrategy into LowLevelZeroStrategy and GeminiStrategy * fix: remove naive * fix: align with modified colossal strategy * fix: fix ddp _try_init_dist arg
2023-06-29 10:11:00 +00:00
from .colossalai import GeminiStrategy, LowLevelZeroStrategy
[Coati] first commit (#3283)
2023-03-28 12:25:36 +00:00
from .ddp import DDPStrategy
[chat] remove naive strategy and split colossalai strategy (#4094) * feat: remove on_learn_epoch fn as not used * revert: add _on_learn_epoch fn * to: remove the use of NaiveStrategy * test: remove NaiveStrategy tests * feat: remove NaiveStrategy * style: modify comments and params * feat: split ColossalAIStrategy into LowLevelZeroStrategy and GeminiStrategy * fix: remove naive * fix: align with modified colossal strategy * fix: fix ddp _try_init_dist arg
2023-06-29 10:11:00 +00:00
__all__ = [
'Strategy', 'DDPStrategy',
'LowLevelZeroStrategy', 'GeminiStrategy'
]