You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/core.py

8 lines
197 B

#!/usr/bin/env python
# -*- encoding: utf-8 -*-
from colossalai.context import ParallelContext, MoeContext
global_context = ParallelContext.get_instance()
MOE_CONTEXT = MoeContext.get_instance()