You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Super Daniel c8e9b2ad78 [hotfix/rotor] fix variable names (#1597) ... * [fx] add some comment and docstrings. * [fx] add dataflow analysis for an autograd graph. * add intepretation for graph analysis. * [fx] before doing save_tensor_hooks. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] a very accurate version on GPT-2. * [fx] refactor code. * [fx] remove redundant inplace=True. * [fx] refactor code. * [fx] refactor code. * [fx] refactor code. * [fx] dive into backward memory. * [fx] fix variable names in ckpt_solvers and unskip tests. * [fx] commit my changes. * [fx] restore skips. * [fx] restore skips. * [fx] chaange stage into phase. * [fx] chaange stage into phase. * [fx] chaange stage into phase.		2 years ago
..
amp	[doc] update rst and docstring (#1351)	2 years ago
auto_parallel	[autoparallel] add reshape handler (#1594)	2 years ago
builder	[NFC] polish colossalai/builder/__init__.py code style (#1560)	2 years ago
cli	[hotfix] fix some bugs caused by size mismatch. (#1011)	3 years ago
communication	[communication] add p2p_v2.py to support communication with List[Any] (#1407)	2 years ago
context	[autoparallel] refactored shape consistency to remove redundancy (#1591)	2 years ago
device	[tensor]add 1D device mesh (#1492)	2 years ago
engine	[engin/schedule] use p2p_v2 to recontruct pipeline_schedule (#1408)	2 years ago
fx	[hotfix/rotor] fix variable names (#1597)	2 years ago
gemini	[NFC] polish colossalai/gemini/update/chunkv2.py code style (#1565)	2 years ago
kernel	[hotfix] fix CPUAdam kernel nullptr (#1410)	2 years ago
logging	[doc] improved docstring in the logging module (#861)	3 years ago
nn	[embeddings] add already_split_along_rank flag for tablewise mode (#1584)	2 years ago
pipeline	[NFC] polish colossalai/pipeline/utils.py code style (#1562)	2 years ago
registry	Remove duplication registry (#1078)	3 years ago
tensor	[autoparallel] refactored shape consistency to remove redundancy (#1591)	2 years ago
testing	[NFC] polish colossalai/testing/comparison.py code style. (#1558)	2 years ago
trainer	[NFC] polish ./colossalai/trainer/hooks/_lr_scheduler_hook.py code style (#1576)	2 years ago
utils	[NFC] polish utils/tensor_detector/__init__.py code style (#1573)	2 years ago
zero	[NFC] polish colossalai/zero/sharded_model/reduce_scatter.py code style (#1554)	2 years ago
__init__.py	[fx] provide a stable but not accurate enough version of profiler. (#1547)	2 years ago
_meta_registrations.py	[fx] provide a stable but not accurate enough version of profiler. (#1547)	2 years ago
constants.py	fix typo in constants (#1027)	3 years ago
core.py	[Tensor] distributed view supports inter-process hybrid parallel (#1169)	2 years ago
global_variables.py	[MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)	3 years ago
initialize.py	[hotfix] remove potiential circle import (#1307)	2 years ago