1078 Commits (c8e9b2ad784a501c9ed4f4bf6d5943528d23be7d)

 

All Branches   

Search

Author	SHA1	Message	Date
Super Daniel	c8e9b2ad78	[hotfix/rotor] fix variable names (#1597) ... * [fx] add some comment and docstrings. * [fx] add dataflow analysis for an autograd graph. * add intepretation for graph analysis. * [fx] before doing save_tensor_hooks. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] a very accurate version on GPT-2. * [fx] refactor code. * [fx] remove redundant inplace=True. * [fx] refactor code. * [fx] refactor code. * [fx] refactor code. * [fx] dive into backward memory. * [fx] fix variable names in ckpt_solvers and unskip tests. * [fx] commit my changes. * [fx] restore skips. * [fx] restore skips. * [fx] chaange stage into phase. * [fx] chaange stage into phase. * [fx] chaange stage into phase.	2 years ago
YuliangLiu0306	faa23b9d9a	[autoparallel] add reshape handler (#1594) ... * [autoparallel] add reshape handler * polish code	2 years ago
github-actions[bot]	c938dda028	Automated submodule synchronization (#1596) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
Super Daniel	5c494d4540	[fx] provide an accurate estimation of memory. (#1587) ... * [fx] add some comment and docstrings. * [fx] add dataflow analysis for an autograd graph. * add intepretation for graph analysis. * [fx] before doing save_tensor_hooks. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] a very accurate version on GPT-2. * [fx] refactor code. * [fx] remove redundant inplace=True. * [fx] refactor code. * [fx] refactor code. * [fx] refactor code. * [fx] dive into backward memory.	2 years ago
Frank Lee	27fe8af60c	[autoparallel] refactored shape consistency to remove redundancy (#1591) ... * [autoparallel] refactored shape consistency to remove redundancy * polish code * polish code * polish code	2 years ago
YuliangLiu0306	d164449d00	[autoparallel] add resnet autoparallel unit test and add backward weight communication cost (#1589)	2 years ago
Frank Lee	7c18a588c8	[autoparallel] added generate_sharding_spec to utils (#1590)	2 years ago
Boyuan Yao	49ccf8b5f8	[fx] Improve linearize and rotor solver (#1586) ... * [fx] add nested activation_checkpoint codegen * undo algorithms commits * solver * undo some commits * [fx] torch11 add nested activation checkpoint codegen * remove some imports * [fx] add some comments in activation codegen * [fx] codegen instance error fix * [fx] imporve linearize and rotor solver * [fx] some comments and format modification	2 years ago
Frank Lee	219f66c571	[autoparallel] added solver option dataclass (#1588)	2 years ago
YuliangLiu0306	82d4376c23	[autoparallel] adapt solver with resnet (#1583) ... * [autoparallel]adapt solver with resnet * polish code * polish code	2 years ago
CsRic	f3403ff98e	[embeddings] add already_split_along_rank flag for tablewise mode (#1584)	2 years ago
github-actions[bot]	77399dc91b	Automated submodule synchronization (#1550) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
Boyuan Yao	f3687e4ee2	[fx] Add nested checkpoint in activation checkpoint codegen (#1585) ... * [fx] add nested activation_checkpoint codegen * undo algorithms commits * solver * undo some commits * [fx] torch11 add nested activation checkpoint codegen * remove some imports * [fx] add some comments in activation codegen * [fx] codegen instance error fix	2 years ago
binmakeswell	1c9ec32734	[NFC] add OPT serving (#1581)	2 years ago
Boyuan Yao	20e466527b	[NFC] polish ./colossalai/trainer/hooks/_lr_scheduler_hook.py code style (#1576)	2 years ago
Fazzie-Maqianli	06dccdde44	[NFC] polish colossalai/zero/sharded_model/reduce_scatter.py code style (#1554)	2 years ago
CsRic	2ac46f7be4	[NFC] polish utils/tensor_detector/__init__.py code style (#1573) ... Co-authored-by: ric <mkkt_bkkt@mail.ustc.edu.cn>	2 years ago
Sze-qq	2144cbae8c	[NFC] polish colossalai/nn/lr_scheduler/multistep.py code style (#1572)	2 years ago
superhao1995	e4bf7ae667	[NFC] polish colossalai/nn/lr_scheduler/torch.py code style (#1571) ... Co-authored-by: Research <research@soccf-snr3-017.comp.nus.edu.sg>	2 years ago
Jiatong Han	3263cdf57f	[NFC] polish colossalai/nn/parallel/data_parallel.py code style (#1570) ... Co-authored-by: JThh <jiatong.han@u.nus.edu>	2 years ago
Zirui Zhu	f566c9b98d	[NFC] polish colossalai/pipeline/utils.py code style (#1562)	2 years ago
Xue Fuzhao	e070ca45c6	[NFC] polish colossalai/fx/tracer/meta_patch/patched_module/convolution.py code style (#1563)	2 years ago
Zangwei Zheng	9823cbf24b	[NFC] polish colossalai/gemini/update/chunkv2.py code style (#1565)	2 years ago
DouJS	f586887a90	[NFC] polish colossalai/nn/layer/colossalai_layer/dropout.py code style (#1568)	2 years ago
LuGY	c7d4932956	[NFC] polish colossalai/utils/tensor_detector/tensor_detector.py code style (#1566)	2 years ago
BigOneLiXiaoMing	0c4c9aa6e0	[NFC] polish colossalai/nn/_ops/embedding.py code style (#1561)	2 years ago
Ziheng Qin	08815f0e72	[NFC] polish colossalai/builder/__init__.py code style (#1560) ... Co-authored-by: henryqin1997 <henryqin1997@gamil.com>	2 years ago
Super Daniel	8328917348	[NFC] polish colossalai/testing/comparison.py code style. (#1558)	2 years ago
Ofey Chan	7cc052f6c0	[NFC] polish colossalai/nn/layer/colossalai_layer/linear.py (#1556)	2 years ago
Kai Wang (Victor Kai)	46931e3c32	[NFC] polish code colossalai/gemini/update/search_utils.py (#1557)	2 years ago
yuxuan-lou	413f9c19f4	[NFC] polish colossalai/nn/_ops/layernorm.py code style (#1555)	2 years ago
shenggan	8edb777cc2	[NFC] polish colossalai/nn/loss/loss_2p5d.py code style (#1553)	2 years ago
Maruyama_Aya	bd2d789832	[NFC] polish colossalai/nn/_ops/embedding_bag.py code style (#1552)	2 years ago
binmakeswell	73e9eb13b7	[NFC] polish colossalai/nn/lr_scheduler/cosine.py code style	2 years ago
Kirigaya Kazuto	318fbf1145	[NFC] polish colossalai/utils/multi_tensor_apply/multi_tensor_apply.py code style (#1559)	2 years ago
ver217	b0f4c0bddf	update version (#1574)	2 years ago
CsRic	a389ac4ec9	[embedding] cache_embedding small improvement (#1564)	2 years ago
ver217	10dd8226b1	add gather_output for VocabParallelClassifier1D (#1569)	2 years ago
アマデウス	e615cfc3a8	[NFC] polish test component gpt code style (#1567)	2 years ago
Kirigaya Kazuto	6159d45417	[pipeline/tuning] improve dispatch performance both time and space cost (#1544)	2 years ago
Super Daniel	4f59693207	[fx] provide a stable but not accurate enough version of profiler. (#1547) ... * [fx] compute memory stat and flop count for MetaInfoProp. * [fx] modify node attribute. * [fx] modify ckpt_chen. * [fx] fix compatibility. * [fx] fix import error. * [fx] skip test for MetaInfoProp. * [fx] skip test for MetaInfoProp. * [fx] skip test for MetaInfoProp. * [fx] skip test for MetaInfoProp. * [fx] skip if torch 1.11.0. * [fx] recover MetaInfoProp support for PyTorch 1.11. * [fx] provide a stable but not accurate enough version of profiler. * [fx] provide a stable but not accurate enough version of profiler. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix import error.	2 years ago
github-actions[bot]	7d49e7b2db	Automated submodule synchronization (#1534) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
YuliangLiu0306	0908d0fc61	[autoparallel]add backward cost info into strategies (#1524)	2 years ago
YuliangLiu0306	1a3599410d	[autoparallel] support fucntion in operator handler (#1529)	2 years ago
YuliangLiu0306	44c866a3e3	[autoparallel] change the merge node logic (#1533)	2 years ago
ver217	ae71036cd2	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) ... * refactor parallel layer * broadcast rank0 model after load ckpt	2 years ago
ver217	2bed096848	[utils] optimize partition_tensor_parallel_state_dict (#1546)	2 years ago
Super Daniel	d8a5aded19	[hotfix] change namespace for meta_trace. (#1541)	2 years ago
ver217	a203b709d5	[hotfix] fix init context (#1543) ... * fix init context * fix lazy init ctx	2 years ago
Jiarui Fang	64169f3e8f	[embedding] polish parallel embedding tablewise (#1545)	2 years ago