1060 Commits (e4bf7ae667a0384bb2791b7f782d0b9e43812423)

 

All Branches   

Search

Author	SHA1	Message	Date
superhao1995	e4bf7ae667	[NFC] polish colossalai/nn/lr_scheduler/torch.py code style (#1571) ... Co-authored-by: Research <research@soccf-snr3-017.comp.nus.edu.sg>	2 years ago
Jiatong Han	3263cdf57f	[NFC] polish colossalai/nn/parallel/data_parallel.py code style (#1570) ... Co-authored-by: JThh <jiatong.han@u.nus.edu>	2 years ago
Zirui Zhu	f566c9b98d	[NFC] polish colossalai/pipeline/utils.py code style (#1562)	2 years ago
Xue Fuzhao	e070ca45c6	[NFC] polish colossalai/fx/tracer/meta_patch/patched_module/convolution.py code style (#1563)	2 years ago
Zangwei Zheng	9823cbf24b	[NFC] polish colossalai/gemini/update/chunkv2.py code style (#1565)	2 years ago
DouJS	f586887a90	[NFC] polish colossalai/nn/layer/colossalai_layer/dropout.py code style (#1568)	2 years ago
LuGY	c7d4932956	[NFC] polish colossalai/utils/tensor_detector/tensor_detector.py code style (#1566)	2 years ago
BigOneLiXiaoMing	0c4c9aa6e0	[NFC] polish colossalai/nn/_ops/embedding.py code style (#1561)	2 years ago
Ziheng Qin	08815f0e72	[NFC] polish colossalai/builder/__init__.py code style (#1560) ... Co-authored-by: henryqin1997 <henryqin1997@gamil.com>	2 years ago
Super Daniel	8328917348	[NFC] polish colossalai/testing/comparison.py code style. (#1558)	2 years ago
Ofey Chan	7cc052f6c0	[NFC] polish colossalai/nn/layer/colossalai_layer/linear.py (#1556)	2 years ago
Kai Wang (Victor Kai)	46931e3c32	[NFC] polish code colossalai/gemini/update/search_utils.py (#1557)	2 years ago
yuxuan-lou	413f9c19f4	[NFC] polish colossalai/nn/_ops/layernorm.py code style (#1555)	2 years ago
shenggan	8edb777cc2	[NFC] polish colossalai/nn/loss/loss_2p5d.py code style (#1553)	2 years ago
Maruyama_Aya	bd2d789832	[NFC] polish colossalai/nn/_ops/embedding_bag.py code style (#1552)	2 years ago
binmakeswell	73e9eb13b7	[NFC] polish colossalai/nn/lr_scheduler/cosine.py code style	2 years ago
Kirigaya Kazuto	318fbf1145	[NFC] polish colossalai/utils/multi_tensor_apply/multi_tensor_apply.py code style (#1559)	2 years ago
ver217	b0f4c0bddf	update version (#1574)	2 years ago
CsRic	a389ac4ec9	[embedding] cache_embedding small improvement (#1564)	2 years ago
ver217	10dd8226b1	add gather_output for VocabParallelClassifier1D (#1569)	2 years ago
アマデウス	e615cfc3a8	[NFC] polish test component gpt code style (#1567)	2 years ago
Kirigaya Kazuto	6159d45417	[pipeline/tuning] improve dispatch performance both time and space cost (#1544)	2 years ago
Super Daniel	4f59693207	[fx] provide a stable but not accurate enough version of profiler. (#1547) ... * [fx] compute memory stat and flop count for MetaInfoProp. * [fx] modify node attribute. * [fx] modify ckpt_chen. * [fx] fix compatibility. * [fx] fix import error. * [fx] skip test for MetaInfoProp. * [fx] skip test for MetaInfoProp. * [fx] skip test for MetaInfoProp. * [fx] skip test for MetaInfoProp. * [fx] skip if torch 1.11.0. * [fx] recover MetaInfoProp support for PyTorch 1.11. * [fx] provide a stable but not accurate enough version of profiler. * [fx] provide a stable but not accurate enough version of profiler. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix compatibility in tests. * [fx] fix import error.	2 years ago
github-actions[bot]	7d49e7b2db	Automated submodule synchronization (#1534) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
YuliangLiu0306	0908d0fc61	[autoparallel]add backward cost info into strategies (#1524)	2 years ago
YuliangLiu0306	1a3599410d	[autoparallel] support fucntion in operator handler (#1529)	2 years ago
YuliangLiu0306	44c866a3e3	[autoparallel] change the merge node logic (#1533)	2 years ago
ver217	ae71036cd2	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) ... * refactor parallel layer * broadcast rank0 model after load ckpt	2 years ago
ver217	2bed096848	[utils] optimize partition_tensor_parallel_state_dict (#1546)	2 years ago
Super Daniel	d8a5aded19	[hotfix] change namespace for meta_trace. (#1541)	2 years ago
ver217	a203b709d5	[hotfix] fix init context (#1543) ... * fix init context * fix lazy init ctx	2 years ago
Jiarui Fang	64169f3e8f	[embedding] polish parallel embedding tablewise (#1545)	2 years ago
Boyuan Yao	46c6cc79a9	[fx] Add common node in model linearize (#1542) ... * [fx] Add common node into linearize * [fx] Add common node to solver	2 years ago
CsRic	964123ae0f	[embedding] freq_aware_embedding: add small functions for caller application (#1537)	2 years ago
Super Daniel	70129603aa	[fx] support meta tracing for aten level computation graphs like functorch. (#1536) ... * [fx] support meta tracing for aten level computation graphs like functorch. * [fx] support meta tracing for aten level computation graphs like functorch. * [fx] remove redundant import. * [fx] add docstring.	2 years ago
Jiarui Fang	521078ffc9	[embedding] fix a bug in table wise sharding (#1538)	2 years ago
Jiarui Fang	87134524fd	[embedding] tablewise sharding polish (#1535)	2 years ago
Boyuan Yao	56159049e8	[fx] Modify solver linearize and add corresponding test (#1531) ... * [fx] modify solver linearize and add test * [fx] add torch11 test of linearize but skip it * [fx] remove some unused imports	2 years ago
Super Daniel	7dc53237c3	[fx] add test for meta tensor. (#1527) ... * [fx] add test for meta tensor. * [fx] add test for meta tensor. * [fx] add test for meta tensor. * [fx] add test for meta tensor. * [fx] fix error.	2 years ago
YuliangLiu0306	4b3d6caeb3	[fx]patch nn.functional convolution (#1528)	2 years ago
CsRic	5156d5b4f8	[embedding] add tablewise sharding for FAW (#1526)	2 years ago
Kirigaya Kazuto	f1e1836218	[pipeline/pipleline_process_group] finish PipelineProcessGroup to manage local abd global rank in TP,DP and PP (#1508) ... * support p2p communication with any type of object | pass test * reconstruct pipeline schedule with p2p_v2.py(support communication with List[Any]) | pass test * [engin/schedule] use p2p_v2 to recontruct pipeline_schedule * [pipeline/rpc] implement a demo for PP with cuda rpc framework * [pipeline/rpc] support interleaving | fix checkpoint bug | change logic when dispatch data in work_list to ensure steady 1F1B * [pipeline/rpc] implement distributed optimizer | test with assert_close * [pipeline/rpc] implement distributed optimizer | test with assert_close * [pipeline/rpc] update outstanding mechanism | optimize dispatching strategy * [pipeline/rpc] update outstanding mechanism | optimize dispatching strategy * [pipeline/rpc] update outstanding mechanism | optimize dispatching strategy * [pipeline/pipleline_process_group] finish PipelineProcessGroup to manage local abd global rank in TP,DP and PP * [pipeline/pipleline_process_group] remove comment * [pipeline/pipleline_process_group] remove comment * [pipeline/pipleline_process_group] skip process group test * [pipeline/pipleline_process_group] remove test named function	2 years ago
binmakeswell	8a29ce5443	polish license (#1522)	2 years ago
Super Daniel	112a1f0a8f	[hotfix] avoid conflict of meta registry with torch 1.13.0. (#1530) ... * [hotfix] avoid conflict of meta registry with torch 1.13.0. * [hotfix] avoid conflict of meta registry with torch 1.13.0.	2 years ago
Boyuan Yao	b231430bcb	[fx] Fix wrong index in annotation and minimal flops in ckpt solver (#1521) ... * [fx] fix wrong variable name in solver rotor * [fx] fix wrong variable name in solver rotor * [fx] fix the discretize bug * [fx] fix the first op in activation checkpoint codegen * [fx] fix some bugs of ckpt solver * [fx] modify test_ckpt_torchvision * [fx] set sequence to __sequence__ attr of GraphModule * [fx] docstring modification * [fx] remove performance test	2 years ago
github-actions[bot]	07f5a4e054	Automated submodule synchronization (#1523) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
Super Daniel	5cc849f6ce	[fx] hack __torch_dispatch__ for meta tensor and autograd. (#1515) ... * [fx] hack __torch_dispatch__ for meta tensor and autograd. * [fx] hack __torch_dispatch__ for meta tensor and autograd. * [fx] hack __torch_dispatch__ for meta tensor and autograd. * [fx] hack __torch_dispatch__ for meta tensor and autograd. * [fx] hack __torch_dispatch__ for meta tensor and autograd. * [fx] add bad case detections. * [fx] add bad case detections. * [fx] rename MetaTensor attributes. * [fx] fix unexpected error. * [fx] fix unexpected error. * [fx] fix unexpected error. * [fx] fix unexpected error. * [fx] fix unexpected error. * [fx] add register backward for native_batch_norm_backward. * [fx] add more meta backend support for nn.Modules. * [fx] add meta backend to support timm and torchvision models. * [fx] add meta hardswish for timm models.	2 years ago
Jiarui Fang	4537d39df9	[doc] docstring for FreqAwareEmbeddingBag (#1525)	2 years ago
YuliangLiu0306	3345c6d352	[autoparellel]add strategies constructor (#1505) ... * [autoparellel]add strategies constructor * remove duplicated strategies * polish code * adapt cost graph with StrategiesConstructor * polish	2 years ago
Frank Lee	a0436a62ee	[autoparallel] added liveness analysis (#1516) ... * [autoparallel] added liveness analysis * remove memory cost	2 years ago