Branch: feature/inference-refactor

ColossalChat

ckpt

cloud/coati

colossalchat

colossalchat_upgrade

dev/gpt2_metainfo_patch

dev/zero-offload

develop

feat/moe

feat/online-serving

feat/speculative-decoding

feature/2-stage

feature/async-io

feature/colossal-infer

feature/elixir

feature/inference-refactor

feature/lora

feature/stable-diffusion

feature/zerobubble

fix-setup

fix/format

flybird11111-patch-1

hotfix/example_test

hotfix/kernel_build_before_load

llama3

main

moe_sp

pre-commit-ci-update-config

refactor/inference

supercooledith-patch-1

support-npu

v0.0.1-beta

v0.0.2

v0.1.0

v0.1.1

v0.1.10

v0.1.11rc1

v0.1.11rc2

v0.1.11rc3

v0.1.11rc4

v0.1.11rc5

v0.1.12

v0.1.13

v0.1.2

v0.1.3

v0.1.4

v0.1.5

v0.1.6

v0.1.7

v0.1.8

v0.1.9

v0.2.0

v0.2.1

v0.2.2

v0.2.3

v0.2.4

v0.2.5

v0.2.6

v0.2.7

v0.2.8

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.3.6

v0.3.7

v0.3.8

v0.3.9

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.4.6

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'feature/inference-refactor'

${ noResults }

Commit Graph

145 Commits (feature/inference-refactor)

Author	SHA1	Message	Date
ppt0011	335cb105e2	[doc] add supported feature diagram for hybrid parallel plugin (#4996)	1 year ago
digger yu	11009103be	[nfc] fix some typo with colossalai/ docs/ etc. (#4920)	1 year ago
Baizhou Zhang	21ba89cab6	[gemini] support gradient accumulation (#4869) ... * add test * fix no_sync bug in low level zero plugin * fix test * add argument for grad accum * add grad accum in backward hook for gemini * finish implementation, rewrite tests * fix test * skip stuck model in low level zero test * update doc * optimize communication & fix gradient checkpoint * modify doc * cleaning codes * update cpu adam fp16 case	1 year ago
flybird11111	6a21f96a87	[doc] update advanced tutorials, training gpt with hybrid parallelism (#4866) ... * [doc]update advanced tutorials, training gpt with hybrid parallelism * [doc]update advanced tutorials, training gpt with hybrid parallelism * update vit tutorials * update vit tutorials * update vit tutorials * update vit tutorials * update en/train_vit_with_hybrid_parallel.py * fix * resolve comments * fix	1 year ago
Zhongkai Zhao	db40e086c8	[test] modify model supporting part of low_level_zero plugin (including correspoding docs)	1 year ago
binmakeswell	822051d888	[doc] update slack link (#4823)	1 year ago
Hongxin Liu	da15fdb9ca	[doc] add lazy init docs (#4808)	1 year ago
Baizhou Zhang	64a08b2dc3	[checkpointio] support unsharded checkpointIO for hybrid parallel (#4774) ... * support unsharded saving/loading for model * support optimizer unsharded saving * update doc * support unsharded loading for optimizer * small fix	1 year ago
Baizhou Zhang	a2db75546d	[doc] polish shardformer doc (#4779) ... * fix example format in docstring * polish shardformer doc	1 year ago
binmakeswell	d512a4d38d	[doc] add llama2 domain-specific solution news (#4789) ... * [doc] add llama2 domain-specific solution news	1 year ago
Baizhou Zhang	493a5efeab	[doc] add shardformer doc to sidebar (#4768)	1 year ago
Hongxin Liu	66f3926019	[doc] clean up outdated docs (#4765) ... * [doc] clean up outdated docs * [doc] fix linking * [doc] fix linking	1 year ago
Pengtai Xu	4d7537ba25	[doc] put native colossalai plugins first in description section	1 year ago
Pengtai Xu	e10d9f087e	[doc] add model examples for each plugin	1 year ago
Pengtai Xu	a04337bfc3	[doc] put individual plugin explanation in front	1 year ago
Pengtai Xu	10513f203c	[doc] explain suitable use case for each plugin	1 year ago
Hongxin Liu	b5f9e37c70	[legacy] clean up legacy code (#4743) ... * [legacy] remove outdated codes of pipeline (#4692) * [legacy] remove cli of benchmark and update optim (#4690) * [legacy] remove cli of benchmark and update optim * [doc] fix cli doc test * [legacy] fix engine clip grad norm * [legacy] remove outdated colo tensor (#4694) * [legacy] remove outdated colo tensor * [test] fix test import * [legacy] move outdated zero to legacy (#4696) * [legacy] clean up utils (#4700) * [legacy] clean up utils * [example] update examples * [legacy] clean up amp * [legacy] fix amp module * [legacy] clean up gpc (#4742) * [legacy] clean up context * [legacy] clean core, constants and global vars * [legacy] refactor initialize * [example] fix examples ci * [example] fix examples ci * [legacy] fix tests * [example] fix gpt example * [example] fix examples ci * [devops] fix ci installation * [example] fix examples ci	1 year ago
Baizhou Zhang	d151dcab74	[doc] explaination of loading large pretrained models (#4741)	1 year ago
Baizhou Zhang	451c3465fb	[doc] polish shardformer doc (#4735) ... * arrange position of chapters * fix typos in seq parallel doc	1 year ago
Bin Jia	6a03c933a0	[shardformer] update seq parallel document (#4730) ... * update doc of seq parallel * fix typo	1 year ago
flybird11111	46162632e5	[shardformer] update pipeline parallel document (#4725) ... * [shardformer] update pipeline parallel document * [shardformer] update pipeline parallel document * [shardformer] update pipeline parallel document * [shardformer] update pipeline parallel document * [shardformer] update pipeline parallel document * [shardformer] update pipeline parallel document * [shardformer] update pipeline parallel document * [shardformer] update pipeline parallel document	1 year ago
Baizhou Zhang	50e5602c2d	[doc] add shardformer support matrix/update tensor parallel documents (#4728) ... * add compatibility matrix for shardformer doc * update tp doc	1 year ago
github-actions[bot]	8c2dda7410	[format] applied code formatting on changed files in pull request 4726 (#4727) ... Co-authored-by: github-actions <github-actions@github.com>	1 year ago
Baizhou Zhang	f911d5b09d	[doc] Add user document for Shardformer (#4702) ... * create shardformer doc files * add docstring for seq-parallel * update ShardConfig docstring * add links to llama example * add outdated massage * finish introduction & supporting information * finish 'how shardformer works' * finish shardformer.md English doc * fix doctest fail * add Chinese document	1 year ago
binmakeswell	ce97790ed7	[doc] fix llama2 code link (#4726) ... * [doc] fix llama2 code link * [doc] fix llama2 code link * [doc] fix llama2 code link	1 year ago
Baizhou Zhang	1d454733c4	[doc] Update booster user documents. (#4669) ... * update booster_api.md * update booster_checkpoint.md * update booster_plugins.md * move transformers importing inside function * fix Dict typing * fix autodoc bug * small fix	1 year ago
Hongxin Liu	554aa9592e	[legacy] move communication and nn to legacy and refactor logger (#4671) ... * [legacy] move communication to legacy (#4640) * [legacy] refactor logger and clean up legacy codes (#4654) * [legacy] make logger independent to gpc * [legacy] make optim independent to registry * [legacy] move test engine to legacy * [legacy] move nn to legacy (#4656) * [legacy] move nn to legacy * [checkpointio] fix save hf config * [test] remove useledd rpc pp test * [legacy] fix nn init * [example] skip tutorial hybriad parallel example * [devops] test doc check * [devops] test doc check	1 year ago
Hongxin Liu	ac178ca5c1	[legacy] move builder and registry to legacy (#4603)	1 year ago
Hongxin Liu	8accecd55b	[legacy] move engine to legacy (#4560) ... * [legacy] move engine to legacy * [example] fix seq parallel example * [example] fix seq parallel example * [test] test gemini pluging hang * [test] test gemini pluging hang * [test] test gemini pluging hang * [test] test gemini pluging hang * [test] test gemini pluging hang * [example] update seq parallel requirements	1 year ago
Hongxin Liu	89fe027787	[legacy] move trainer to legacy (#4545) ... * [legacy] move trainer to legacy * [doc] update docs related to trainer * [test] ignore legacy test	1 year ago
binmakeswell	7a978eb3d0	[DOC] hotfix/llama2news (#4595) ... * [doc] add llama2 news * [doc] add llama2 news * [doc] add llama2 news	1 year ago
Hongxin Liu	27061426f7	[gemini] improve compatibility and add static placement policy (#4479) ... * [gemini] remove distributed-related part from colotensor (#4379) * [gemini] remove process group dependency * [gemini] remove tp part from colo tensor * [gemini] patch inplace op * [gemini] fix param op hook and update tests * [test] remove useless tests * [test] remove useless tests * [misc] fix requirements * [test] fix model zoo * [test] fix model zoo * [test] fix model zoo * [test] fix model zoo * [test] fix model zoo * [misc] update requirements * [gemini] refactor gemini optimizer and gemini ddp (#4398) * [gemini] update optimizer interface * [gemini] renaming gemini optimizer * [gemini] refactor gemini ddp class * [example] update gemini related example * [example] update gemini related example * [plugin] fix gemini plugin args * [test] update gemini ckpt tests * [gemini] fix checkpoint io * [example] fix opt example requirements * [example] fix opt example * [example] fix opt example * [example] fix opt example * [gemini] add static placement policy (#4443) * [gemini] add static placement policy * [gemini] fix param offload * [test] update gemini tests * [plugin] update gemini plugin * [plugin] update gemini plugin docstr * [misc] fix flash attn requirement * [test] fix gemini checkpoint io test * [example] update resnet example result (#4457) * [example] update bert example result (#4458) * [doc] update gemini doc (#4468) * [example] update gemini related examples (#4473) * [example] update gpt example * [example] update dreambooth example * [example] update vit * [example] update opt * [example] update palm * [example] update vit and opt benchmark * [hotfix] fix bert in model zoo (#4480) * [hotfix] fix bert in model zoo * [test] remove chatglm gemini test * [test] remove sam gemini test * [test] remove vit gemini test * [hotfix] fix opt tutorial example (#4497) * [hotfix] fix opt tutorial example * [hotfix] fix opt tutorial example	1 year ago
binmakeswell	089c365fa0	[doc] add Series A Funding and NeurIPS news (#4377) ... * [doc] add Series A Funding and NeurIPS news * [kernal] fix mha kernal * [CI] skip moe * [CI] fix requirements	1 year ago
flybird1111	f40b718959	[doc] Fix gradient accumulation doc. (#4349) ... * [doc] fix gradient accumulation doc * [doc] fix gradient accumulation doc	1 year ago
Baizhou Zhang	c6f6005990	[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302) ... * sharded optimizer checkpoint for gemini plugin * modify test to reduce testing time * update doc * fix bug when keep_gatherd is true under GeminiPlugin	1 year ago
binmakeswell	7ff11b5537	[example] add llama pretraining (#4257)	1 year ago
Jianghai	711e2b4c00	[doc] update and revise some typos and errs in docs (#4107) ... * fix some typos and problems in doc * fix some typos and problems in doc * add doc test	1 year ago
digger yu	769cddcb2c	fix typo docs/ (#4033)	1 year ago
Baizhou Zhang	4da324cd60	[hotfix]fix argument naming in docs and examples (#4083)	1 year ago
Frank Lee	ddcf58cacf	Revert "[sync] sync feature/shardformer with develop"	1 year ago
digger yu	33eef714db	fix typo examples and docs (#3932)	1 year ago
Hongxin Liu	12c90db3f3	[doc] add lazy init tutorial (#3922) ... * [doc] add lazy init en doc * [doc] add lazy init zh doc * [doc] add lazy init doc in sidebar * [doc] add lazy init doc test * [doc] fix lazy init doc link	1 year ago
Baizhou Zhang	c1535ccbba	[doc] fix docs about booster api usage (#3898)	1 year ago
jiangmingyan	07cb21142f	[doc]update moe chinese document. (#3890) ... * [doc]update-moe * [doc]update-moe * [doc]update-moe * [doc]update-moe * [doc]update-moe	1 year ago
jiangmingyan	281b33f362	[doc] update document of zero with chunk. (#3855) ... * [doc] fix title of mixed precision * [doc]update document of zero with chunk * [doc] update document of zero with chunk, fix * [doc] update document of zero with chunk, fix * [doc] update document of zero with chunk, fix * [doc] update document of zero with chunk, add doc test * [doc] update document of zero with chunk, add doc test * [doc] update document of zero with chunk, fix installation * [doc] update document of zero with chunk, fix zero with chunk doc * [doc] update document of zero with chunk, fix zero with chunk doc	2 years ago
jiangmingyan	b0474878bf	[doc] update nvme offload documents. (#3850)	2 years ago
jiangmingyan	a64df3fa97	[doc] update document of gemini instruction. (#3842) ... * [doc] update meet_gemini.md * [doc] update meet_gemini.md * [doc] fix parentheses * [doc] fix parentheses * [doc] fix doc test * [doc] fix doc test * [doc] fix doc	2 years ago
Frank Lee	54e97ed7ea	[workflow] supported test on CUDA 10.2 (#3841)	2 years ago
wukong1992	3229f93e30	[booster] add warning for torch fsdp plugin doc (#3833)	2 years ago
digger yu	518b31c059	[docs] change placememt_policy to placement_policy (#3829) ... * fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc. * fix typo colossalai/auto_parallel autochunk fx/passes etc. * fix typo docs/ * change placememt_policy to placement_policy in docs/ and examples/	2 years ago