ColossalAI

Commit Graph

Author	SHA1	Message	Date
Edenzzzz	15055f9a36	[hotfix] quick fixes to make legacy tutorials runnable (#5559 ) Co-authored-by: Edenzzzz <wtan45@wisc.edu>	8 months ago
Frank Lee	7cfed5f076	[feat] refactored extension module (#5298 ) * [feat] refactored extension module * polish * polish * polish * polish * polish * polish * polish * polish * polish * polish	10 months ago
digger yu	bce9499ed3	fix some typo (#5307 )	10 months ago
Hongxin Liu	d202cc28c0	[npu] change device to accelerator api (#5239 ) * update accelerator * fix timer * fix amp * update * fix * update bug * add error raise * fix autocast * fix set device * remove doc accelerator * update doc * update doc * update doc * use nullcontext * update cpu * update null context * change time limit for example * udpate * update * update * update * [npu] polish accelerator code --------- Co-authored-by: Xuanlei Zhao <xuanlei.zhao@gmail.com> Co-authored-by: zxl <43881818+oahzxl@users.noreply.github.com>	11 months ago
flybird11111	26cd6d850c	[fix] fix weekly runing example (#4787 ) * [fix] fix weekly runing example * [fix] fix weekly runing example	1 year ago
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752 ) * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
Hongxin Liu	b5f9e37c70	[legacy] clean up legacy code (#4743 ) * [legacy] remove outdated codes of pipeline (#4692) * [legacy] remove cli of benchmark and update optim (#4690) * [legacy] remove cli of benchmark and update optim * [doc] fix cli doc test * [legacy] fix engine clip grad norm * [legacy] remove outdated colo tensor (#4694) * [legacy] remove outdated colo tensor * [test] fix test import * [legacy] move outdated zero to legacy (#4696) * [legacy] clean up utils (#4700) * [legacy] clean up utils * [example] update examples * [legacy] clean up amp * [legacy] fix amp module * [legacy] clean up gpc (#4742) * [legacy] clean up context * [legacy] clean core, constants and global vars * [legacy] refactor initialize * [example] fix examples ci * [example] fix examples ci * [legacy] fix tests * [example] fix gpt example * [example] fix examples ci * [devops] fix ci installation * [example] fix examples ci	1 year ago
Hongxin Liu	554aa9592e	[legacy] move communication and nn to legacy and refactor logger (#4671 ) * [legacy] move communication to legacy (#4640) * [legacy] refactor logger and clean up legacy codes (#4654) * [legacy] make logger independent to gpc * [legacy] make optim independent to registry * [legacy] move test engine to legacy * [legacy] move nn to legacy (#4656) * [legacy] move nn to legacy * [checkpointio] fix save hf config * [test] remove useledd rpc pp test * [legacy] fix nn init * [example] skip tutorial hybriad parallel example * [devops] test doc check * [devops] test doc check	1 year ago
Hongxin Liu	8accecd55b	[legacy] move engine to legacy (#4560 ) * [legacy] move engine to legacy * [example] fix seq parallel example * [example] fix seq parallel example * [test] test gemini pluging hang * [test] test gemini pluging hang * [test] test gemini pluging hang * [test] test gemini pluging hang * [test] test gemini pluging hang * [example] update seq parallel requirements	1 year ago
Tian Siyuan	f1ae8c9104	[example] change accelerate version (#4431 ) Co-authored-by: Siyuan Tian <siyuant@vmware.com> Co-authored-by: Hongxin Liu <lhx0217@gmail.com>	1 year ago
Hongxin Liu	27061426f7	[gemini] improve compatibility and add static placement policy (#4479 ) * [gemini] remove distributed-related part from colotensor (#4379) * [gemini] remove process group dependency * [gemini] remove tp part from colo tensor * [gemini] patch inplace op * [gemini] fix param op hook and update tests * [test] remove useless tests * [test] remove useless tests * [misc] fix requirements * [test] fix model zoo * [test] fix model zoo * [test] fix model zoo * [test] fix model zoo * [test] fix model zoo * [misc] update requirements * [gemini] refactor gemini optimizer and gemini ddp (#4398) * [gemini] update optimizer interface * [gemini] renaming gemini optimizer * [gemini] refactor gemini ddp class * [example] update gemini related example * [example] update gemini related example * [plugin] fix gemini plugin args * [test] update gemini ckpt tests * [gemini] fix checkpoint io * [example] fix opt example requirements * [example] fix opt example * [example] fix opt example * [example] fix opt example * [gemini] add static placement policy (#4443) * [gemini] add static placement policy * [gemini] fix param offload * [test] update gemini tests * [plugin] update gemini plugin * [plugin] update gemini plugin docstr * [misc] fix flash attn requirement * [test] fix gemini checkpoint io test * [example] update resnet example result (#4457) * [example] update bert example result (#4458) * [doc] update gemini doc (#4468) * [example] update gemini related examples (#4473) * [example] update gpt example * [example] update dreambooth example * [example] update vit * [example] update opt * [example] update palm * [example] update vit and opt benchmark * [hotfix] fix bert in model zoo (#4480) * [hotfix] fix bert in model zoo * [test] remove chatglm gemini test * [test] remove sam gemini test * [test] remove vit gemini test * [hotfix] fix opt tutorial example (#4497) * [hotfix] fix opt tutorial example * [hotfix] fix opt tutorial example	1 year ago
Tian Siyuan	ff836790ae	[doc] fix a typo in examples/tutorial/auto_parallel/README.md (#4430 ) Co-authored-by: Siyuan Tian <siyuant@vmware.com>	1 year ago
binmakeswell	089c365fa0	[doc] add Series A Funding and NeurIPS news (#4377 ) * [doc] add Series A Funding and NeurIPS news * [kernal] fix mha kernal * [CI] skip moe * [CI] fix requirements	1 year ago
github-actions[bot]	4e9b09c222	Automated submodule synchronization (#4217 ) Co-authored-by: github-actions <github-actions@github.com>	1 year ago
Maruyama_Aya	b29e1f0722	change directory	1 year ago
Maruyama_Aya	1c1f71cbd2	fixing insecure hash function	1 year ago
Maruyama_Aya	b56c7f4283	update shell file	1 year ago
Maruyama_Aya	176010f289	update performance evaluation	1 year ago
Maruyama_Aya	25447d4407	modify path	1 year ago
Maruyama_Aya	60ec33bb18	Add a new example of Dreambooth training using the booster API	1 year ago
github-actions[bot]	62c7e67f9f	[format] applied code formatting on changed files in pull request 3786 (#3787 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	ad2cf58f50	[chat] add performance and tutorial (#3786 )	2 years ago
digger-yu	b7141c36dd	[CI] fix some spelling errors (#3707 ) * fix spelling error with examples/comminity/ * fix spelling error with tests/ * fix some spelling error with tests/ colossalai/ etc.	2 years ago
Hongxin Liu	3bf09efe74	[booster] update prepare dataloader method for plugin (#3706 ) * [booster] add prepare dataloader method for plug * [booster] update examples and docstr	2 years ago
Hongxin Liu	f83ea813f5	[example] add train resnet/vit with booster example (#3694 ) * [example] add train vit with booster example * [example] update readme * [example] add train resnet with booster example * [example] enable ci * [example] enable ci * [example] add requirements * [hotfix] fix analyzer init * [example] update requirements	2 years ago
Hongxin Liu	d556648885	[example] add finetune bert with booster example (#3693 )	2 years ago
github-actions[bot]	d544ed4345	[bot] Automated submodule synchronization (#3596 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	f1b3d60cae	[example] reorganize for community examples (#3557 )	2 years ago
Frank Lee	80eba05b0a	[test] refactor tests with spawn (#3452 ) * [test] added spawn decorator * polish code * polish code * polish code * polish code * polish code * polish code	2 years ago
Frank Lee	7d8d825681	[booster] fixed the torch ddp plugin with the new checkpoint api (#3442 )	2 years ago
ver217	573af84184	[example] update examples related to zero/gemini (#3431 ) * [zero] update legacy import * [zero] update examples * [example] fix opt tutorial * [example] fix opt tutorial * [example] fix opt tutorial * [example] fix opt tutorial * [example] fix import	2 years ago
ver217	26b7aac0be	[zero] reorganize zero/gemini folder structure (#3424 ) * [zero] refactor low-level zero folder structure * [zero] fix legacy zero import path * [zero] fix legacy zero import path * [zero] remove useless import * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor legacy zero import path * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor legacy zero import path * [zero] fix test import path * [zero] fix test * [zero] fix circular import * [zero] update import	2 years ago
YuliangLiu0306	fd6add575d	[examples] polish AutoParallel readme (#3270 )	2 years ago
Frank Lee	73d3e4d309	[booster] implemented the torch ddd + resnet example (#3232 ) * [booster] implemented the torch ddd + resnet example * polish code	2 years ago
github-actions[bot]	0aa92c0409	Automated submodule synchronization (#3105 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	018936a3f3	[tutorial] update notes for TransformerEngine (#3098 )	2 years ago
Kirthi Shankar Sivamani	65a4dbda6c	[NVIDIA] Add FP8 example using TE (#3080 ) Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>	2 years ago
binmakeswell	52a5078988	[doc] add ISC tutorial (#2997 ) * [doc] add ISC tutorial * [doc] add ISC tutorial * [doc] add ISC tutorial * [doc] add ISC tutorial	2 years ago
github-actions[bot]	827a0af8cc	Automated submodule synchronization (#2982 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	0afb55fc5b	[doc] add os scope, update tutorial install and tips (#2914 )	2 years ago
Zheng Zeng	597914317b	[doc] fix typo in opt inference tutorial (#2849 )	2 years ago
github-actions[bot]	a5721229d9	Automated submodule synchronization (#2740 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
github-actions[bot]	d701ef81b1	Automated submodule synchronization (#2707 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
github-actions[bot]	88416019e7	Automated submodule synchronization (#2648 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	9ab14b20b5	[doc] add CVPR tutorial (#2666 )	2 years ago
Frank Lee	4ae02c4b1c	[tutorial] added energonai to opt inference requirements (#2625 )	2 years ago
binmakeswell	0556f5d468	[tutorial] add video link (#2619 )	2 years ago
github-actions[bot]	ae86be1fd2	Automated submodule synchronization (#2607 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	039b0c487b	[tutorial] polish README (#2568 )	2 years ago
oahzxl	4f5ef73a43	[tutorial] update fastfold tutorial (#2565 ) * update readme * update * update	2 years ago

1 2

84 Commits (feat/speculative-decoding)