ColossalAI

Commit Graph

Author	SHA1	Message	Date
Jiarui Fang	7e24b9b9ee	[Gemini] clean no used MemTraceOp (#1970 )	2 years ago
Boyuan Yao	7c7921f71b	[autoparallel] add torch.nn.ReLU metainfo (#1868 ) * [fx] metainfo class for auto parallel * [fx] add unit test for linear metainfo * [fx] fix bwd param for linear * [fx] modify unit test * [fx] modify unit test * [fx] modify import * [fx] modify import * [fx] modify import * [fx] move meta profiler to auto parallel * [fx] add conv metainfo class * [fx] restore profiler * [fx] restore meta profiler * [autoparallel] modify unit test * [fx] modify unit test * [autoparallel] add batchnorm metainfo class * [autoparallel] fix batchnorm unit test function declaration * [fx] restore profiler * [fx] add relu metainfo class * [fx] restore profiler * [autoparallel] modify metainfo input	2 years ago
Jiarui Fang	8c66a1d0aa	[polish] remove useless file _mem_tracer_hook.py (#1963 )	2 years ago
Jiarui Fang	c4739a725a	[Gemini] polish memstats collector (#1962 )	2 years ago
YuliangLiu0306	fea3cb661c	[autoparallel] support addmm in tracer and solver (#1961 ) * [fx] patch addmm * [autoparallel] support addmm in tracer and solver	2 years ago
Jiarui Fang	f7e276fa71	[Gemini] add GeminiAdamOptimizer (#1960 )	2 years ago
HELSON	7066dfbf82	[zero] fix memory leak for zero2 (#1955 )	2 years ago
Jiarui Fang	60abd86d6a	[example] enhance GPT demo (#1959 ) * [example] enhence GPT demo * Update README.md Co-authored-by: binmakeswell <binmakeswell@gmail.com>	2 years ago
Fazzie-Maqianli	acba142929	Merge pull request #1958 from Fazziekey/lightning update model download in README	2 years ago
Fazzie	a09f88ab07	update model download in README	2 years ago
Fazzie-Maqianli	6bdd0a90ca	update lightning version (#1954 )	2 years ago
Jiarui Fang	52c6ad26e0	[ColoTensor] reconfig ColoInitContext, decouple default_pg and default_dist_spec. (#1953 )	2 years ago
zbian	598d456d0e	fixed logger	2 years ago
zbian	6877121377	updated flash attention api	2 years ago
YuliangLiu0306	36c0f3ea5b	[autoparallel] remove redundancy comm node (#1893 )	2 years ago
binmakeswell	9183e0dec5	[tutorial] polish all README (#1946 )	2 years ago
Frank Lee	de56b563b9	[tutorial] added missing dummy dataloader (#1944 )	2 years ago
Frank Lee	c6ea65011f	[tutorial] fixed pipeline bug for sequence parallel (#1943 )	2 years ago
アマデウス	e52f9d9109	[tensorparallel] fixed tp layers (#1938 )	2 years ago
Jiarui Fang	cf68cc92ac	[example] add vit (#1942 ) * [ColoTensor] ColoInitContext initialize parameters in shard mode. * polish * [example] add vit	2 years ago
YuliangLiu0306	c7925c5d08	[sc demo] add requirements to spmd README (#1941 )	2 years ago
Boyuan Yao	d5f5e06d82	[SC] remove redundant hands on (#1939 ) * [sc] SC tutorial for auto checkpoint * [sc] polish examples * [sc] polish readme * [sc] polish readme and help information * [sc] polish readme and help information * [sc] modify auto checkpoint benchmark * [sc] remove imgs * [sc] remove redundant handson	2 years ago
Jiarui Fang	9f4fb3f28a	[ColoTensor] ColoInitContext initialize parameters in shard mode. (#1937 )	2 years ago
ver217	b42b672842	[release] update version (#1931 )	2 years ago
binmakeswell	41868f7605	[tutorial] polish README and OPT files (#1930 ) * [tutorial] polish README and OPT files * [tutorial] polish README and OPT files * [tutorial] polish README and OPT files	2 years ago
ver217	b0b7a786b7	[tutorial] add synthetic dataset for opt (#1924 )	2 years ago
Frank Lee	0486048453	[tutorial] updated hybrid parallel readme (#1928 ) * [tutorial] updated hybrid parallel readme * polish code	2 years ago
Frank Lee	807cbdb87d	[tutorial] added synthetic data for sequence parallel (#1927 ) * [tutorial] added synthetic data for sequence parallel * polish code	2 years ago
Frank Lee	abf4c27f6a	[tutorial] removed huggingface model warning (#1925 )	2 years ago
Frank Lee	d43a671ad6	Hotfix/tutorial readme index (#1922 ) * [tutorial] removed tutorial index in readme * [tutorial] removed tutorial index in readme	2 years ago
Boyuan Yao	24cbee0ebe	[tutorial] modify hands-on of auto activation checkpoint (#1920 ) * [sc] SC tutorial for auto checkpoint * [sc] polish examples * [sc] polish readme * [sc] polish readme and help information * [sc] polish readme and help information * [sc] modify auto checkpoint benchmark * [sc] remove imgs	2 years ago
Frank Lee	ff16773ded	[tutorial] added synthetic data for hybrid parallel (#1921 ) * [tutorial] added synthetic data for hybrid parallel * polish code	2 years ago
Frank Lee	3c42fdbedc	[tutorial] added synthetic data for hybrid parallel (#1919 )	2 years ago
Frank Lee	1b0dd05940	[tutorial] added synthetic dataset for auto parallel demo (#1918 )	2 years ago
Frank Lee	acd9abc5ca	[tutorial] updated auto parallel demo with latest data path (#1917 )	2 years ago
Frank Lee	d53415bc10	[tutorial] added data script and updated readme (#1916 )	2 years ago
binmakeswell	155e202318	[example] update auto_parallel img path (#1910 )	2 years ago
Boyuan Yao	d5c5bc219e	[SC] add GPT example for auto checkpoint (#1889 ) * [sc] SC tutorial for auto checkpoint * [sc] polish examples * [sc] polish readme * [sc] polish readme and help information * [sc] polish readme and help information	2 years ago
binmakeswell	11ee8ae478	[tutorial] add cifar10 for diffusion (#1907 )	2 years ago
Junming Wu	14a0b18305	[NFC] polish colossalai/amp/naive_amp/__init__.py code style (#1905 )	2 years ago
binmakeswell	c13c22c481	[doc] add news (#1901 )	2 years ago
Frank Lee	cb7ec714c8	[tutorial] removed duplicated tutorials (#1904 )	2 years ago
Fazzie-Maqianli	351f0f64e6	[example] add cifar10 dadaset for diffusion (#1902 ) * add cifar10 dadasets * Update README.md Co-authored-by: binmakeswell <binmakeswell@gmail.com>	2 years ago
BoxiangW	ca6e75bc28	[tutorial] edited hands-on practices (#1899 ) * Add handson to ColossalAI. * Change names of handsons and edit sequence parallel example. * Edit wrong folder name * resolve conflict * delete readme	2 years ago
BoxiangW	d9bf83e084	Add handson to ColossalAI. (#1896 ) Co-authored-by: Boxiang Wang <boxiang.wang1@gmail.com>	2 years ago
wozeparrot	0ef8154bfa	Delete .DS_Store (#1894 )	2 years ago
github-actions[bot]	abadd6e8f7	Automated submodule synchronization (#1797 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
HELSON	6e51d296f0	[zero] migrate zero1&2 (#1878 ) * add zero1&2 optimizer * rename test ditectory * rename test files * change tolerance in test	2 years ago
Super Daniel	cc55ff0aa4	[autoparallel] user-friendly API for CheckpointSolver. (#1879 ) Merge for SC tutorial	2 years ago
Super Daniel	448248b27c	[fx] metainfo_trace as an API. (#1873 ) * [fx] metainfo_trace as an API. * [fx] add return.	2 years ago

1 2 3 4 5 ...

1355 Commits (7e24b9b9ee4ad812da8280d351acfd23e4317574) All Branches Search

1355 Commits (7e24b9b9ee4ad812da8280d351acfd23e4317574)

All Branches