1404 Commits (31c644027ba1991d660933dbc4a100eda4f334fe)

 

All Branches   

Search

Author	SHA1	Message	Date
Boyuan Yao	7c7921f71b	[autoparallel] add torch.nn.ReLU metainfo (#1868) ... * [fx] metainfo class for auto parallel * [fx] add unit test for linear metainfo * [fx] fix bwd param for linear * [fx] modify unit test * [fx] modify unit test * [fx] modify import * [fx] modify import * [fx] modify import * [fx] move meta profiler to auto parallel * [fx] add conv metainfo class * [fx] restore profiler * [fx] restore meta profiler * [autoparallel] modify unit test * [fx] modify unit test * [autoparallel] add batchnorm metainfo class * [autoparallel] fix batchnorm unit test function declaration * [fx] restore profiler * [fx] add relu metainfo class * [fx] restore profiler * [autoparallel] modify metainfo input	2 years ago
Jiarui Fang	8c66a1d0aa	[polish] remove useless file _mem_tracer_hook.py (#1963)	2 years ago
Jiarui Fang	c4739a725a	[Gemini] polish memstats collector (#1962)	2 years ago
YuliangLiu0306	fea3cb661c	[autoparallel] support addmm in tracer and solver (#1961) ... * [fx] patch addmm * [autoparallel] support addmm in tracer and solver	2 years ago
Jiarui Fang	f7e276fa71	[Gemini] add GeminiAdamOptimizer (#1960)	2 years ago
HELSON	7066dfbf82	[zero] fix memory leak for zero2 (#1955)	2 years ago
Jiarui Fang	60abd86d6a	[example] enhance GPT demo (#1959) ... * [example] enhence GPT demo * Update README.md Co-authored-by: binmakeswell <binmakeswell@gmail.com>	2 years ago
Fazzie-Maqianli	acba142929	Merge pull request #1958 from Fazziekey/lightning ... update model download in README	2 years ago
Fazzie	a09f88ab07	update model download in README	2 years ago
Fazzie-Maqianli	6bdd0a90ca	update lightning version (#1954)	2 years ago
Jiarui Fang	52c6ad26e0	[ColoTensor] reconfig ColoInitContext, decouple default_pg and default_dist_spec. (#1953)	2 years ago
zbian	598d456d0e	fixed logger	2 years ago
zbian	6877121377	updated flash attention api	2 years ago
YuliangLiu0306	36c0f3ea5b	[autoparallel] remove redundancy comm node (#1893)	2 years ago
binmakeswell	9183e0dec5	[tutorial] polish all README (#1946)	2 years ago
Frank Lee	de56b563b9	[tutorial] added missing dummy dataloader (#1944)	2 years ago
Frank Lee	c6ea65011f	[tutorial] fixed pipeline bug for sequence parallel (#1943)	2 years ago
アマデウス	e52f9d9109	[tensorparallel] fixed tp layers (#1938)	2 years ago
Jiarui Fang	cf68cc92ac	[example] add vit (#1942) ... * [ColoTensor] ColoInitContext initialize parameters in shard mode. * polish * [example] add vit	2 years ago
YuliangLiu0306	c7925c5d08	[sc demo] add requirements to spmd README (#1941)	2 years ago
Boyuan Yao	d5f5e06d82	[SC] remove redundant hands on (#1939) ... * [sc] SC tutorial for auto checkpoint * [sc] polish examples * [sc] polish readme * [sc] polish readme and help information * [sc] polish readme and help information * [sc] modify auto checkpoint benchmark * [sc] remove imgs * [sc] remove redundant handson	2 years ago
Jiarui Fang	9f4fb3f28a	[ColoTensor] ColoInitContext initialize parameters in shard mode. (#1937)	2 years ago
ver217	b42b672842	[release] update version (#1931)	2 years ago
binmakeswell	41868f7605	[tutorial] polish README and OPT files (#1930) ... * [tutorial] polish README and OPT files * [tutorial] polish README and OPT files * [tutorial] polish README and OPT files	2 years ago
ver217	b0b7a786b7	[tutorial] add synthetic dataset for opt (#1924)	2 years ago
Frank Lee	0486048453	[tutorial] updated hybrid parallel readme (#1928) ... * [tutorial] updated hybrid parallel readme * polish code	2 years ago
Frank Lee	807cbdb87d	[tutorial] added synthetic data for sequence parallel (#1927) ... * [tutorial] added synthetic data for sequence parallel * polish code	2 years ago
Frank Lee	abf4c27f6a	[tutorial] removed huggingface model warning (#1925)	2 years ago
Frank Lee	d43a671ad6	Hotfix/tutorial readme index (#1922) ... * [tutorial] removed tutorial index in readme * [tutorial] removed tutorial index in readme	2 years ago
Boyuan Yao	24cbee0ebe	[tutorial] modify hands-on of auto activation checkpoint (#1920) ... * [sc] SC tutorial for auto checkpoint * [sc] polish examples * [sc] polish readme * [sc] polish readme and help information * [sc] polish readme and help information * [sc] modify auto checkpoint benchmark * [sc] remove imgs	2 years ago
Frank Lee	ff16773ded	[tutorial] added synthetic data for hybrid parallel (#1921) ... * [tutorial] added synthetic data for hybrid parallel * polish code	2 years ago
Frank Lee	3c42fdbedc	[tutorial] added synthetic data for hybrid parallel (#1919)	2 years ago
Frank Lee	1b0dd05940	[tutorial] added synthetic dataset for auto parallel demo (#1918)	2 years ago
Frank Lee	acd9abc5ca	[tutorial] updated auto parallel demo with latest data path (#1917)	2 years ago
Frank Lee	d53415bc10	[tutorial] added data script and updated readme (#1916)	2 years ago
binmakeswell	155e202318	[example] update auto_parallel img path (#1910)	2 years ago
Boyuan Yao	d5c5bc219e	[SC] add GPT example for auto checkpoint (#1889) ... * [sc] SC tutorial for auto checkpoint * [sc] polish examples * [sc] polish readme * [sc] polish readme and help information * [sc] polish readme and help information	2 years ago
binmakeswell	11ee8ae478	[tutorial] add cifar10 for diffusion (#1907)	2 years ago
Junming Wu	14a0b18305	[NFC] polish colossalai/amp/naive_amp/__init__.py code style (#1905)	2 years ago
binmakeswell	c13c22c481	[doc] add news (#1901)	2 years ago
Frank Lee	cb7ec714c8	[tutorial] removed duplicated tutorials (#1904)	2 years ago
Fazzie-Maqianli	351f0f64e6	[example] add cifar10 dadaset for diffusion (#1902) ... * add cifar10 dadasets * Update README.md Co-authored-by: binmakeswell <binmakeswell@gmail.com>	2 years ago
BoxiangW	ca6e75bc28	[tutorial] edited hands-on practices (#1899) ... * Add handson to ColossalAI. * Change names of handsons and edit sequence parallel example. * Edit wrong folder name * resolve conflict * delete readme	2 years ago
BoxiangW	d9bf83e084	Add handson to ColossalAI. (#1896) ... Co-authored-by: Boxiang Wang <boxiang.wang1@gmail.com>	2 years ago
wozeparrot	0ef8154bfa	Delete .DS_Store (#1894)	2 years ago
github-actions[bot]	abadd6e8f7	Automated submodule synchronization (#1797) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
HELSON	6e51d296f0	[zero] migrate zero1&2 (#1878) ... * add zero1&2 optimizer * rename test ditectory * rename test files * change tolerance in test	2 years ago
Super Daniel	cc55ff0aa4	[autoparallel] user-friendly API for CheckpointSolver. (#1879) ... Merge for SC tutorial	2 years ago
Super Daniel	448248b27c	[fx] metainfo_trace as an API. (#1873) ... * [fx] metainfo_trace as an API. * [fx] add return.	2 years ago
Super Daniel	6d559ea614	[sc] add examples for auto checkpoint. (#1880)	2 years ago