Commit Graph

1644 Commits (7a58dc5ad244f68d162e34a269a4a7c96f9896ab)
 

Author SHA1 Message Date
Jiarui Fang 52c6ad26e0
[ColoTensor] reconfig ColoInitContext, decouple default_pg and default_dist_spec. (#1953)
2 years ago
zbian 598d456d0e fixed logger
2 years ago
zbian 6877121377 updated flash attention api
2 years ago
YuliangLiu0306 36c0f3ea5b
[autoparallel] remove redundancy comm node (#1893)
2 years ago
binmakeswell 9183e0dec5
[tutorial] polish all README (#1946)
2 years ago
Frank Lee de56b563b9
[tutorial] added missing dummy dataloader (#1944)
2 years ago
Frank Lee c6ea65011f
[tutorial] fixed pipeline bug for sequence parallel (#1943)
2 years ago
アマデウス e52f9d9109
[tensorparallel] fixed tp layers (#1938)
2 years ago
Jiarui Fang cf68cc92ac
[example] add vit (#1942)
2 years ago
YuliangLiu0306 c7925c5d08
[sc demo] add requirements to spmd README (#1941)
2 years ago
Boyuan Yao d5f5e06d82
[SC] remove redundant hands on (#1939)
2 years ago
Jiarui Fang 9f4fb3f28a
[ColoTensor] ColoInitContext initialize parameters in shard mode. (#1937)
2 years ago
ver217 b42b672842
[release] update version (#1931)
2 years ago
binmakeswell 41868f7605
[tutorial] polish README and OPT files (#1930)
2 years ago
ver217 b0b7a786b7
[tutorial] add synthetic dataset for opt (#1924)
2 years ago
Frank Lee 0486048453
[tutorial] updated hybrid parallel readme (#1928)
2 years ago
Frank Lee 807cbdb87d
[tutorial] added synthetic data for sequence parallel (#1927)
2 years ago
Frank Lee abf4c27f6a
[tutorial] removed huggingface model warning (#1925)
2 years ago
Frank Lee d43a671ad6
Hotfix/tutorial readme index (#1922)
2 years ago
Boyuan Yao 24cbee0ebe
[tutorial] modify hands-on of auto activation checkpoint (#1920)
2 years ago
Frank Lee ff16773ded
[tutorial] added synthetic data for hybrid parallel (#1921)
2 years ago
Frank Lee 3c42fdbedc
[tutorial] added synthetic data for hybrid parallel (#1919)
2 years ago
Frank Lee 1b0dd05940
[tutorial] added synthetic dataset for auto parallel demo (#1918)
2 years ago
Frank Lee acd9abc5ca
[tutorial] updated auto parallel demo with latest data path (#1917)
2 years ago
Frank Lee d53415bc10
[tutorial] added data script and updated readme (#1916)
2 years ago
binmakeswell 155e202318
[example] update auto_parallel img path (#1910)
2 years ago
Boyuan Yao d5c5bc219e
[SC] add GPT example for auto checkpoint (#1889)
2 years ago
binmakeswell 11ee8ae478
[tutorial] add cifar10 for diffusion (#1907)
2 years ago
Junming Wu 14a0b18305
[NFC] polish colossalai/amp/naive_amp/__init__.py code style (#1905)
2 years ago
binmakeswell c13c22c481
[doc] add news (#1901)
2 years ago
Frank Lee cb7ec714c8
[tutorial] removed duplicated tutorials (#1904)
2 years ago
Fazzie-Maqianli 351f0f64e6
[example] add cifar10 dadaset for diffusion (#1902)
2 years ago
BoxiangW ca6e75bc28
[tutorial] edited hands-on practices (#1899)
2 years ago
BoxiangW d9bf83e084
Add handson to ColossalAI. (#1896)
2 years ago
wozeparrot 0ef8154bfa
Delete .DS_Store (#1894)
2 years ago
github-actions[bot] abadd6e8f7
Automated submodule synchronization (#1797)
2 years ago
HELSON 6e51d296f0
[zero] migrate zero1&2 (#1878)
2 years ago
Super Daniel cc55ff0aa4
[autoparallel] user-friendly API for CheckpointSolver. (#1879)
2 years ago
Super Daniel 448248b27c
[fx] metainfo_trace as an API. (#1873)
2 years ago
Super Daniel 6d559ea614
[sc] add examples for auto checkpoint. (#1880)
2 years ago
Jiarui Fang 51597f6a28
[hotfix] pass test_complete_workflow (#1877)
2 years ago
Jiarui Fang 986f8cbaa7
[inference] overlap comm and compute in Linear1D_Row when stream_chunk_num > 1 (#1876)
2 years ago
YuliangLiu0306 1b494ad73c
[autoparallel] fix linear logical convert issue (#1857)
2 years ago
Jiarui Fang c2947dadf1
[inference] streaming Linear 1D Row inference (#1874)
2 years ago
xcnick a141681260
[amp] add torch amp test (#1860)
2 years ago
HELSON f9e7d179f2
[diffusion] fix package conflicts (#1875)
2 years ago
binmakeswell 610dda676c
[example] migrate diffusion and auto_parallel hands-on (#1871)
2 years ago
Frank Lee e6ec99d389
[utils] fixed lazy init context (#1867)
2 years ago
binmakeswell 50c4cb0167
[NFC] remove redundant dependency (#1869)
2 years ago
binmakeswell fd8f0ca5a8
[example] initialize tutorial (#1865)
2 years ago