Commit Graph

1358 Commits (6630d455467d7bec41b1d8d83e6839f52f39842a)

Author SHA1 Message Date
HELSON 6e51d296f0
[zero] migrate zero1&2 (#1878)
* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test
2022-11-11 09:26:40 +08:00
Super Daniel cc55ff0aa4
[autoparallel] user-friendly API for CheckpointSolver. (#1879)
Merge for SC tutorial
2022-11-10 20:59:28 +08:00
Super Daniel 448248b27c
[fx] metainfo_trace as an API. (#1873)
* [fx] metainfo_trace as an API.

* [fx] add return.
2022-11-10 20:58:37 +08:00
Super Daniel 6d559ea614
[sc] add examples for auto checkpoint. (#1880) 2022-11-10 20:50:15 +08:00
Jiarui Fang 51597f6a28
[hotfix] pass test_complete_workflow (#1877) 2022-11-10 17:53:39 +08:00
Jiarui Fang 986f8cbaa7
[inference] overlap comm and compute in Linear1D_Row when stream_chunk_num > 1 (#1876) 2022-11-10 17:36:42 +08:00
YuliangLiu0306 1b494ad73c
[autoparallel] fix linear logical convert issue (#1857) 2022-11-10 17:19:22 +08:00
Jiarui Fang c2947dadf1
[inference] streaming Linear 1D Row inference (#1874) 2022-11-10 17:03:21 +08:00
xcnick a141681260
[amp] add torch amp test (#1860) 2022-11-10 16:40:26 +08:00
HELSON f9e7d179f2
[diffusion] fix package conflicts (#1875) 2022-11-10 16:33:34 +08:00
binmakeswell 610dda676c
[example] migrate diffusion and auto_parallel hands-on (#1871) 2022-11-10 15:31:46 +08:00
Frank Lee e6ec99d389
[utils] fixed lazy init context (#1867) 2022-11-10 15:17:20 +08:00
binmakeswell 50c4cb0167
[NFC] remove redundant dependency (#1869)
* remove redundant config

* remove redundant dependency
2022-11-10 14:51:47 +08:00
binmakeswell fd8f0ca5a8
[example] initialize tutorial (#1865) 2022-11-10 14:05:27 +08:00
yuxuan-lou cc27adceb0
[NFC] polish .github/workflows/scripts/build_colossalai_wheel.py code style (#1856) 2022-11-09 16:54:09 +08:00
zbian 653b0a620e added skip_bias_add for non-tp linear 2022-11-09 15:41:08 +08:00
Ofey Chan e5b1a0c9be
[NFC] polish .github/workflows/scripts/generate_release_draft.py code style (#1855) 2022-11-09 15:28:33 +08:00
Kai Wang (Victor Kai) a3b1d07ca4
[NFC] polish workflows code style (#1854) 2022-11-09 14:50:09 +08:00
LuGY 94329fc139
[NFC] polish colossalai/amp/apex_amp/__init__.py code style (#1853) 2022-11-09 14:49:42 +08:00
nuszzh 32c8a03389
[NFC] polish .readthedocs.yaml code style (#1852)
Co-authored-by: superhao1995 <804673818@qq.com>
2022-11-09 14:49:16 +08:00
RichardoLuo 81a642fe8d
[NFC] polish <.github/workflows/release_nightly.yml> code style (#1851)
Co-authored-by: RichardoLuo <14049555596@qq.com>
2022-11-09 14:48:53 +08:00
zbian 1559a09fb7 [NFC] polish amp.naive_amp.grad_scaler code style 2022-11-09 13:38:15 +08:00
binmakeswell e9635eb493 add explanation specified version 2022-11-09 12:13:01 +08:00
HELSON 72c9448920 [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py code style (#1845) 2022-11-09 12:08:47 +08:00
Genghan Zhang b25030cc07 [NFC] polish ./colossalai/amp/torch_amp/__init__.py code style (#1836) 2022-11-09 12:08:47 +08:00
xyupeng b0a138aa22 [NFC] polish .github/workflows/build.yml code style (#1837) 2022-11-09 12:08:47 +08:00
Sze-qq 95ac4f88ea [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py code style (#1829)
Co-authored-by: siqi <siqi@siqis-MacBook-Pro.local>
2022-11-09 12:08:47 +08:00
Ziyue Jiang 5da03c936d [NFC] polish colossalai/amp/torch_amp/_grad_scaler.py code style (#1823)
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2022-11-09 12:08:47 +08:00
Maruyama_Aya 90833b45dd [NFC] polish .github/workflows/release_docker.yml code style 2022-11-09 12:08:47 +08:00
shenggan b0706fbb00 [NFC] polish .github/workflows/submodule.yml code style (#1822) 2022-11-09 12:08:47 +08:00
Arsmart1 fc8d8b1b9c [NFC] polish .github/workflows/draft_github_release_post.yml code style (#1820) 2022-11-09 12:08:47 +08:00
Fazzie-Maqianli 399f84d8f6 [NFC] polish colossalai/amp/naive_amp/_fp16_optimizer.py code style (#1819) 2022-11-09 12:08:47 +08:00
CsRic 9623ec1b02 [NFC] polish colossalai/amp/naive_amp/_utils.py code style (#1816)
* [NFC] polish colossalai/nn/metric/accuracy_2p5d.py code style (#1714)

* [NFC] polish colossalai/zero/sharded_param/__init__.py code style

* [NFC] polish colossalai/amp/naive_amp/_utils.py code style

Co-authored-by: shenggan <csg19971016@gmail.com>
Co-authored-by: ric <mkkt_bkkt@mail.ustc.edu.cn>
2022-11-09 12:08:47 +08:00
Zangwei Zheng 25993db98a [NFC] polish .github/workflows/build_gpu_8.yml code style (#1813) 2022-11-09 12:08:47 +08:00
Zirui Zhu 244fa3108a [NFC] polish MANIFEST.in code style (#1814) 2022-11-09 12:08:47 +08:00
binmakeswell 3c3714fc2a [NFC] polish strategies_constructor.py code style (#1806) 2022-11-09 12:08:47 +08:00
Jiarui Fang 3ce4463fe6
[utils] remove lazy_memory_allocate from ColoInitContext (#1844) 2022-11-09 11:50:33 +08:00
Fazzie-Maqianli fabed0df3b
Merge pull request #1842 from feifeibear/jiarui/polish
[example] polish diffusion readme
2022-11-09 09:49:18 +08:00
jiaruifang 27211d6267 [example] polish diffusion readme 2022-11-09 09:38:05 +08:00
jiaruifang cddb4b6f6f Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into main 2022-11-09 09:27:45 +08:00
binmakeswell 4ac7d3ec3b
[doc] polish diffusion README (#1840) 2022-11-08 22:36:55 +08:00
binmakeswell 9d3124ac8b
[doc] remove obsolete API demo (#1833) 2022-11-08 18:00:49 +08:00
Jiarui Fang fba34efb5a
version to 0.1.11rc2 (#1832) 2022-11-08 17:25:15 +08:00
jiaruifang 267b55f0a6 version to 0.1.11rc2 2022-11-08 17:24:02 +08:00
Jiarui Fang 8a6d28b6c2
[example] remove useless readme in diffusion (#1831)
* [NFC] update gitignore remove DS_Store

* [version] upgrade the version to 0.1.11rc2
2022-11-08 17:22:32 +08:00
Jiarui Fang f86a703bcf
[NFC] update gitignore remove DS_Store (#1830) 2022-11-08 17:18:15 +08:00
Jiarui Fang a25f755331
[example] add TP to GPT example (#1828) 2022-11-08 17:17:19 +08:00
YuliangLiu0306 49216d7ab1
[autoparallel] fix bugs caused by negative dim key (#1808)
* [autoparallel] fix bugs caused by negative dim key

* fix import error

* fix matmul test issue

* fix unit test issue
2022-11-08 17:03:50 +08:00
アマデウス 4268ae017b
[kernel] added jit warmup (#1792) 2022-11-08 16:22:23 +08:00
binmakeswell 76e64cb67c
[doc] add diffusion (#1827) 2022-11-08 16:21:54 +08:00