1537 Commits (31fe84237b22d183a7de9db153f3b6fb739732f6)
 

Author SHA1 Message Date
Jiarui Fang 2cfe685b9f
[exmaple] add vit missing functions (#2154) 2 years ago
HELSON a7d95b7024
[example] add zero1, zero2 example in GPT examples (#2146) 2 years ago
YuliangLiu0306 1cce6e36ca
[autoparallel] use metainfo in handler (#2149) 2 years ago
Jiarui Fang 9b39170a5c
[version] 0.1.13 (#2152) 2 years ago
Jiarui Fang e0c01d1db1
Revert "[version] version to v0.1.13 (#2139)" (#2153) 2 years ago
Jiarui Fang 2827f41898
[Gemini] GeminiDPP convert to PyTorch Module. (#2151) 2 years ago
Jiarui Fang bdef9dfdbe
[NFC] remove useless graph node code (#2150) 2 years ago
BlueRum b3f73ce1c8
[Gemini] Update coloinit_ctx to support meta_tensor (#2147) 2 years ago
Jiarui Fang 6ad866b684
[version] version to v0.1.13 (#2139) 2 years ago
Zihao a128eec9d5
register aten._convolution.default (#2137) 2 years ago
Jiarui Fang ee287620f0
[Gemini] revert ZeROInitCtx related tracer (#2138) 2 years ago
アマデウス 077a66dd81
updated attention kernel (#2133) 2 years ago
github-actions[bot] 484fe62252
Automated submodule synchronization (#2131) 2 years ago
YuliangLiu0306 a3c6924deb
[autoparallel] process size nodes in runtime pass (#2130) 2 years ago
YuliangLiu0306 536560ccc0
[autoparallel] implement softmax handler (#2132) 2 years ago
Jiarui Fang c89c66a858
[Gemini] update API of the chunkmemstatscollector. (#2129) 2 years ago
Jiarui Fang 2938edf446
[Gemini] update the non model data record method in runtime memory tracer (#2128) 2 years ago
Jiarui Fang deee317b0f
[Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127) 2 years ago
Jiarui Fang 8fac837679
[Gemini] update non model data calculation method (#2126) 2 years ago
Fazzie-Maqianli 6c4c6a0409
Merge pull request #2120 from Fazziekey/example/stablediffusion-v2 2 years ago
Fazzie cea4292ae5 support stable diffusion v2 2 years ago
Jiarui Fang 5efda69735
[Gemini] hotfix the unittest bugs (#2125) 2 years ago
Jiarui Fang 05bb28aacf
[Gemini] mapping of preop timestep and param (#2124) 2 years ago
github-actions[bot] 764bc16f3e
Automated submodule synchronization (#2123) 2 years ago
YuliangLiu0306 cd0af9f7f6
[autoparallel] gpt2lp runtimee test (#2113) 2 years ago
Jiarui Fang 9214d1fe28
[Gemini] chunk init using runtime visited param order (#2115) 2 years ago
HELSON e7d3afc9cc
[optimizer] add div_scale for optimizers (#2117) 2 years ago
Jiarui Fang e5aa8333e4
[NFC] update chunk manager API (#2119) 2 years ago
Jiarui Fang e99edfcb51
[NFC] polish comments for Chunk class (#2116) 2 years ago
Ziyue Jiang 09d69e1c25
[PP Middleware] Add bwd and step for PP middleware (#2111) 2 years ago
Jiarui Fang 8afc001f4f
[Gemini] chunk init use OrderedParamGenerator (#2110) 2 years ago
HELSON 63fbba3c19
[zero] add L2 gradient clipping for ZeRO (#2112) 2 years ago
Jiarui Fang 70a8556946
[gemini] get the param visited order during runtime (#2108) 2 years ago
Jiarui Fang 61f31c3cf0
[Gemini] NFC, polish search_chunk_configuration (#2107) 2 years ago
Jiarui Fang 8e14344ec9
[hotfix] fix a type in ColoInitContext (#2106) 2 years ago
Jiarui Fang 05545bfee9
[ColoTensor] throw error when ColoInitContext meets meta parameter. (#2105) 2 years ago
YuliangLiu0306 d87baa85d9
[autoparallel] support linear function bias addition (#2104) 2 years ago
Jiarui Fang 6a71d3a0d9
[version] 0.1.11rc5 -> 0.1.12 (#2103) 2 years ago
YuliangLiu0306 0fecbb9e20
[autoparallel] support addbmm computation (#2102) 2 years ago
YuliangLiu0306 d3d4630495
[autoparallel] add sum handler (#2101) 2 years ago
Ziyue Jiang e4705ba4e2
[Pipeline Middleware] fix data race in Pipeline Scheduler for DAG (#2087) 2 years ago
YuliangLiu0306 b175e6d58e
[autoparallel] add bias addtion function class (#2098) 2 years ago
YuliangLiu0306 3af7e65dea
[autoparallel] complete gpt related module search (#2097) 2 years ago
Jiarui Fang 85efb7ac2e
[Gemini] gemini use the runtime memory tracer (RMT) (#2099) 2 years ago
Super Daniel 2bf2d1cd3b
[fx] An experimental version of ColoTracer.' (#2002) 2 years ago
Jiarui Fang 4b055351b0
[Gemini] make RuntimeMemTracer work correctly (#2096) 2 years ago
ZijianYY fa9d1aea71
[example] update GPT README (#2095) 2 years ago
Jiarui Fang 978242326a
[Gemini] remove eval in gemini unittests! (#2092) 2 years ago
YuliangLiu0306 7f72eb0510
[autoparallel]add embedding handler (#2089) 2 years ago
Jiarui Fang 1fca5d79ea
[Gemini] remove GLOBAL_MODEL_DATA_TRACER (#2091) 2 years ago