Commit Graph

  • 4967ff1124 Merge branch 'feature/layer_spec' of github.com:YuliangLiu0306/ColossalAI into feature/layer_spec YuliangLiu0306 2022-04-23 13:49:44 +0800
  • 89bbacb819
    Merge branch 'hpcaitech:main' into feature/layer_spec YuliangLiu0306 2022-04-23 13:49:25 +0800
  • 997c625020
    Merge branch 'hpcaitech:main' into main YuliangLiu0306 2022-04-23 13:49:11 +0800
  • 9e4cb76a23 [pipeline]add to_layer_list and partition method to support arbitrary non-pp model YuliangLiu0306 2022-04-23 13:47:50 +0800
  • 889e7d8896 polish code ver217 2022-04-22 20:25:15 +0800
  • a818bb14ef remove redundant codes ver217 2022-04-22 20:20:05 +0800
  • 409bdc366b refactor folder structure ver217 2022-04-22 20:17:28 +0800
  • 82a785fdc3 polish Wesley 2022-04-22 19:25:32 +0800
  • f9aa1c099d add a subclass of torch.profiler.profile ver217 2022-04-22 19:07:30 +0800
  • 7029e9cade fix unit test Wesley 2022-04-22 18:57:50 +0800
  • 8789850eea
    Init Conext supports lazy allocate model memory (#842) Jiarui Fang 2022-04-22 18:03:35 +0800
  • 34ff8773e6 Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into coloctx jiaruifang 2022-04-22 17:24:41 +0800
  • 91b7acf5c5 merge from main Wesley 2022-04-22 17:22:29 +0800
  • 135310f06d Add 1D row Wesley 2022-04-22 17:21:28 +0800
  • f721e8f110 a context replacing torch param to ColoTensor. Support lazy init memroy jiaruifang 2022-04-22 17:19:50 +0800
  • 4575a3298b
    [hotfix] ColoTensor pin_memory (#840) Jiarui Fang 2022-04-22 17:07:46 +0800
  • f202de0f9d hotfix tensor pin memory bug jiaruifang 2022-04-22 17:02:42 +0800
  • 9f6f656952
    [setup] use env var instead of option for cuda ext (#839) Frank Lee 2022-04-22 15:44:56 +0800
  • b9669b291b [setup] use env var instead of option for cuda ext FrankLeeeee 2022-04-22 15:41:54 +0800
  • 943982d29a
    [unittest] refactored unit tests for change in dependency (#838) Frank Lee 2022-04-22 15:39:07 +0800
  • c671a6460c [unittest] refactored unit tests for change in dependency FrankLeeeee 2022-04-22 15:29:45 +0800
  • d0b833a696 add model data profiler ver217 2022-04-22 15:29:10 +0800
  • 26fa5554b5 Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into main jiaruifang 2022-04-22 15:29:00 +0800
  • f271f34716
    Automated submodule synchronization (#827) github-actions[bot] 2022-04-22 15:24:58 +0800
  • 01e9f834f5
    [dependency] removed torchvision (#833) Frank Lee 2022-04-22 15:24:35 +0800
  • 64c2f42ff3 fixed transforms FrankLeeeee 2022-04-22 14:48:49 +0800
  • cb5a4778e1
    Revert "[WIP] Applying ColoTensor on TP-1D-row Linear. (#831)" (#835) Jiarui Fang 2022-04-22 14:45:57 +0800
  • 6db0b548ef Revert "[WIP] Applying ColoTensor on TP-1D-row Linear. (#831)" Jiarui Fang 2022-04-22 14:45:03 +0800
  • 5e00e6cf23
    [setup] allow installation with python 3.6 (#834) Frank Lee 2022-04-22 14:17:51 +0800
  • 0fcf85c129 [setup] allow installation with python 3.6 FrankLeeeee 2022-04-22 14:06:04 +0800
  • ac88de6dfc
    [WIP] Applying ColoTensor on TP-1D-row Linear. (#831) Jiarui Fang 2022-04-22 14:03:26 +0800
  • d345114c38 [dependency] removed torchvision FrankLeeeee 2022-04-22 14:01:18 +0800
  • bc664c79e7 [tensor] init row 1d linear jiaruifang 2022-04-22 13:32:02 +0800
  • 595bedf767
    revert zero tensors back (#829) Jiarui Fang 2022-04-22 12:12:35 +0800
  • c69ed4b274 revert zero tensors back jiaruifang 2022-04-22 12:10:46 +0800
  • 294a6060d0
    [tensor] ZeRO use ColoTensor as the base class. (#828) Jiarui Fang 2022-04-22 12:00:48 +0800
  • 7d469ec2b6 polish jiaruifang 2022-04-22 11:08:06 +0800
  • d3948fd6cc Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into tensor/zero jiaruifang 2022-04-22 11:03:57 +0800
  • ade1d77d11 [tensor] ZeRO use ColoTensor as the base class. jiaruifang 2022-04-22 10:58:57 +0800
  • 4a52ee7893 Automated submodule synchronization github-actions 2022-04-22 00:01:31 +0000
  • 820ccb9d95
    Merge 21f7bc7d73 into 8e6fdb4f29 Jie Zhu 2022-04-21 21:05:14 +0800
  • 8e6fdb4f29
    [tensor]fix test_linear (#826) Ziyue Jiang 2022-04-21 17:18:56 +0800
  • d12986df89 remove UNIT Wesley 2022-04-21 17:17:57 +0800
  • f34134313f check all ops Wesley 2022-04-21 17:11:58 +0800
  • 99ae2dd9cc fix test_linear() Wesley 2022-04-21 17:03:22 +0800
  • 1a2dd2a600 Merge branch 'main' of github.com:hpcaitech/ColossalAI into feature/ColoTensor_TP1D Wesley 2022-04-21 16:51:01 +0800
  • 1a9e2c2dff
    [tensor] fix kwargs in colo_tensor torch_funtion (#825) Ziyue Jiang 2022-04-21 16:47:35 +0800
  • 341bc411de Merge branch 'main' of github.com:hpcaitech/ColossalAI into feature/ColoTensor_TP1D Wesley 2022-04-21 16:44:46 +0800
  • d3148d40e1 fix kwargs in colo_tensor torch_funtion Wesley 2022-04-21 16:44:38 +0800
  • eb1b89908c
    [refactor] moving InsertPostInitMethodToModuleSubClasses to utils. (#824) Jiarui Fang 2022-04-21 16:03:18 +0800
  • 49ce815f21 [refactor] moving InsertPostInitMethodToModuleSubClasses to utils. jiaruifang 2022-04-21 15:55:50 +0800
  • 2ecc3d7a55
    [tensor] lazy init (#823) Jiarui Fang 2022-04-21 15:40:23 +0800
  • 7ff64430f1 polish jiaruifang 2022-04-21 15:35:03 +0800
  • 6c78303544 polish jiaruifang 2022-04-21 15:26:09 +0800
  • fd7f109dbe polish jiaruifang 2022-04-21 15:21:57 +0800
  • 4129e4bef0 Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into tensor/lazy_init jiaruifang 2022-04-21 15:20:26 +0800
  • 20c1728991 ColoTensor lazy init jiaruifang 2022-04-21 15:19:05 +0800
  • 68dcd51d41
    [Tensor] update ColoTensor torch_function (#822) Jiarui Fang 2022-04-21 14:25:27 +0800
  • 72164b0153 polish jiaruifang 2022-04-21 14:21:58 +0800
  • 660d2d1f1b
    [Tensor] apply ColoTensor on Torch functions (#821) Jiarui Fang 2022-04-21 14:21:10 +0800
  • 0d5041a2b9 Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into tensor/nohijactfunc jiaruifang 2022-04-21 14:18:35 +0800
  • 80214ecb76 [tensor] hander the function not wrapped jiaruifang 2022-04-21 14:15:56 +0800
  • 0ce8924ceb
    [tensor] reorganize files (#820) Jiarui Fang 2022-04-21 14:15:48 +0800
  • 330010152d polish jiaruifang 2022-04-21 14:01:13 +0800
  • 12e6e41d6f polish jiaruifang 2022-04-21 12:18:29 +0800
  • c617a1bd4c rm useless dir jiaruifang 2022-04-21 12:08:33 +0800
  • 1dd7d6c4d4
    Merge branch 'main' into gemini/tensor2 Jiarui Fang 2022-04-21 12:06:06 +0800
  • d98591adae [tensor] renaming and reorganize directory structure. jiaruifang 2022-04-21 12:03:19 +0800
  • ab962b9735
    [gemini] a new tensor structure (#818) Jiarui Fang 2022-04-21 11:42:37 +0800
  • e91c007791 polish jiaruifang 2022-04-21 11:40:12 +0800
  • 413ce30c45
    Automated submodule synchronization (#819) github-actions[bot] 2022-04-21 11:26:58 +0800
  • ae30628c9f polish jiaruifang 2022-04-21 10:54:20 +0800
  • 9a96ab3e13 polish jiaruifang 2022-04-21 10:47:37 +0800
  • 7bfef417a3 polish jiaruifang 2022-04-21 10:20:48 +0800
  • 68822ff289 polish jiaruifang 2022-04-21 10:16:21 +0800
  • 684af0d15e polish jiaruifang 2022-04-21 10:14:20 +0800
  • 884877d01c polish jiaruifang 2022-04-21 09:59:59 +0800
  • b90ac3564b polish jiaruifang 2022-04-21 09:58:15 +0800
  • 3f8de4c335 polish jiaruifang 2022-04-21 09:45:18 +0800
  • 73952ee2d2 Automated submodule synchronization github-actions 2022-04-21 00:01:45 +0000
  • 748b381bb0 polish jiaruifang 2022-04-20 18:14:01 +0800
  • 3b40af20a6 polish jiaruifang 2022-04-20 18:09:33 +0800
  • d1ee07cc1b Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into gemini/tensor jiaruifang 2022-04-20 18:07:44 +0800
  • b83668b01e add a new tensor structure and override linear for it jiaruifang 2022-04-20 18:05:13 +0800
  • 9da7893cf5 Merge branch 'feature/layer_spec' of github.com:YuliangLiu0306/ColossalAI into feature/layer_spec YuliangLiu0306 2022-04-20 17:02:22 +0800
  • e23d33e8be
    Merge branch 'hpcaitech:main' into main YuliangLiu0306 2022-04-20 15:47:02 +0800
  • fe00316b85 [pipeline]add module lazy init feature to support large model initization. YuliangLiu0306 2022-04-20 15:43:52 +0800
  • 9aae4197bb
    Automated submodule synchronization (#810) github-actions[bot] 2022-04-20 13:57:12 +0800
  • e1b3899824
    Merge pull request #815 from FrankLeeeee/feature/check-cli YuliangLiu0306 2022-04-20 12:19:50 +0800
  • 70ed11d07e [cli] added check installation cli FrankLeeeee 2022-04-20 12:05:38 +0800
  • c7eca40f51
    Merge pull request #812 from FrankLeeeee/feature/cli YuliangLiu0306 2022-04-20 11:40:07 +0800
  • 3ddbd1bce1
    [gemini] collect cpu-gpu moving volume in each iteration (#813) Jiarui Fang 2022-04-20 11:29:48 +0800
  • c8635e9855 Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into gemini/cpugpu_volume jiaruifang 2022-04-20 10:55:33 +0800
  • d294a2a2f8 polish code jiaruifang 2022-04-20 10:53:47 +0800
  • d522cb704e [cli] fixed single-node process launching FrankLeeeee 2022-04-20 10:38:21 +0800
  • 61c20b44bc
    [log] local throughput metrics (#811) Jiarui Fang 2022-04-20 10:05:39 +0800
  • 58ea5d0b37 polish jiaruifang 2022-04-20 10:00:39 +0800
  • 073e153ef1 polish code jiaruifang 2022-04-20 09:55:32 +0800
  • 43e4b8e7f7 polish jiaruifang 2022-04-20 09:54:03 +0800
  • 60029814c3 polish jiaruifang 2022-04-20 09:48:32 +0800