Jiarui Fang
5d7dc3525b
[hotfix] run cpu adam unittest in pytest ( #424 )
3 years ago
Jiarui Fang
54229cd33e
[log] better logging display with rich ( #426 )
...
* better logger using rich
* remove deepspeed in zero requirements
3 years ago
HELSON
3f70a2b12f
removed noisy function during evaluation of MoE router ( #419 )
3 years ago
Jiarui Fang
adebb3e041
[zero] cuda margin space for OS ( #418 )
3 years ago
Jiarui Fang
56bb412e72
[polish] use GLOBAL_MODEL_DATA_TRACER ( #417 )
3 years ago
Jiarui Fang
23ba3fc450
[zero] refactory ShardedOptimV2 init method ( #416 )
3 years ago
Frank Lee
e79ea44247
[fp16] refactored fp16 optimizer ( #392 )
3 years ago
Frank Lee
f8a0e7fb01
Merge pull request #412 from hpcaitech/develop
...
merge develop to main
3 years ago
Jiarui Fang
21dc54e019
[zero] memtracer to record cuda memory usage of model data and overall system ( #395 )
3 years ago
Jiarui Fang
a37bf1bc42
[hotfix] rm test_tensor_detector.py ( #413 )
3 years ago
Jiarui Fang
370f567e7d
[zero] new interface for ShardedOptimv2 ( #406 )
3 years ago
LuGY
a9c27be42e
Added tensor detector ( #393 )
...
* Added tensor detector
* Added the - states
* Allowed change include_cpu when detect()
3 years ago
Frank Lee
32296cf462
Merge pull request #409 from 1SAA/develop
...
[hotfix] fixed error when no collective communication in CommProfiler
3 years ago
1SAA
907ac4a2dc
fixed error when no collective communication in CommProfiler
3 years ago
Frank Lee
62b08acc72
update hf badge link ( #410 )
3 years ago
Frank Lee
2fe68b359a
Merge pull request #403 from ver217/feature/shard-strategy
...
[zero] Add bucket tensor shard strategy
3 years ago
Frank Lee
cf92a779dc
added huggingface badge ( #407 )
3 years ago
HELSON
dfd0363f68
polished output format for communication profiler and pcie profiler ( #404 )
...
fixed typing error
3 years ago
ver217
63469c0f91
polish code
3 years ago
ver217
54fd37f0e0
polish unit test
3 years ago
ver217
88804aee49
add bucket tensor shard strategy
3 years ago
Frank Lee
aaead33cfe
Merge pull request #397 from hpcaitech/create-pull-request/patch-sync-submodule
...
[Bot] Synchronize Submodule References
3 years ago
github-actions
6098bc4cce
Automated submodule synchronization
3 years ago
Frank Lee
6937f85004
Merge pull request #402 from oikosohn/oikosohn-patch-1
...
fix typo in CHANGE_LOG.md
3 years ago
sohn
ff4f5d7231
fix typo in CHANGE_LOG.md
...
- fix typo, `Unifed` -> `Unified` below Added
3 years ago
Frank Lee
fc5101f24c
Merge pull request #401 from hpcaitech/develop
3 years ago
Frank Lee
fc2fd0abe5
Merge pull request #400 from hpcaitech/hotfix/readme
...
fixed broken badge link
3 years ago
Frank Lee
6d3a4f51bf
fixed broken badge link
3 years ago
HELSON
7c079d9c33
[hotfix] fixed bugs in ShardStrategy and PcieProfiler ( #394 )
3 years ago
Frank Lee
1e4bf85cdb
fixed bug in activation checkpointing test ( #387 )
3 years ago
Jiarui Fang
3af13a2c3e
[zero] polish ShardedOptimV2 unittest ( #385 )
...
* place params on cpu after zero init context
* polish code
* bucketzed cpu gpu tensor transter
* find a bug in sharded optim unittest
* add offload unittest for ShardedOptimV2.
* polish code and make it more robust
3 years ago
binmakeswell
ce7b2c9ae3
update README and images path ( #384 )
3 years ago
ScalableEKNN
2fcd4f38ee
fix format ( #379 )
3 years ago
Jiang Zhuo
5a4a3b77d9
fix format ( #376 )
3 years ago
lucasliunju
ce886a9062
fix format ( #374 )
3 years ago
Frank Lee
526a318032
[unit test] Refactored test cases with component func ( #339 )
...
* refactored test with component func
* fixed bug
3 years ago
LuGY
de46450461
Added activation offload ( #331 )
...
* Added activation offload
* Fixed the import bug, used the pytest
3 years ago
Jiarui Fang
272ebfb57d
[bug] shard param during initializing the ShardedModelV2 ( #381 )
3 years ago
HELSON
8c18eb0998
[profiler] Fixed bugs in CommProfiler and PcieProfiler ( #377 )
3 years ago
Jiarui Fang
b5f43acee3
[zero] find miss code ( #378 )
3 years ago
Jiarui Fang
6b6002962a
[zero] zero init context collect numel of model ( #375 )
3 years ago
HELSON
1ed7c24c02
Added PCIE profiler to dectect data transmission ( #373 )
3 years ago
jiaruifang
d9217e1960
Revert "[zero] bucketized tensor cpu gpu copy ( #368 )"
...
This reverts commit bef05489b6
.
3 years ago
Xue Fuzhao
a8cd5e8e81
Update README-zh-Hans.md ( #367 )
...
Fuzhao updated
3 years ago
Shen Chenhui
1c88dd43e2
Fix/format ( #366 )
3 years ago
Ziheng Qin
0db43fa995
fix format ( #364 )
3 years ago
RichardoLuo
8539898ec6
flake8 style change ( #363 )
3 years ago
Kai Wang (Victor Kai)
53bb3bcc0a
fix format ( #362 )
3 years ago
ziyu huang
a77d73f22b
fix format parallel_context.py ( #359 )
...
Co-authored-by: huangziyu <202476410arsmart@gmail.com>
3 years ago
Zangwei
c695369af0
fix format constants.py ( #358 )
3 years ago