Commit Graph

3762 Commits (e0c68ab6d3d64f401208d6ec66815995cee233c3)
 

Author SHA1 Message Date
Jiarui Fang 5d7dc3525b
[hotfix] run cpu adam unittest in pytest (#424)
3 years ago
Jiarui Fang 54229cd33e
[log] better logging display with rich (#426)
3 years ago
HELSON 3f70a2b12f
removed noisy function during evaluation of MoE router (#419)
3 years ago
Jiarui Fang adebb3e041
[zero] cuda margin space for OS (#418)
3 years ago
Jiarui Fang 56bb412e72
[polish] use GLOBAL_MODEL_DATA_TRACER (#417)
3 years ago
Jiarui Fang 23ba3fc450
[zero] refactory ShardedOptimV2 init method (#416)
3 years ago
Frank Lee e79ea44247
[fp16] refactored fp16 optimizer (#392)
3 years ago
Frank Lee f8a0e7fb01
Merge pull request #412 from hpcaitech/develop
3 years ago
Jiarui Fang 21dc54e019
[zero] memtracer to record cuda memory usage of model data and overall system (#395)
3 years ago
Jiarui Fang a37bf1bc42
[hotfix] rm test_tensor_detector.py (#413)
3 years ago
Jiarui Fang 370f567e7d
[zero] new interface for ShardedOptimv2 (#406)
3 years ago
LuGY a9c27be42e
Added tensor detector (#393)
3 years ago
Frank Lee 32296cf462
Merge pull request #409 from 1SAA/develop
3 years ago
1SAA 907ac4a2dc fixed error when no collective communication in CommProfiler
3 years ago
Frank Lee 62b08acc72
update hf badge link (#410)
3 years ago
Frank Lee 2fe68b359a
Merge pull request #403 from ver217/feature/shard-strategy
3 years ago
Frank Lee cf92a779dc
added huggingface badge (#407)
3 years ago
HELSON dfd0363f68
polished output format for communication profiler and pcie profiler (#404)
3 years ago
ver217 63469c0f91 polish code
3 years ago
ver217 54fd37f0e0 polish unit test
3 years ago
ver217 88804aee49 add bucket tensor shard strategy
3 years ago
Frank Lee aaead33cfe
Merge pull request #397 from hpcaitech/create-pull-request/patch-sync-submodule
3 years ago
github-actions 6098bc4cce Automated submodule synchronization
3 years ago
Frank Lee 6937f85004
Merge pull request #402 from oikosohn/oikosohn-patch-1
3 years ago
sohn ff4f5d7231
fix typo in CHANGE_LOG.md
3 years ago
Frank Lee fc5101f24c
Merge pull request #401 from hpcaitech/develop
3 years ago
Frank Lee fc2fd0abe5
Merge pull request #400 from hpcaitech/hotfix/readme
3 years ago
Frank Lee 6d3a4f51bf fixed broken badge link
3 years ago
HELSON 7c079d9c33
[hotfix] fixed bugs in ShardStrategy and PcieProfiler (#394)
3 years ago
Frank Lee 1e4bf85cdb fixed bug in activation checkpointing test (#387)
3 years ago
Jiarui Fang 3af13a2c3e [zero] polish ShardedOptimV2 unittest (#385)
3 years ago
binmakeswell ce7b2c9ae3 update README and images path (#384)
3 years ago
ScalableEKNN 2fcd4f38ee fix format (#379)
3 years ago
Jiang Zhuo 5a4a3b77d9 fix format (#376)
3 years ago
lucasliunju ce886a9062 fix format (#374)
3 years ago
Frank Lee 526a318032 [unit test] Refactored test cases with component func (#339)
3 years ago
LuGY de46450461 Added activation offload (#331)
3 years ago
Jiarui Fang 272ebfb57d [bug] shard param during initializing the ShardedModelV2 (#381)
3 years ago
HELSON 8c18eb0998 [profiler] Fixed bugs in CommProfiler and PcieProfiler (#377)
3 years ago
Jiarui Fang b5f43acee3 [zero] find miss code (#378)
3 years ago
Jiarui Fang 6b6002962a [zero] zero init context collect numel of model (#375)
3 years ago
HELSON 1ed7c24c02 Added PCIE profiler to dectect data transmission (#373)
3 years ago
jiaruifang d9217e1960 Revert "[zero] bucketized tensor cpu gpu copy (#368)"
3 years ago
Xue Fuzhao a8cd5e8e81 Update README-zh-Hans.md (#367)
3 years ago
Shen Chenhui 1c88dd43e2 Fix/format (#366)
3 years ago
Ziheng Qin 0db43fa995 fix format (#364)
3 years ago
RichardoLuo 8539898ec6 flake8 style change (#363)
3 years ago
Kai Wang (Victor Kai) 53bb3bcc0a fix format (#362)
3 years ago
ziyu huang a77d73f22b fix format parallel_context.py (#359)
3 years ago
Zangwei c695369af0 fix format constants.py (#358)
3 years ago