ver217
|
45b9124df4
|
[tensor] hijack addmm for colo tensor (#923)
* hijack addmm for colo tensor
* fix bugs
* polish unit test
* polish comments
|
3 years ago |
Jiarui Fang
|
534afb018a
|
test pretrain loading on multi-process (#922)
|
3 years ago |
Ziyue Jiang
|
c195d2814c
|
[Tensor] add from_pretrained support and bert pretrained test (#921)
* add from_pretrained support and test
* polish
* polish
* polish
* polish
|
3 years ago |
ver217
|
1d625fcd36
|
[setup] support more cuda architectures (#920)
* support more cuda archs
* polish code
|
3 years ago |
ver217
|
5d8f1262fb
|
update cuda ext cc flags (#919)
|
3 years ago |
Jiarui Fang
|
845856ea29
|
[Graph] building computing graph with ColoTensor, Linear only (#917)
|
3 years ago |
Ziyue Jiang
|
75d221918a
|
[Tensor] add 1d vocab loss (#918)
* add 1d vocab loss
* polish
|
3 years ago |
Ziyue Jiang
|
dfaff4e243
|
[Tensor] fix test_model (#916)
* polish test_model
* polish
|
3 years ago |
Jiarui Fang
|
ed6426c300
|
[Tensor] polish model test (#915)
|
3 years ago |
Ziyue Jiang
|
0fab86b12a
|
[Tensor] add a basic bert. (#911)
* add base bert test
* Add bert test
* polish
* remove test_bert
* polish
|
3 years ago |
Jiarui Fang
|
ab95ec9aea
|
[Tensor] init ColoParameter (#914)
|
3 years ago |
Ziyue Jiang
|
193d629311
|
update pytest.mark.parametrize in tensor tests (#913)
|
3 years ago |
github-actions[bot]
|
1cf7fb3cd9
|
Automated submodule synchronization (#912)
Co-authored-by: github-actions <github-actions@github.com>
|
3 years ago |
Frank Lee
|
f0f35216f1
|
[ci] added wheel build scripts (#910)
* [ci] added wheel build scripts
* polish code and workflow
* polish code and workflow
* polish code and workflow
* polish code and workflow
* polish code and workflow
* polish code and workflow
* polish code and workflow
* polish code and workflow
* polish code and workflow
* polish code and workflow
* polish code and workflow
* [ci] polish wheel build scripts
|
3 years ago |
ver217
|
150b1a7453
|
update local version format (#909)
|
3 years ago |
github-actions[bot]
|
3b1f5f07ce
|
Automated submodule synchronization (#907)
Co-authored-by: github-actions <github-actions@github.com>
|
3 years ago |
Ziyue Jiang
|
f593a5637e
|
[Tensor] add embedding tp1d row (#904)
|
3 years ago |
ver217
|
16122d5fac
|
update release bdist CI (#902)
|
3 years ago |
Ziyue Jiang
|
2c0d19d755
|
[Tensor] add ColoTensor TP1Dcol Embedding (#899)
|
3 years ago |
ver217
|
e46e423c00
|
add CI for releasing bdist wheel (#901)
|
3 years ago |
Jiarui Fang
|
e1108caf7d
|
change version to 0.1.4 (#900)
|
3 years ago |
Jiarui Fang
|
d16671da75
|
[Tensor] initialize the ColoOptimizer (#898)
* [Tensor] activation is an attr of ColoTensor
* [Tensor] add optimizer
* only detach parameters in context
* polish code
|
3 years ago |
Jiarui Fang
|
676f191532
|
[Tensor] activation is an attr of ColoTensor (#897)
|
3 years ago |
Jiarui Fang
|
e76f76c08b
|
[Tensor] test parameters() as member function (#896)
|
3 years ago |
Ziyue Jiang
|
cb182da7c5
|
[tensor] refine linear and add gather for laynorm (#893)
* refine linear and add function to ColoTensor
* add gather for layernorm
* polish
* polish
|
3 years ago |
Jiarui Fang
|
26c49639d8
|
[Tensor] overriding paramters() for Module using ColoTensor (#889)
|
3 years ago |
ver217
|
daf59ff72e
|
[setup] add local version label (#890)
|
3 years ago |
Ziyue Jiang
|
1d0aba4153
|
[tensor] add ColoTensor 1Dcol (#888)
|
3 years ago |
Jiarui Fang
|
a0e5971692
|
[Tensor] test model check results for a simple net (#887)
|
3 years ago |
Jiarui Fang
|
72cdc06875
|
[Tensor] make ColoTensor more robust for getattr (#886)
* [Tensor] make ColoTensor more robust for getattr
* polish
* polish
|
3 years ago |
Ziyue Jiang
|
9bc5a77c31
|
[tensor] wrap function in the torch_tensor to ColoTensor (#881)
|
3 years ago |
ver217
|
4df6471f5d
|
fix import error (#880)
|
3 years ago |
Jiarui Fang
|
7f76517a85
|
[Tensor] make a simple net works with 1D row TP (#879)
|
3 years ago |
ver217
|
c4d903e64a
|
[gemini] accelerate adjust_layout() (#878)
* add lru cache
* polish code
* update unit test
* fix sharded optim
|
3 years ago |
Jiarui Fang
|
909211453b
|
[Tensor] Add some attributes to ColoTensor (#877)
* [Tensor] add some function to ColoTensor
* torch.allclose
* rm torch.add
|
3 years ago |
HELSON
|
425b4a96b8
|
[gemini] polish stateful_tensor_mgr (#876)
|
3 years ago |
Jiarui Fang
|
e43f83aa5c
|
[Tensor] get named parameters for model using ColoTensors (#874)
|
3 years ago |
LuGY
|
2883040286
|
[example] change qkv processing (#870)
|
3 years ago |
Jiarui Fang
|
96211c2cc8
|
[tensor] customized op returns ColoTensor (#875)
* [tensor] customized op returns ColoTensor
* polish
* polish code
|
3 years ago |
Ziyue Jiang
|
26d4ab8b03
|
[Tensor] Add function to spec and update linear 1Drow and unit tests (#869)
|
3 years ago |
Frank Lee
|
11f54c7b6b
|
[doc] improved docstring and assertion messages for the engine module (#871)
|
3 years ago |
Frank Lee
|
1c34382678
|
[doc] improved assertion messages in trainer (#873)
|
3 years ago |
Frank Lee
|
7a64fae33a
|
[doc] improved error messages in initialize (#872)
|
3 years ago |
Jiarui Fang
|
1190b2c4a4
|
[tensor] add cross_entrophy_loss (#868)
|
3 years ago |
HELSON
|
3107817172
|
[gemini] add stateful tensor container (#867)
|
3 years ago |
Jiarui Fang
|
d01d3b8cb0
|
colo init context add device attr. (#866)
|
3 years ago |
Frank Lee
|
2238758c2e
|
[usability] improved error messages in the context module (#856)
|
3 years ago |
Frank Lee
|
9fdebadd69
|
[doc] improved docstring in the amp module (#857)
|
3 years ago |
Frank Lee
|
b862d89d00
|
[doc] improved docstring in the logging module (#861)
|
3 years ago |
Frank Lee
|
8004c8e938
|
[doc] improved docstring in the communication module (#863)
|
3 years ago |