Commit Graph

720 Commits (8106d7b8c73c23877a9bc75d8a66c2631a5b930d)
 

Author SHA1 Message Date
ver217 1d625fcd36
[setup] support more cuda architectures (#920)
3 years ago
ver217 5d8f1262fb
update cuda ext cc flags (#919)
3 years ago
Jiarui Fang 845856ea29
[Graph] building computing graph with ColoTensor, Linear only (#917)
3 years ago
Ziyue Jiang 75d221918a
[Tensor] add 1d vocab loss (#918)
3 years ago
Ziyue Jiang dfaff4e243
[Tensor] fix test_model (#916)
3 years ago
Jiarui Fang ed6426c300
[Tensor] polish model test (#915)
3 years ago
Ziyue Jiang 0fab86b12a
[Tensor] add a basic bert. (#911)
3 years ago
Jiarui Fang ab95ec9aea
[Tensor] init ColoParameter (#914)
3 years ago
Ziyue Jiang 193d629311
update pytest.mark.parametrize in tensor tests (#913)
3 years ago
github-actions[bot] 1cf7fb3cd9
Automated submodule synchronization (#912)
3 years ago
Frank Lee f0f35216f1
[ci] added wheel build scripts (#910)
3 years ago
ver217 150b1a7453
update local version format (#909)
3 years ago
github-actions[bot] 3b1f5f07ce
Automated submodule synchronization (#907)
3 years ago
Ziyue Jiang f593a5637e
[Tensor] add embedding tp1d row (#904)
3 years ago
ver217 16122d5fac
update release bdist CI (#902)
3 years ago
Ziyue Jiang 2c0d19d755
[Tensor] add ColoTensor TP1Dcol Embedding (#899)
3 years ago
ver217 e46e423c00
add CI for releasing bdist wheel (#901)
3 years ago
Jiarui Fang e1108caf7d
change version to 0.1.4 (#900)
3 years ago
Jiarui Fang d16671da75
[Tensor] initialize the ColoOptimizer (#898)
3 years ago
Jiarui Fang 676f191532
[Tensor] activation is an attr of ColoTensor (#897)
3 years ago
Jiarui Fang e76f76c08b
[Tensor] test parameters() as member function (#896)
3 years ago
Ziyue Jiang cb182da7c5
[tensor] refine linear and add gather for laynorm (#893)
3 years ago
Jiarui Fang 26c49639d8
[Tensor] overriding paramters() for Module using ColoTensor (#889)
3 years ago
ver217 daf59ff72e
[setup] add local version label (#890)
3 years ago
Ziyue Jiang 1d0aba4153
[tensor] add ColoTensor 1Dcol (#888)
3 years ago
Jiarui Fang a0e5971692
[Tensor] test model check results for a simple net (#887)
3 years ago
Jiarui Fang 72cdc06875
[Tensor] make ColoTensor more robust for getattr (#886)
3 years ago
Ziyue Jiang 9bc5a77c31
[tensor] wrap function in the torch_tensor to ColoTensor (#881)
3 years ago
ver217 4df6471f5d
fix import error (#880)
3 years ago
Jiarui Fang 7f76517a85
[Tensor] make a simple net works with 1D row TP (#879)
3 years ago
ver217 c4d903e64a
[gemini] accelerate adjust_layout() (#878)
3 years ago
Jiarui Fang 909211453b
[Tensor] Add some attributes to ColoTensor (#877)
3 years ago
HELSON 425b4a96b8
[gemini] polish stateful_tensor_mgr (#876)
3 years ago
Jiarui Fang e43f83aa5c
[Tensor] get named parameters for model using ColoTensors (#874)
3 years ago
LuGY 2883040286
[example] change qkv processing (#870)
3 years ago
Jiarui Fang 96211c2cc8
[tensor] customized op returns ColoTensor (#875)
3 years ago
Ziyue Jiang 26d4ab8b03
[Tensor] Add function to spec and update linear 1Drow and unit tests (#869)
3 years ago
Frank Lee 11f54c7b6b
[doc] improved docstring and assertion messages for the engine module (#871)
3 years ago
Frank Lee 1c34382678
[doc] improved assertion messages in trainer (#873)
3 years ago
Frank Lee 7a64fae33a
[doc] improved error messages in initialize (#872)
3 years ago
Jiarui Fang 1190b2c4a4
[tensor] add cross_entrophy_loss (#868)
3 years ago
HELSON 3107817172
[gemini] add stateful tensor container (#867)
3 years ago
Jiarui Fang d01d3b8cb0
colo init context add device attr. (#866)
3 years ago
Frank Lee 2238758c2e
[usability] improved error messages in the context module (#856)
3 years ago
Frank Lee 9fdebadd69
[doc] improved docstring in the amp module (#857)
3 years ago
Frank Lee b862d89d00
[doc] improved docstring in the logging module (#861)
3 years ago
Frank Lee 8004c8e938
[doc] improved docstring in the communication module (#863)
3 years ago
Jiarui Fang 8af5f7423d
[tensor] an initial dea of tensor spec (#865)
3 years ago
Jiarui Fang 126ba573a8
[Tensor] add layer norm Op (#852)
3 years ago
Frank Lee a82da26f7e
[cli] refactored micro-benchmarking cli and added more metrics (#858)
3 years ago