682 Commits (bad5d4c0a1982b6d6bf7ff645d40cead992d6bc6)

 

All Branches   

Search

Author	SHA1	Message	Date
Ziyue Jiang	797a9dc5a9	add DistSpec for loss and test_model (#947)	3 years ago
ver217	67c33f57eb	[tensor] design DistSpec and DistSpecManager for ColoTensor (#934) ... * add dist spec * update linear op * polish code * polish code * update embedding op * polish unit tests * polish unit tests * polish comments * polish code * add test_dist_spec_mgr * polish code * refactor folder structure * polish unit tests * add get_process_group() for TensorSpec * polish code	3 years ago
Ziyue Jiang	830d3bca26	[Tensor] add optimizer to bert test (#933) ... * add optimizer to bert test * polish	3 years ago
github-actions[bot]	7edb38193a	Automated submodule synchronization (#932) ... Co-authored-by: github-actions <github-actions@github.com>	3 years ago
Ziyue Jiang	d73c2b1d79	[Tensor] fix init context (#931) ... * change torch.Parameter to ColoParameter * fix post assignment for init context * polish * polish	3 years ago
Ziyue Jiang	dfc88b85ea	[Tensor] simplify named param (#928) ... * simplify ColoModulize * simplify ColoModulize * polish * polish	3 years ago
YuliangLiu0306	32a45cd7ef	[pipelinable]use pipelinable to support GPT model. (#903) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [pipelinable]use pipelinable to support GPT model. * fix a bug caused by ShardedModel * polish * fix front func list	3 years ago
github-actions[bot]	b61d64685f	Automated submodule synchronization (#929) ... Co-authored-by: github-actions <github-actions@github.com>	3 years ago
ver217	4ca732349e	[tensor] colo tensor overrides mul (#927) ... * colo tensor overrides mul * polish code	3 years ago
ver217	45b9124df4	[tensor] hijack addmm for colo tensor (#923) ... * hijack addmm for colo tensor * fix bugs * polish unit test * polish comments	3 years ago
Jiarui Fang	534afb018a	test pretrain loading on multi-process (#922)	3 years ago
Ziyue Jiang	c195d2814c	[Tensor] add from_pretrained support and bert pretrained test (#921) ... * add from_pretrained support and test * polish * polish * polish * polish	3 years ago
ver217	1d625fcd36	[setup] support more cuda architectures (#920) ... * support more cuda archs * polish code	3 years ago
ver217	5d8f1262fb	update cuda ext cc flags (#919)	3 years ago
Jiarui Fang	845856ea29	[Graph] building computing graph with ColoTensor, Linear only (#917)	3 years ago
Ziyue Jiang	75d221918a	[Tensor] add 1d vocab loss (#918) ... * add 1d vocab loss * polish	3 years ago
Ziyue Jiang	dfaff4e243	[Tensor] fix test_model (#916) ... * polish test_model * polish	3 years ago
Jiarui Fang	ed6426c300	[Tensor] polish model test (#915)	3 years ago
Ziyue Jiang	0fab86b12a	[Tensor] add a basic bert. (#911) ... * add base bert test * Add bert test * polish * remove test_bert * polish	3 years ago
Jiarui Fang	ab95ec9aea	[Tensor] init ColoParameter (#914)	3 years ago
Ziyue Jiang	193d629311	update pytest.mark.parametrize in tensor tests (#913)	3 years ago
github-actions[bot]	1cf7fb3cd9	Automated submodule synchronization (#912) ... Co-authored-by: github-actions <github-actions@github.com>	3 years ago
Frank Lee	f0f35216f1	[ci] added wheel build scripts (#910) ... * [ci] added wheel build scripts * polish code and workflow * polish code and workflow * polish code and workflow * polish code and workflow * polish code and workflow * polish code and workflow * polish code and workflow * polish code and workflow * polish code and workflow * polish code and workflow * polish code and workflow * [ci] polish wheel build scripts	3 years ago
ver217	150b1a7453	update local version format (#909)	3 years ago
github-actions[bot]	3b1f5f07ce	Automated submodule synchronization (#907) ... Co-authored-by: github-actions <github-actions@github.com>	3 years ago
Ziyue Jiang	f593a5637e	[Tensor] add embedding tp1d row (#904)	3 years ago
ver217	16122d5fac	update release bdist CI (#902)	3 years ago
Ziyue Jiang	2c0d19d755	[Tensor] add ColoTensor TP1Dcol Embedding (#899)	3 years ago
ver217	e46e423c00	add CI for releasing bdist wheel (#901)	3 years ago
Jiarui Fang	e1108caf7d	change version to 0.1.4 (#900)	3 years ago
Jiarui Fang	d16671da75	[Tensor] initialize the ColoOptimizer (#898) ... * [Tensor] activation is an attr of ColoTensor * [Tensor] add optimizer * only detach parameters in context * polish code	3 years ago
Jiarui Fang	676f191532	[Tensor] activation is an attr of ColoTensor (#897)	3 years ago
Jiarui Fang	e76f76c08b	[Tensor] test parameters() as member function (#896)	3 years ago
Ziyue Jiang	cb182da7c5	[tensor] refine linear and add gather for laynorm (#893) ... * refine linear and add function to ColoTensor * add gather for layernorm * polish * polish	3 years ago
Jiarui Fang	26c49639d8	[Tensor] overriding paramters() for Module using ColoTensor (#889)	3 years ago
ver217	daf59ff72e	[setup] add local version label (#890)	3 years ago
Ziyue Jiang	1d0aba4153	[tensor] add ColoTensor 1Dcol (#888)	3 years ago
Jiarui Fang	a0e5971692	[Tensor] test model check results for a simple net (#887)	3 years ago
Jiarui Fang	72cdc06875	[Tensor] make ColoTensor more robust for getattr (#886) ... * [Tensor] make ColoTensor more robust for getattr * polish * polish	3 years ago
Ziyue Jiang	9bc5a77c31	[tensor] wrap function in the torch_tensor to ColoTensor (#881)	3 years ago
ver217	4df6471f5d	fix import error (#880)	3 years ago
Jiarui Fang	7f76517a85	[Tensor] make a simple net works with 1D row TP (#879)	3 years ago
ver217	c4d903e64a	[gemini] accelerate adjust_layout() (#878) ... * add lru cache * polish code * update unit test * fix sharded optim	3 years ago
Jiarui Fang	909211453b	[Tensor] Add some attributes to ColoTensor (#877) ... * [Tensor] add some function to ColoTensor * torch.allclose * rm torch.add	3 years ago
HELSON	425b4a96b8	[gemini] polish stateful_tensor_mgr (#876)	3 years ago
Jiarui Fang	e43f83aa5c	[Tensor] get named parameters for model using ColoTensors (#874)	3 years ago
LuGY	2883040286	[example] change qkv processing (#870)	3 years ago
Jiarui Fang	96211c2cc8	[tensor] customized op returns ColoTensor (#875) ... * [tensor] customized op returns ColoTensor * polish * polish code	3 years ago
Ziyue Jiang	26d4ab8b03	[Tensor] Add function to spec and update linear 1Drow and unit tests (#869)	3 years ago
Frank Lee	11f54c7b6b	[doc] improved docstring and assertion messages for the engine module (#871)	3 years ago