14 Commits (ee50497db2a4754f4bc064710a27dc759fc98d79)

Author	SHA1	Message	Date
ver217	007ca0df92	fix colo init context (#1026)	2022-05-25 20:41:58 +08:00
ver217	ad536e308e	[tensor] refactor colo-tensor (#992) ... * refactor colo-tensor and update linear op * polish code * polish code * update ops and unit tests * update unit tests * polish code * rename dist_spec module * polish code * polish code * remove unneeded import * fix pipelinable	2022-05-19 12:44:59 +08:00
Ziyue Jiang	d73c2b1d79	[Tensor] fix init context (#931) ... * change torch.Parameter to ColoParameter * fix post assignment for init context * polish * polish	2022-05-11 15:48:12 +08:00
Ziyue Jiang	dfc88b85ea	[Tensor] simplify named param (#928) ... * simplify ColoModulize * simplify ColoModulize * polish * polish	2022-05-11 10:54:19 +08:00
Ziyue Jiang	c195d2814c	[Tensor] add from_pretrained support and bert pretrained test (#921) ... * add from_pretrained support and test * polish * polish * polish * polish	2022-05-09 16:11:47 +08:00
Jiarui Fang	ab95ec9aea	[Tensor] init ColoParameter (#914)	2022-05-06 12:57:14 +08:00
Jiarui Fang	d16671da75	[Tensor] initialize the ColoOptimizer (#898) ... * [Tensor] activation is an attr of ColoTensor * [Tensor] add optimizer * only detach parameters in context * polish code	2022-04-28 15:23:40 +08:00
Jiarui Fang	676f191532	[Tensor] activation is an attr of ColoTensor (#897)	2022-04-28 14:43:22 +08:00
Jiarui Fang	26c49639d8	[Tensor] overriding paramters() for Module using ColoTensor (#889)	2022-04-27 15:28:59 +08:00
Jiarui Fang	d01d3b8cb0	colo init context add device attr. (#866)	2022-04-25 14:24:26 +08:00
Jiarui Fang	62f059251b	[Tensor] init a tp network training unittest (#849)	2022-04-24 16:43:44 +08:00
ver217	0dea140760	[hotfix] add deconstructor for stateful tensor (#848) ... * add deconstructor for stateful tensor * fix colo init context	2022-04-24 15:03:04 +08:00
YuliangLiu0306	35ea6e1023	[pipelinable]use pipelinable context to initialize non-pipeline model (#816) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [pipeline]add module lazy init feature to support large model initization. * [pipeline]add to_layer_list and partition method to support arbitrary non-pp model * refactor the module structure * polish * [pipelinable]add unit test for pipelinable * polish * polish * Fix CodeFactor issues.	2022-04-24 13:03:12 +08:00
Jiarui Fang	8789850eea	Init Conext supports lazy allocate model memory (#842)	2022-04-22 18:03:35 +08:00