ColossalAI

Commit Graph

Author	SHA1	Message	Date
digger yu	a9d1cadc49	fix typo with colossalai/trainer utils zero (#3908 )	2023-06-07 16:08:37 +08:00
Kirigaya Kazuto	3b2a59b0ba	[pipeline/rank_recorder] fix bug when process data before backward \| add a tool for multiple ranks debug (#1681 ) * [pipeline/tuning] improve dispatch performance both time and space cost * [pipeline/converge] add interface for testing convergence * [NFC] polish colossalai/utils/multi_tensor_apply/multi_tensor_apply.py code style * Update PipelineBase.py * [pipeline/chimera] reconstruct PipelineBase and Worker to support more feasible custom schedule \| finish Chimera * [pipeline/chimera] test chimera \| fix bug of initializing * [pipeline/pytree] add pytree to process args and kwargs \| provide to process args and kwargs after forward	2022-10-09 17:32:57 +08:00

Author

SHA1

Message

Date

digger yu

a9d1cadc49

fix typo with colossalai/trainer utils zero (#3908 )

2023-06-07 16:08:37 +08:00

Kirigaya Kazuto

3b2a59b0ba

[pipeline/rank_recorder] fix bug when process data before backward | add a tool for multiple ranks debug (#1681 )

* [pipeline/tuning] improve dispatch performance both time and space cost

* [pipeline/converge] add interface for testing convergence

* [NFC] polish colossalai/utils/multi_tensor_apply/multi_tensor_apply.py code style

* Update PipelineBase.py

* [pipeline/chimera] reconstruct PipelineBase and Worker to support more feasible custom schedule | finish Chimera

* [pipeline/chimera] test chimera | fix bug of initializing

* [pipeline/pytree] add pytree to process args and kwargs | provide  to process args and kwargs after forward

2022-10-09 17:32:57 +08:00

2 Commits (ec18fc7340f99693f2436e91e1dea99342f476d5)