8 Commits (8fd25d6e09069a8437c6ebee8dd83e1de4c9b83d)

Author	SHA1	Message	Date
Wenhao Chen	e614aa34f3	[shardformer, pipeline] add `gradient_checkpointing_ratio` and heterogenous shard policy for llama (#5508) ... * feat: add `GradientCheckpointConfig` and `PipelineGradientCheckpointConfig` * feat: apply `GradientCheckpointConfig` to policy and llama_forward * feat: move `distribute_layer` and `get_stage_index` to PipelineStageManager * fix: add optional args for `distribute_layer` and `get_stage_index` * fix: fix changed API calls * test: update llama tests * style: polish `GradientCheckpointConfig` * fix: fix pipeline utils tests	8 months ago
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
FoolPlayer	d3bc530849	[shardformer] Refactor shardformer api (#4001) ... * fix an error in readme * simplify code * refactor shardformer * add todo * remove slicer * resolve code review	1 year ago
Frank Lee	4972e1f40e	[shardformer] refactored the user api (#3828) ... * [shardformer] refactored the user api * polish code	1 year ago
FoolPlayer	8d68de767d	[shardformer] init shardformer code structure (#3731) ... * init shardformer code structure * add implement of sharder (inject and replace) * add implement of replace layer to colossal layer * separate different layer policy, add some notion * implement 1d and 2d slicer, can tell col or row * fix bug when slicing and inject model * fix some bug; add inference test example	1 year ago
Frank Lee	ddcf58cacf	Revert "[sync] sync feature/shardformer with develop"	1 year ago
Frank Lee	537a52b7a2	[shardformer] refactored the user api (#3828) ... * [shardformer] refactored the user api * polish code	1 year ago
FoolPlayer	6a69b44dfc	[shardformer] init shardformer code structure (#3731) ... * init shardformer code structure * add implement of sharder (inject and replace) * add implement of replace layer to colossal layer * separate different layer policy, add some notion * implement 1d and 2d slicer, can tell col or row * fix bug when slicing and inject model * fix some bug; add inference test example	1 year ago