Commit Graph

2 Commits (7ef91606e17cc1e991496c6cc74f73cbd42313ae)

Author SHA1 Message Date
Hongxin Liu e094933da1
[shardformer] fix pipeline grad ckpt (#5620)
7 months ago
Wenhao Chen e614aa34f3
[shardformer, pipeline] add `gradient_checkpointing_ratio` and heterogenous shard policy for llama (#5508)
8 months ago