You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

botbw 8e718a1421 [gemini] fixes for benchmarking (#5847) ... * [gemini] fix missing return * [gemini] fix missing arg pass * [gemini] use gather tensor instead of list * [test] enable flash attention for benchmark by default * [test] enable flash attention for benchmark by default --------- Co-authored-by: genghaozhe <939857490@qq.com>		5 months ago
..
_C	Clean up	6 months ago
_analyzer	[test] Fix/fix testcase (#5770)	6 months ago
accelerator	[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)	9 months ago
amp	[npu] change device to accelerator api (#5239)	11 months ago
auto_parallel	[misc] refactor launch API and tensor constructor (#5666)	7 months ago
autochunk	[hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606)	7 months ago
booster	[gemini] fixes for benchmarking (#5847)	5 months ago
checkpoint_io	[shardformer] upgrade transformers to 4.39.3 (#5815)	5 months ago
cli	[devops] fix extention building (#5427)	9 months ago
cluster	[Feature] optimize PP overlap (#5735)	5 months ago
context	[Fix]: implement thread-safety singleton to avoid deadlock for very large-scale training scenarios (#5625)	7 months ago
device	[Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694)	6 months ago
fx	[test] Fix/fix testcase (#5770)	6 months ago
inference	[Fix] Fix spec-dec Glide LlamaModel for compatibility with transformers (#5837)	5 months ago
interface	[Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694)	6 months ago
kernel	[NFC] Fix code factors on inference triton kernels (#5743)	6 months ago
lazy	[lazy] fix lazy cls init (#5720)	6 months ago
legacy	[sync] Sync feature/colossal-infer with main	6 months ago
logging	[misc] update pre-commit and run all files (#4752)	1 year ago
moe	[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)	9 months ago
nn	[misc] fix dist logger (#5782)	6 months ago
pipeline	[Feature] optimize PP overlap (#5735)	5 months ago
quantization	[Feature] qlora support (#5586)	7 months ago
shardformer	change 'xxx if xxx else None' to 'xxx or None'	5 months ago
tensor	[Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694)	6 months ago
testing	[misc] Accelerate CI for zero and dist optim (#5758)	6 months ago
utils	Merge pull request #5310 from hpcaitech/feature/npu	10 months ago
zero	[gemini] fixes for benchmarking (#5847)	5 months ago
__init__.py	[devops] remove post commit ci (#5566)	8 months ago
initialize.py	[launch] Support IPv4 host initialization in launch (#5822)	5 months ago