You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Guangyao Zhang 53cb9606bd [Feature] llama shardformer fp8 support (#5938) ... * add llama shardformer fp8 * Llama Shardformer Parity * fix typo * fix all reduce * fix pytest failure * fix reduce op and move function to fp8.py * fix typo		4 months ago
..
_C	Clean up	6 months ago
_analyzer	[test] Fix/fix testcase (#5770)	6 months ago
accelerator	[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)	9 months ago
amp	[npu] change device to accelerator api (#5239)	11 months ago
auto_parallel	[pre-commit.ci] pre-commit autoupdate (#5572)	5 months ago
autochunk	[hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606)	7 months ago
booster	[fp8] add fp8 comm for low level zero	4 months ago
checkpoint_io	[MoE/ZeRO] Moe refactor with zero refactor (#5821)	5 months ago
cli	[devops] fix extention building (#5427)	9 months ago
cluster	[MoE/ZeRO] Moe refactor with zero refactor (#5821)	5 months ago
context	[Fix]: implement thread-safety singleton to avoid deadlock for very large-scale training scenarios (#5625)	7 months ago
device	[Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694)	7 months ago
fx	[test] Fix/fix testcase (#5770)	6 months ago
inference	[pre-commit.ci] pre-commit autoupdate (#5572)	5 months ago
interface	[Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694)	7 months ago
kernel	[NFC] Fix code factors on inference triton kernels (#5743)	6 months ago
lazy	[lazy] fix lazy cls init (#5720)	6 months ago
legacy	[pre-commit.ci] pre-commit autoupdate (#5572)	5 months ago
logging	[misc] update pre-commit and run all files (#4752)	1 year ago
moe	[MoE/ZeRO] Moe refactor with zero refactor (#5821)	5 months ago
nn	[misc] fix dist logger (#5782)	6 months ago
pipeline	[pre-commit.ci] auto fixes from pre-commit.com hooks	5 months ago
quantization	[Feature] llama shardformer fp8 support (#5938)	4 months ago
shardformer	[Feature] llama shardformer fp8 support (#5938)	4 months ago
tensor	[MoE/ZeRO] Moe refactor with zero refactor (#5821)	5 months ago
testing	[misc] Accelerate CI for zero and dist optim (#5758)	6 months ago
utils	Merge pull request #5310 from hpcaitech/feature/npu	10 months ago
zero	[fp8] add fp8 comm for low level zero	4 months ago
__init__.py	[devops] remove post commit ci (#5566)	8 months ago
initialize.py	[launch] Support IPv4 host initialization in launch (#5822)	5 months ago