github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

[NFC] polish colossalai/kernel/cuda_native/csrc/kernels/cross_entropy.cu code style (#953)

Browse Source 
Co-authored-by: 何晓昕 <cautious@hexiaoxins-MacBook-Pro.local>
pull/997/head
Cautiousss 3 years ago committed by binmakeswell
parent d8d07b0e2b
commit 0b86a6345e
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File

2
colossalai/kernel/cuda_native/csrc/kernels/cross_entropy.cu
Unescape View File

@ -16,7 +16,7 @@ __global__ void ls_cross_entropy_fw_kernel(
const int left_idx = block_start + threadIdx.x; const int left_idx = block_start + threadIdx.x;
const int right_idx = (blockIdx.x + 1) * vocab_size; const int right_idx = (blockIdx.x + 1) * vocab_size;
float max_input[1] = {REDUCE_FLOAT_INF_NEG}; float max_input[1] = {REDUCE_FLOAT_INF_NEG};
float sum_logits[2] = {0.f, 0.f}; // logit and logit exp float sum_logits[2] = {0.f, 0.f}; // logit and logit exp
int target_tid = targets[blockIdx.x]; int target_tid = targets[blockIdx.x];
if (target_tid == padding_idx) { if (target_tid == padding_idx) {

Write Preview
Loading…
Cancel
Save