Commit Graph

Select branches

Hide Pull Requests

ColossalChat

ckpt

cloud/coati

colossalchat

colossalchat_upgrade

dev/gpt2_metainfo_patch

dev/zero-offload

develop

feat/moe

feat/online-serving

feat/speculative-decoding

feature/2-stage

feature/async-io

feature/colossal-infer

feature/elixir

feature/inference-refactor

feature/lora

feature/stable-diffusion

feature/zerobubble

fix-setup

fix/format

flybird11111-patch-1

hotfix/example_test

hotfix/kernel_build_before_load

llama3

main

moe_sp

pre-commit-ci-update-config

refactor/inference

supercooledith-patch-1

support-npu

#10

#100

#1000

#1001

#1003

#1004

#1005

#1007

#1008

#1009

#101

#1010

#1011

#1012

#1015

#1016

#1017

#1018

#1019

#1020

#1021

#1022

#1024

#1025

#1026

#1027

#1029

#1030

#1031

#1034

#1040

#1041

#1042

#1044

#1045

#1046

#1047

#1048

#1049

#1050

#1052

#1053

#1054

#1059

#1062

#1063

#1066

#1068

#1069

#1070

#1071

#1072

#1073

#1075

#1076

#1077

#1078

#108

#1080

#1081

#1086

#1087

#1088

#1089

#1090

#1091

#1093

#1094

#1096

#1097

#1098

#1099

#11

#1100

#1101

#1102

#1103

#1105

#1106

#1108

#111

#1115

#1117

#1118

#1119

#112

#1120

#1121

#1122

#1123

#1125

#1127

#1128

#1129

#113

#1130

#1131

#1133

#1134

#1135

#1136

#1137

#1138

#1139

#114

#1140

#1142

#1143

#1144

#1145

#1146

#1147

#1148

#115

#1150

#1151

#1152

#1153

#1154

#1155

#1156

#1157

#1158

#1159

#1160

#1161

#1163

#1164

#1165

#1166

#1167

#1168

#1169

#1170

#1171

#1172

#1173

#1174

#1175

#1176

#1177

#1178

#1179

#118

#1181

#1182

#1185

#1186

#1187

#1188

#1189

#1191

#1192

#1193

#1194

#1196

#1197

#1198

#1199

#12

#1200

#1201

#1202

#1203

#1204

#1207

#1208

#1209

#1210

#1211

#1212

#1213

#1214

#1215

#1216

#1217

#1219

#1220

#1221

#1222

#1223

#1224

#1225

#1226

#1227

#1228

#1229

#123

#1230

#1231

#1232

#1233

#1234

#1235

#1236

#1237

#1238

#1239

#1240

#1241

#1242

#1243

#1244

#1245

#1246

#1247

#1248

#1248

#125

#1250

#1251

#1252

#1253

#1254

#1255

#1256

#1257

#1258

#1259

#126

#1260

#1261

#1262

#1263

#1264

#1265

#1266

#1267

#1268

#1269

#127

#1270

#1271

#1272

#1273

#1274

#1275

#1276

#1277

#1278

#1279

#128

#1280

#1281

#1282

#1283

#1284

#1285

#1286

#1287

#1288

#1288

#1289

#129

#1290

#1291

#1292

#1293

#1294

#1295

#1296

#1297

#1298

#1299

#13

#130

#1300

#1301

#1302

#1303

#1305

#1306

#1307

#1308

#1309

#1310

#1311

#1312

#1313

#1314

#1315

#1316

#1318

#1319

#132

#1320

#1321

#1323

#1324

#1325

#1326

#1327

#1328

#1329

#133

#1331

#1332

#1333

#1334

#1335

#1336

#1338

#1339

#1340

#1342

#1343

#1344

#1345

#1346

#1347

#1348

#1349

#135

#1350

#1351

#1352

#1353

#1354

#1355

#1357

#1358

#1359

#1360

#1361

#1362

#1363

#1364

#1366

#1367

#1368

#1369

#137

#1370

#1372

#1373

#1374

#1376

#1377

#1378

#1379

#138

#1380

#1381

#1382

#1383

#1384

#1385

#1386

#1387

#1388

#1391

#1392

#1393

#1394

#1395

#1396

#1397

#1398

#1399

#14

#140

#1403

#1404

#1405

#1406

#1407

#1408

#1409

#141

#1410

#1415

#1416

#1417

#1418

#1419

#142

#1421

#1422

#1423

#1424

#1425

#1426

#1428

#1429

#143

#1430

#1431

#1432

#1433

#1435

#1436

#1437

#1438

#1439

#144

#1441

#1442

#1444

#1446

#1447

#1448

#1449

#145

#1450

#1451

#1452

#1453

#1456

#1457

#1458

#1459

#146

#1460

#1461

#1462

#1463

#1464

#1465

#1466

#1467

#1468

#1469

#147

#1470

#1471

#1472

#1473

#1475

#1476

#1477

#1478

#1479

#148

#1480

#1481

#1482

#1483

#1484

#1486

#1487

#1488

#1489

#1490

#1492

#1493

#1494

#1495

#1496

#1497

#1499

#15

#1500

#1501

#1502

#1503

#1504

#1505

#1506

#1507

#1508

#1509

#151

#1510

#1511

#1512

#1513

#1514

#1515

#1516

#1518

#1519

#152

#1520

#1521

#1522

#1523

#1524

#1525

#1526

#1527

#1528

#1529

#153

#1530

#1531

#1532

#1533

#1534

#1535

#1536

#1537

#1538

#1539

#154

#1541

#1542

#1543

#1544

#1545

#1546

#1547

#1548

#1549

#1550

#1551

#1552

#1553

#1554

#1555

#1556

#1557

#1558

#1559

#156

#1560

#1561

#1562

#1563

#1564

#1565

#1566

#1567

#1568

#1569

#157

#1570

#1571

#1572

#1573

#1574

#1575

#1576

#1578

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#159

#1590

#1591

#1594

#1595

#1596

#1597

#1598

#1599

#160

#1600

#1601

#1602

#1603

#1604

#1605

#1606

#1607

#1608

#1609

#161

#1610

#1611

#1612

#1613

#1614

#1615

#1616

#1617

#1618

#1619

#162

#1620

#1621

#1622

#1623

#1624

#1625

#1628

#1629

#163

#1630

#1631

#1633

#1634

#1635

#1636

#1637

#1638

#1639

#164

#1640

#1641

#1642

#1643

#1644

#1645

#1646

#1647

#1648

#1649

#165

#1650

#1651

#1652

#1653

#1654

#1655

#1656

#1657

#1658

#1659

#166

#1660

#1661

#1662

#1663

#1664

#1665

#1666

#1667

#1669

#167

#1670

#1671

#1673

#1674

#1676

#1677

#1678

#1679

#168

#1680

#1681

#1682

#1683

#1684

#1686

#1687

#1688

#1689

#1690

#1691

#1692

#1694

#1695

#1696

#1697

#1698

#1699

#17

#1700

#1701

#1702

#1703

#1704

#1705

#1706

#1707

#1708

#1709

#171

#1710

#1711

#1712

#1713

#1714

#1715

#1716

#1717

#1718

#1719

#172

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1727

#1728

#1729

#173

#1730

#1731

#1732

#1733

#1734

#1735

#1736

#1739

#174

#1740

#1741

#1742

#1743

#1744

#1745

#1746

#1747

#1748

#1750

#1751

#1752

#1753

#1754

#1755

#1757

#1758

#1759

#176

#1760

#1762

#1763

#1764

#1765

#1766

#1767

#1768

#1769

#1770

#1771

#1772

#1775

#1776

#1778

#178

#1780

#1781

#1782

#1783

#1784

#1785

#1786

#1787

#1788

#1789

#179

#1790

#1791

#1792

#1793

#1796

#1797

#1798

#1799

#18

#1800

#1801

#1802

#1803

#1804

#1805

#1806

#1807

#1808

#1809

#1810

#1811

#1812

#1813

#1814

#1815

#1816

#1817

#1818

#1819

#1820

#1821

#1822

#1823

#1824

#1825

#1826

#1827

#1828

#1829

#183

#1830

#1831

#1832

#1833

#1834

#1835

#1836

#1837

#184

#1840

#1842

#1843

#1844

#1845

#1846

#1847

#1848

#1849

#1851

#1852

#1853

#1854

#1855

#1856

#1857

#1858

#1859

#186

#1860

#1865

#1866

#1867

#1868

#1869

#187

#1871

#1873

#1874

#1875

#1876

#1877

#1878

#1879

#188

#1880

#1889

#189

#1891

#1893

#1894

#1895

#1896

#1897

#1898

#1899

#19

#190

#1901

#1902

#1903

#1904

#1905

#1906

#1907

#1908

#1909

#191

#1910

#1916

#1917

#1918

#1919

#192

#1920

#1921

#1922

#1924

#1925

#1927

#1928

#193

#1930

#1931

#1937

#1938

#1939

#194

#1940

#1941

#1942

#1943

#1944

#1946

#1950

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#196

#1960

#1961

#1962

#1963

#1964

#1967

#1968

#197

#1970

#1971

#1972

#1973

#1974

#1977

#1978

#1979

#198

#1980

#1981

#1982

#1984

#1985

#1986

#1987

#1989

#1990

#1998

#1999

#2

#20

#200

#2000

#2001

#2002

#2003

#2004

#2005

#2006

#2007

#2008

#2009

#201

#2010

#2011

#2015

#2016

#2017

#2018

#2019

#202

#2020

#2021

#2021

#2022

#2023

#2025

#2027

#2028

#2029

#203

#2030

#2032

#2033

#2034

#2035

#2036

#2037

#2038

#2039

#204

#2040

#2042

#2043

#2045

#2046

#2047

#2048

#205

#2050

#2051

#2052

#2053

#2058

#2059

#2060

#2061

#2062

#2064

#2065

#2066

#2069

#2071

#2072

#2073

#2074

#2075

#2076

#2077

#2078

#2079

#2080

#2081

#2082

#2083

#2084

#2085

#2086

#2087

#2088

#2089

#209

#2090

#2091

#2092

#2095

#2096

#2097

#2098

#2099

#21

#210

#2101

#2102

#2103

#2104

#2105

#2106

#2107

#2108

#2110

#2111

#2112

#2113

#2115

#2116

#2117

#2118

#2119

#212

#2120

#2123

#2124

#2125

#2126

#2127

#2128

#2129

#213

#2130

#2131

#2132

#2133

#2134

#2136

#2137

#2138

#2139

#214

#2144

#2146

#2147

#2148

#2149

#215

#2150

#2151

#2152

#2153

#2154

#2155

#2156

#2157

#2158

#2159

#2162

#2163

#2164

#2165

#2167

#2168

#2168

#2169

#217

#2171

#2172

#2173

#2174

#2175

#2177

#2178

#2179

#218

#2184

#2186

#2187

#2188

#2189

#219

#2190

#2191

#2193

#2194

#2195

#2196

#2197

#220

#2200

#2201

#2202

#2203

#2206

#2207

#2208

#2209

#221

#2210

#2211

#2212

#2213

#2214

#2216

#2217

#2219

#222

#2221

#2222

#2223

#2224

#2225

#2226

#2227

#2228

#2229

#223

#2231

#2232

#2234

#2237

#2238

#2239

#224

#2242

#2243

#2244

#2245

#2247

#2248

#2254

#2257

#2258

#226

#2261

#2262

#2263

#2264

#2265

#2266

#2267

#2268

#2268

#2269

#227

#2270

#2271

#2272

#2273

#2274

#2275

#2276

#2277

#2278

#2279

#2280

#2281

#2282

#2283

#2284

#2286

#2287

#2288

#2289

#229

#2290

#2291

#2292

#2293

#2295

#2296

#2297

#2298

#2299

#23

#2300

#2301

#2302

#2303

#2304

#2305

#2306

#2307

#2308

#2310

#2311

#2312

#2313

#2314

#2315

#2316

#2317

#2318

#2319

#232

#2320

#2322

#2323

#2326

#2327

#2328

#2329

#233

#2333

#2336

#2338

#2339

#2340

#2342

#2344

#2345

#2348

#2349

#2350

#2352

#2353

#2354

#2355

#2356

#2357

#2358

#2359

#2363

#2364

#2365

#2366

#2367

#2368

#2370

#2371

#2372

#2373

#2374

#2375

#2379

#2381

#2385

#2387

#2389

#2390

#2393

#2395

#2396

#2396

#2397

#2399

#24

#240

#2400

#2401

#2403

#2404

#2405

#2406

#2408

#2410

#2411

#2412

#2413

#2414

#2415

#2416

#2417

#2418

#2419

#242

#2420

#2423

#2424

#2427

#243

#2431

#2432

#2434

#2436

#2438

#244

#2442

#2443

#2444

#2445

#2446

#2448

#2449

#245

#2451

#2452

#2453

#2456

#2459

#246

#2463

#2464

#2465

#2466

#2468

#2469

#2471

#2473

#2474

#2475

#2476

#2477

#248

#2481

#2482

#2483

#2484

#2485

#2486

#2488

#249

#2492

#2494

#2495

#2497

#2498

#2499

#25

#2502

#2503

#2504

#2506

#2507

#2508

#2509

#251

#2510

#2511

#2512

#2514

#2515

#2516

#2517

#2518

#2519

#252

#2520

#2521

#2522

#2523

#2524

#2525

#2526

#2527

#2528

#2529

#253

#2532

#2533

#2534

#2537

#2538

#2540

#2543

#2544

#2545

#2549

#255

#2550

#2552

#2554

#2556

#2558

#2560

#2561

#2564

#2565

#2567

#2568

#2572

#2574

#2577

#2578

#2581

#2584

#2585

#2586

#2589

#2591

#2594

#2596

#2598

#2600

#2601

#2602

#2604

#2607

#2608

#2611

#2613

#2614

#2615

#2618

#2619

#2621

#2623

#2624

#2625

#2626

#263

#2635

#2637

#264

#2641

#2643

#2644

#2647

#2648

#265

#2652

#2656

#2657

#2658

#2659

#266

#2661

#2664

#2665

#2666

#2669

#267

#2670

#2671

#2672

#2674

#2675

#2678

#268

#2680

#2681

#2683

#2686

#2687

#2689

#2689

#269

#2690

#2691

#2692

#2693

#2694

#2695

#2696

#2698

#2699

#27

#270

#2700

#2701

#2701

#2702

#2702

#2703

#2704

#2705

#2706

#2707

#2708

#2709

#271

#2711

#2712

#2713

#2714

#2715

#2716

#2717

#2719

#272

#2720

#2721

#2723

#2725

#2726

#2727

#2728

#273

#2730

#2734

#2736

#2737

#2738

#274

#2740

#2741

#2742

#2744

#2747

#2749

#2749

#275

#2754

#276

#2760

#2762

#2764

#2766

#2767

#2769

#277

#2773

#2775

#2777

#2789

#279

#2791

#2792

#2796

#2797

#2798

#28

#280

#2803

#2804

#281

#2812

#2813

#2817

#282

#2820

#2821

#2822

#2823

#2824

#2826

#2829

#283

#2835

#2837

#284

#2846

#2848

#2849

#285

#2852

#2854

#286

#2860

#2863

#2867

#2869

#287

#2871

#2876

#288

#2880

#2886

#2895

#29

#291

#2912

#2914

#292

#2920

#2922

#2923

#2925

#2927

#2929

#293

#2930

#2932

#2933

#2935

#2939

#294

#2944

#2946

#2951

#2954

#296

#2964

#2966

#2969

#297

#2971

#2974

#2977

#298

#2982

#2983

#2984

#2986

#2987

#2988

#299

#2993

#2994

#2996

#2997

#2999

#3

#30

#300

#3006

#3008

#301

#3014

#3017

#3019

#302

#3020

#3022

#3025

#3026

#3028

#3029

#303

#3032

#3034

#3037

#304

#3042

#305

#3055

#3056

#3057

#3058

#306

#3062

#3065

#307

#3070

#3072

#3073

#3075

#3079

#308

#3080

#3082

#3084

#3085

#3086

#3087

#3089

#309

#3093

#3094

#3098

#3099

#310

#3101

#3104

#3105

#3107

#3108

#311

#3113

#3116

#312

#3121

#3122

#3128

#3129

#313

#3131

#3132

#3133

#3135

#3136

#3138

#3139

#3147

#315

#3151

#3153

#3154

#3157

#3159

#316

#3162

#3166

#3167

#317

#3170

#3173

#3174

#3177

#3178

#3180

#3181

#3183

#3185

#3186

#3188

#3190

#3191

#3194

#3195

#3197

#3199

#32

#320

#3204

#3205

#3206

#3207

#3209

#321

#3211

#3213

#3216

#3218

#3219

#322

#3221

#3222

#3223

#3225

#3227

#3229

#323

#3230

#3232

#3233

#3236

#3238

#3239

#324

#3241

#3244

#325

#3253

#3254

#3255

#3256

#3257

#3259

#3260

#3261

#3262

#3263

#3265

#3266

#3268

#3269

#327

#3270

#3272

#3273

#3274

#3275

#3276

#3277

#3279

#328

#3282

#3283

#3284

#3285

#3286

#3287

#3288

#3289

#329

#3290

#3292

#3293

#3294

#3295

#3296

#3297

#3298

#3299

#33

#330

#3300

#3301

#3302

#3304

#3305

#3306

#3307

#3308

#3309

#331

#3311

#3312

#3313

#3315

#3318

#332

#3323

#3327

#3329

#333

#3332

#3333

#3338

#334

#3343

#3346

#3347

#335

#3352

#3354

#336

#3367

#3368

#337

#3377

#3378

#3379

#338

#3384

#3386

#339

#3398

#34

#340

#3405

#3408

#341

#3411

#3417

#3418

#342

#3420

#3424

#3427

#3429

#343

#3431

#3433

#3436

#344

#3442

#3445

#3448

#345

#3450

#3452

#3453

#346

#3461

#3465

#347

#3472

#3473

#3474

#3475

#3476

#3477

#3479

#348

#3481

#3486

#3488

#349

#3493

#3497

#35

#350

#3504

#3506

#351

#3513

#3516

#3517

#3519

#352

#3520

#3522

#3525

#353

#3536

#354

#3541

#3548

#3549

#355

#3551

#3552

#3553

#3557

#356

#3561

#3563

#3567

#3567

#3568

#357

#3572

#3573

#3577

#3578

#3579

#358

#3581

#3586

#3588

#3589

#359

#3590

#3592

#3593

#3594

#3596

#3597

#36

#360

#3603

#3605

#3608

#361

#3610

#3611

#3612

#3618

#3619

#362

#3621

#3623

#3625

#3627

#3628

#363

#3632

#364

#3641

#3645

#3646

#3647

#3648

#365

#3652

#3653

#3654

#3655

#3656

#366

#3662

#3663

#3666

#3667

#3668

#367

#3671

#3679

#368

#3680

#3684

#3688

#369

#3691

#3692

#3693

#3694

#3695

#3697

#3699

#3699

#370

#3706

#3707

#3709

#371

#3710

#3711

#3713

#3715

#3718

#3719

#372

#3722

#3725

#3727

#3728

#3729

#373

#3730

#3731

#3735

#374

#3740

#3742

#3744

#3748

#375

#3751

#3754

#3756

#3758

#3759

#376

#3763

#3765

#3767

#377

#3770

#3771

#3772

#3774

#3775

#3778

#3779

#378

#3780

#3781

#3782

#3783

#3785

#3786

#3787

#3788

#3789

#379

#3792

#3794

#3795

#3799

#38

#380

#3801

#3804

#3805

#3806

#3807

#3808

#3809

#381

#3810

#3813

#3815

#3816

#3817

#382

#3820

#3821

#3822

#3823

#3824

#3825

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3833

#3834

#3835

#3838

#384

#3841

#3842

#3844

#3845

#3846

#3847

#3849

#385

#3850

#3855

#3856

#386

#3860

#3862

#3864

#3865

#3868

#3869

#387

#3871

#3872

#3873

#3877

#3878

#3879

#388

#3880

#3882

#3883

#3884

#3885

#3887

#389

#3890

#3891

#3896

#3898

#3899

#39

#390

#3900

#3901

#3902

#3905

#3907

#3908

#3909

#391

#3910

#3911

#3913

#3915

#3916

#3917

#3918

#3919

#392

#3920

#3922

#3923

#3924

#3925

#3926

#3928

#3929

#393

#3930

#3931

#3932

#3934

#3936

#3937

#3939

#394

#3940

#3942

#3943

#3944

#3946

#3947

#3949

#395

#3956

#3960

#3963

#3967

#3968

#3969

#397

#3970

#3972

#3976

#3976

#3979

#3980

#3984

#3985

#3987

#3988

#399

#3990

#3991

#3993

#3994

#3996

#3999

#4

#40

#400

#4001

#4002

#4004

#4006

#4006

#401

#4011

#4013

#4014

#4016

#4018

#4019

#402

#4020

#4021

#4022

#4024

#4025

#4026

#4028

#403

#4030

#4033

#4034

#4036

#4039

#404

#4041

#4043

#4045

#4046

#4046

#4047

#4048

#4049

#4053

#4055

#4056

#4058

#406

#4060

#4062

#4064

#4065

#4067

#4068

#4068

#4069

#407

#4070

#4072

#4073

#4075

#4079

#4080

#4081

#4082

#4083

#4086

#4087

#4089

#409

#4090

#4091

#4093

#4094

#4096

#4098

#41

#410

#4100

#4101

#4103

#4105

#4106

#4107

#4109

#411

#4111

#4112

#4115

#4117

#412

#4122

#4124

#4126

#4127

#4129

#413

#4130

#4132

#4137

#4138

#4139

#414

#4141

#4142

#4144

#4145

#4146

#4147

#4149

#4152

#4153

#4155

#4157

#4158

#4159

#416

#4160

#4161

#4162

#4163

#4165

#4166

#4167

#4169

#417

#4171

#4172

#4173

#4174

#4175

#4176

#4178

#4179

#418

#4180

#4182

#4185

#4187

#4188

#419

#4191

#4192

#4194

#4196

#4197

#42

#420

#4202

#4203

#4205

#4206

#4208

#421

#4210

#4212

#4213

#4214

#4215

#4216

#4217

#4218

#422

#4221

#4223

#4224

#4225

#4226

#4227

#4228

#4229

#423

#423

#4231

#4233

#4234

#4236

#4237

#4238

#4239

#424

#4240

#4241

#4243

#4244

#4245

#4246

#4248

#4250

#4251

#4252

#4253

#4254

#4255

#4256

#4257

#4258

#4259

#426

#4260

#4261

#4263

#4264

#4265

#4266

#4267

#4268

#4269

#427

#4270

#4271

#4272

#4273

#4274

#4275

#4276

#4277

#4278

#4279

#428

#4283

#4284

#4287

#4288

#429

#4290

#4291

#4293

#4295

#4297

#4299

#43

#430

#4300

#4301

#4302

#4303

#4305

#4306

#4307

#4309

#4309

#431

#4310

#4312

#4313

#4314

#4315

#4316

#4317

#432

#4320

#4321

#4323

#4324

#4325

#4329

#433

#4330

#4331

#4332

#4333

#4334

#4336

#4338

#434

#4340

#4341

#4345

#4346

#4347

#4349

#435

#4350

#4352

#4354

#4355

#4356

#4357

#4358

#4359

#436

#4362

#4363

#4366

#4369

#4372

#4377

#4379

#438

#4380

#4382

#4384

#4386

#4388

#4389

#439

#4392

#4395

#4396

#4398

#4399

#44

#440

#4401

#4403

#4404

#4405

#4407

#4408

#4409

#441

#4413

#4415

#4416

#442

#4420

#4421

#4423

#4424

#4426

#4426

#4428

#4429

#4430

#4431

#4432

#4433

#4434

#4435

#4436

#4440

#4441

#4443

#4445

#4446

#4448

#445

#4450

#4452

#4455

#4456

#4457

#4458

#446

#4460

#4461

#4462

#4463

#4465

#4466

#4468

#4469

#447

#4471

#4472

#4473

#4479

#448

#4480

#4481

#4482

#4484

#4485

#4488

#449

#4492

#4493

#4494

#4495

#4496

#4497

#4498

#4499

#45

#450

#4501

#4502

#4503

#4504

#4505

#4506

#4507

#4508

#4509

#451

#4511

#4512

#4514

#4516

#4517

#4519

#452

#4520

#4521

#4523

#4524

#4526

#4527

#4529

#453

#4531

#4532

#4533

#4535

#4536

#4538

#4539

#454

#4540

#4541

#4542

#4544

#4545

#4546

#4549

#455

#4550

#4552

#4553

#4554

#4555

#4556

#4557

#4558

#4559

#456

#4560

#4561

#4563

#4564

#4566

#4569

#457

#4570

#4571

#4572

#4574

#4575

#4576

#4577

#4579

#458

#4580

#4581

#4584

#4585

#4586

#4587

#4588

#4589

#459

#4591

#4592

#4593

#4593

#4595

#4597

#4598

#4599

#46

#460

#4600

#4601

#4602

#4603

#4604

#4606

#4608

#4609

#461

#4611

#4612

#4614

#4615

#4616

#4617

#4618

#4619

#462

#4620

#4621

#4622

#4623

#4624

#4627

#4629

#463

#4630

#4631

#4632

#4633

#4634

#4635

#4636

#4637

#464

#4640

#4641

#4642

#4645

#4646

#4647

#465

#4650

#4653

#4654

#4655

#4656

#4657

#4658

#4659

#4659

#4663

#4665

#4666

#4667

#4669

#467

#4670

#4671

#4672

#4673

#4674

#4676

#4678

#4680

#4683

#4684

#4685

#4686

#4689

#469

#4690

#4692

#4693

#4694

#4695

#4696

#4697

#4698

#4699

#47

#470

#4700

#4701

#4702

#4703

#4704

#4706

#4707

#4708

#4709

#471

#4710

#4712

#4713

#4715

#4716

#4718

#472

#4720

#4721

#4722

#4723

#4724

#4725

#4726

#4727

#4728

#4729

#473

#4730

#4731

#4732

#4733

#4734

#4735

#4736

#4738

#474

#4740

#4741

#4742

#4743

#4745

#4748

#4749

#475

#4750

#4752

#4753

#4754

#4755

#4757

#4758

#476

#4763

#4764

#4765

#4766

#4768

#477

#4770

#4771

#4772

#4773

#4774

#4775

#4777

#4778

#4779

#478

#4784

#4786

#4787

#4788

#4789

#479

#4790

#4791

#4792

#4793

#4794

#4795

#4796

#4798

#4799

#48

#480

#4800

#4801

#4802

#4804

#4805

#4807

#4808

#4809

#481

#4810

#4811

#4812

#4813

#4814

#4815

#4816

#4817

#4819

#482

#4820

#4821

#4822

#4823

#4824

#4825

#4827

#4828

#483

#4830

#4831

#4832

#4834

#4836

#4837

#4838

#484

#4840

#4841

#4842

#4843

#4846

#4849

#4849

#485

#4850

#4851

#4852

#4853

#4854

#4856

#4858

#486

#4860

#4861

#4864

#4866

#4869

#487

#4872

#4873

#4874

#4876

#4877

#4878

#488

#4883

#4884

#4886

#4887

#4889

#489

#4890

#4893

#4894

#4895

#4896

#4897

#4898

#49

#490

#4900

#4901

#4902

#4904

#4905

#4907

#4908

#4909

#491

#4910

#4911

#4914

#4915

#4916

#4917

#4918

#4919

#492

#4920

#4921

#4922

#4923

#4925

#4926

#4927

#4928

#493

#4932

#4933

#4934

#4935

#4936

#4937

#4938

#4940

#4942

#4943

#4945

#4946

#4947

#4948

#4949

#495

#4950

#4951

#4952

#4953

#4954

#4959

#496

#4963

#4965

#4966

#4967

#497

#4972

#4975

#4976

#4976

#4977

#4978

#498

#4981

#4982

#4983

#4988

#4989

#4990

#4991

#4992

#4993

#4995

#4996

#4998

#5

#50

#500

#5001

#5001

#5002

#5007

#5008

#5009

#501

#5012

#5014

#5015

#5017

#5018

#502

#5020

#5022

#5023

#5024

#5025

#503

#5031

#5032

#5033

#5035

#5036

#504

#5043

#5044

#5046

#5047

#5048

#505

#5051

#5052

#5053

#5055

#5057

#5058

#5059

#506

#5060

#5062

#5063

#5064

#5065

#5067

#5069

#507

#5070

#5071

#5072

#5073

#5074

#5076

#5077

#5078

#5079

#508

#5080

#5081

#5082

#5082

#5084

#5085

#5086

#5087

#5088

#5089

#509

#5090

#5092

#5093

#5095

#5096

#5097

#5098

#5099

#51

#510

#5100

#5102

#5103

#5105

#5106

#5107

#511

#5111

#5112

#5113

#5114

#5115

#5116

#5117

#5118

#512

#5120

#5120

#5121

#5122

#5123

#5124

#5125

#5127

#5128

#5129

#513

#5130

#5131

#5132

#5133

#5134

#5135

#5138

#514

#5140

#5141

#5143

#5146

#5147

#5148

#5149

#515

#5150

#5153

#5155

#5155

#5156

#5157

#5158

#5159

#516

#5160

#5160

#5161

#5162

#5164

#5165

#5166

#5169

#517

#5170

#5171

#5172

#5173

#5176

#5177

#5178

#518

#5181

#5183

#5186

#5189

#519

#5190

#5192

#5194

#5196

#5199

#52

#520

#5201

#5202

#5206

#5207

#5209

#521

#5210

#5214

#5216

#5217

#5219

#522

#5224

#5225

#5227

#5228

#5229

#5230

#5231

#5232

#5233

#5234

#5235

#5236

#5237

#5238

#5239

#5240

#5241

#5242

#5246

#5247

#5248

#5248

#5249

#525

#5250

#5251

#5252

#5253

#5254

#5255

#5256

#5257

#5258

#5258

#526

#5260

#5261

#5262

#5263

#5264

#5265

#5265

#5267

#5267

#5268

#5269

#527

#5270

#5272

#5273

#5274

#5275

#5276

#5277

#5278

#5279

#528

#5280

#5281

#5282

#5283

#5284

#5285

#5286

#5287

#5288

#5289

#529

#5291

#5292

#5294

#5294

#5295

#5296

#5297

#5298

#5299

#53

#530

#5301

#5302

#5303

#5304

#5306

#5307

#5308

#5309

#531

#5310

#5311

#5313

#5314

#5315

#5316

#5317

#5318

#532

#5320

#5321

#5322

#5324

#5325

#5326

#5327

#5329

#533

#5330

#5331

#5332

#5333

#5334

#5335

#5336

#5337

#5338

#5339

#5340

#5341

#5342

#5343

#5344

#5345

#5346

#5347

#5348

#5349

#535

#5350

#5351

#5352

#5353

#5354

#5355

#5356

#5357

#5358

#536

#5360

#5361

#5362

#5363

#5364

#5365

#5366

#5367

#5368

#5369

#537

#5371

#5372

#5373

#5374

#5375

#5376

#5377

#5378

#5379

#538

#5380

#5382

#5383

#5384

#5386

#5388

#5389

#539

#5390

#5392

#5395

#5396

#5398

#5399

#54

#540

#5400

#5401

#5402

#5403

#5404

#5405

#5406

#5407

#5408

#541

#5411

#5412

#5413

#5415

#5416

#5417

#5418

#542

#5420

#5422

#5423

#5424

#5425

#5427

#5428

#5429

#543

#5430

#5431

#5432

#5433

#5434

#5435

#5437

#5438

#5440

#5441

#5442

#5444

#5445

#5446

#5447

#5448

#5449

#545

#5451

#5452

#5454

#5455

#5456

#5457

#546

#5460

#5461

#5462

#5465

#5468

#5469

#547

#5470

#5471

#5472

#5473

#5476

#5477

#5477

#5479

#548

#5480

#5484

#5485

#5486

#5486

#5489

#549

#5490

#5491

#5493

#5493

#5495

#5496

#5497

#5498

#5499

#55

#5500

#5501

#5502

#5503

#5504

#5506

#5508

#551

#5510

#5511

#5512

#5514

#5515

#5517

#5518

#5519

#552

#5520

#5522

#5523

#5524

#5525

#5526

#5528

#5529

#553

#5530

#5531

#5532

#5533

#5535

#5537

#554

#5541

#5543

#5544

#5544

#5545

#5546

#5548

#555

#5550

#5551

#5552

#5554

#5556

#5557

#5558

#5559

#556

#5561

#5563

#5565

#5566

#5567

#5568

#5569

#5570

#5572

#5574

#5575

#5576

#5577

#5578

#5579

#558

#5580

#5581

#5582

#5583

#5584

#5586

#5588

#5589

#559

#5590

#5591

#5592

#5593

#5596

#5598

#5599

#5602

#5603

#5604

#5605

#5606

#5607

#5608

#5609

#561

#5610

#5611

#5612

#5613

#5614

#5619

#5620

#5621

#5622

#5623

#5624

#5625

#5626

#5627

#5628

#5629

#563

#5630

#5631

#5632

#5633

#5634

#5635

#5636

#5637

#5638

#5639

#564

#5640

#5642

#5643

#5644

#5645

#5646

#5647

#5648

#5649

#565

#5650

#5651

#5652

#5653

#5654

#5655

#5656

#5657

#5658

#5659

#566

#5660

#5660

#5661

#5663

#5665

#5666

#5668

#5668

#567

#5670

#5674

#5675

#5676

#5677

#5678

#5679

#568

#5680

#5681

#5682

#5684

#5685

#5686

#5687

#5688

#5689

#569

#5690

#5691

#5692

#5693

#5694

#5695

#5696

#5697

#5698

#5699

#57

#570

#5700

#5701

#5702

#5703

#5704

#5705

#5706

#5707

#5708

#571

#5710

#5711

#5712

#5713

#5714

#5715

#5715

#5716

#5717

#5719

#572

#5720

#5722

#5723

#5724

#5725

#5727

#573

#5730

#5731

#5733

#5734

#5734

#5735

#5736

#5737

#5738

#5739

#574

#5740

#5741

#5742

#5743

#5744

#5745

#5746

#5747

#5748

#5749

#575

#5750

#5751

#5752

#5753

#5754

#5755

#5756

#5756

#5758

#5759

#576

#5760

#5761

#5763

#5764

#5765

#5766

#5767

#5769

#577

#5770

#5771

#5772

#5772

#5774

#5775

#5776

#5777

#5779

#578

#5780

#5781

#5782

#5783

#5784

#5785

#5786

#5787

#5788

#5789

#579

#5790

#5791

#5793

#5794

#5796

#5797

#5799

#58

#580

#5800

#5801

#5802

#5803

#5804

#5806

#5807

#5808

#5809

#581

#5810

#5811

#5812

#5813

#5814

#5815

#5816

#5817

#5818

#5819

#582

#5820

#5821

#5822

#5823

#5824

#5825

#5827

#5828

#5829

#583

#5832

#5833

#5835

#5836

#5837

#5838

#5839

#584

#5840

#5842

#5843

#5844

#5845

#5846

#5847

#5848

#5849

#585

#5850

#5851

#5852

#5854

#5856

#5857

#5858

#5859

#586

#5860

#5862

#5863

#5864

#5867

#5868

#5870

#5871

#5872

#5874

#5875

#5876

#5877

#5877

#5878

#5879

#5881

#5882

#5883

#5884

#5885

#5888

#5889

#589

#5891

#5892

#5893

#5894

#5895

#5896

#5897

#5898

#5899

#59

#590

#5901

#5902

#5903

#5904

#5905

#591

#5910

#5911

#5912

#5917

#5918

#5919

#592

#5921

#5922

#5923

#5924

#5925

#5928

#593

#5931

#5932

#5934

#5936

#5938

#5939

#5939

#594

#5941

#5942

#5944

#5945

#5946

#5947

#595

#5950

#5951

#5952

#5953

#5956

#5957

#5958

#5959

#596

#5961

#5962

#5963

#5966

#5967

#5968

#597

#5970

#5973

#5975

#5976

#5977

#5978

#5979

#598

#5980

#5981

#5982

#5984

#5985

#5989

#599

#5990

#5991

#5993

#5994

#5995

#5997

#5998

#6

#60

#6000

#6001

#6002

#6003

#6004

#6005

#6006

#6007

#6008

#6009

#601

#6010

#6011

#6012

#6013

#6014

#6015

#6015

#6016

#6017

#6018

#6020

#6022

#6023

#6024

#6026

#6029

#603

#6030

#6031

#6033

#6034

#6035

#6035

#6036

#6038

#604

#6040

#6041

#6042

#6043

#6044

#6045

#6046

#6048

#6050

#6051

#6052

#6053

#6054

#6055

#6056

#6057

#6059

#6060

#6061

#6062

#6063

#6064

#6065

#6068

#6069

#607

#6070

#6071

#6072

#6073

#6073

#6074

#6075

#6077

#6078

#608

#6080

#6081

#6081

#6082

#6083

#6084

#6085

#6086

#6087

#6088

#6089

#609

#6090

#6092

#6093

#6094

#6096

#6098

#6099

#61

#610

#6100

#6104

#6104

#6106

#6107

#6109

#611

#6113

#6113

#6114

#6115

#6116

#6117

#6118

#6118

#6119

#6119

#612

#6121

#6122

#6122

#6123

#6124

#6124

#6125

#6125

#6126

#6127

#6127

#6128

#6129

#613

#6130

#6130

#6131

#6132

#6134

#6135

#6136

#6137

#6139

#614

#6140

#6141

#6142

#6143

#6144

#6144

#6145

#6145

#6146

#6147

#6148

#6149

#615

#6150

#6150

#6151

#6151

#616

#617

#618

#619

#62

#620

#621

#622

#623

#624

#625

#626

#627

#628

#629

#63

#630

#631

#632

#633

#634

#635

#636

#637

#638

#639

#64

#640

#641

#642

#645

#646

#647

#648

#649

#649

#65

#652

#655

#656

#657

#659

#66

#660

#661

#662

#664

#666

#667

#668

#67

#672

#673

#678

#679

#681

#683

#686

#687

#69

#691

#692

#694

#695

#699

#7

#70

#700

#701

#704

#705

#706

#707

#708

#71

#710

#711

#712

#715

#717

#717

#719

#72

#721

#723

#724

#725

#726

#727

#728

#729

#73

#730

#731

#732

#735

#738

#739

#74

#740

#741

#742

#743

#746

#747

#748

#749

#75

#750

#751

#752

#753

#754

#756

#758

#76

#760

#762

#763

#764

#765

#766

#769

#77

#770

#771

#772

#773

#775

#777

#779

#78

#781

#783

#784

#785

#788

#789

#79

#790

#791

#792

#793

#795

#797

#798

#799

#8

#80

#800

#801

#802

#803

#804

#805

#806

#807

#808

#809

#81

#810

#811

#812

#813

#815

#816

#818

#819

#82

#820

#821

#822

#823

#824

#825

#826

#827

#828

#829

#83

#830

#831

#832

#833

#834

#835

#837

#838

#839

#84

#840

#842

#843

#844

#845

#846

#847

#848

#849

#850

#852

#853

#854

#855

#856

#857

#858

#859

#86

#860

#861

#862

#863

#864

#865

#866

#867

#868

#869

#87

#870

#871

#872

#873

#874

#875

#876

#877

#878

#879

#88

#880

#881

#886

#887

#888

#889

#890

#893

#894

#895

#896

#897

#898

#899

#9

#90

#900

#901

#902

#903

#904

#905

#907

#909

#91

#910

#911

#912

#913

#914

#915

#916

#917

#918

#919

#92

#920

#921

#922

#923

#927

#928

#929

#93

#931

#932

#933

#934

#935

#936

#937

#938

#939

#94

#940

#941

#942

#943

#944

#945

#946

#947

#948

#949

#95

#950

#951

#952

#953

#954

#955

#956

#957

#958

#959

#96

#960

#961

#962

#963

#964

#965

#966

#967

#968

#969

#97

#970

#971

#972

#973

#974

#975

#976

#977

#978

#979

#98

#980

#981

#982

#983

#984

#986

#987

#99

#992

#997

#998

#999

v0.0.1-beta

v0.0.2

v0.1.0

v0.1.1

v0.1.10

v0.1.11rc1

v0.1.11rc2

v0.1.11rc3

v0.1.11rc4

v0.1.11rc5

v0.1.12

v0.1.13

v0.1.2

v0.1.3

v0.1.4

v0.1.5

v0.1.6

v0.1.7

v0.1.8

v0.1.9

v0.2.0

v0.2.1

v0.2.2

v0.2.3

v0.2.4

v0.2.5

v0.2.6

v0.2.7

v0.2.8

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.3.6

v0.3.7

v0.3.8

v0.3.9

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.4.6

Mono Color

• 953d3a341c
  Merge b9ac0a6808 into dac0e07b13 #6081 flybird11111 2024-10-14 11:50:10 +0800
• e1e86f9f1f fix wangbluo 2024-10-14 11:45:35 +0800
• 6fef58bf50 improve method arg names, add more perf. comments and TODOs Edenzzzz 2024-10-12 21:23:34 +0000
• 3273eb52ab update Edenzzzz 2024-10-12 19:42:15 +0000
• 4a6d73ef67 update Edenzzzz 2024-10-12 19:29:47 +0000
• cba8b33faa update Edenzzzz 2024-10-11 16:49:09 +0000
• 4c8e85ee0d
  [Coati] Train DPO using PP (#6054) Tong Li 2024-10-11 19:32:00 +0800
• 703bb5c18d fix the test wangbluo 2024-10-11 17:34:20 +0800
• 4e0e99bb6a fix the test wangbluo 2024-10-11 17:31:40 +0800
• 0ca16d5cbe [fix] fix llama, mixtral benchmark zbv loss none bug; update mixtral & llama policy and modeling; duanjunwen 2024-10-11 07:32:43 +0000
• 1507a7528f fix wangbluo 2024-10-11 06:20:34 +0000
• 0002ae5956 fix wangbluo 2024-10-11 14:16:21 +0800
• dac0e07b13
  [zero bubble] support zero (#6080) flybird11111 2024-10-11 14:14:05 +0800
• d71660217d polish code #6054 Tong Li 2024-10-11 05:47:48 +0000
• dc2cdaf3e8
  [shardformer] optimize seq parallelism (#6086) Hongxin Liu 2024-10-11 13:44:40 +0800
• 4bd3d5fc53 fix #6080 flybird11111 2024-10-11 03:17:43 +0000
• 205d364af2 [shardformer] fix gpt2 fused linear reduce #6086 ver217 2024-10-10 19:12:39 +0800
• efe3042bb2 fix wangbluo 2024-10-10 18:38:47 +0800
• 64a43beab9 [test] update gpt2 fused linear test ver217 2024-10-10 17:34:16 +0800
• 4ede27432c [plugin] update moe hybrid plugin ver217 2024-10-10 17:32:58 +0800
• f2e9a1ad86 [plugin] update gemini plugin ver217 2024-10-10 17:31:55 +0800
• b50f0ad158 [shardformer] fix gpt2 fused linear col ver217 2024-10-10 17:30:51 +0800
• 6b2c506fc5
  Update README.md (#6087) 梁爽 2024-10-10 17:02:49 +0800
• bcbd311bc3
  Update README.md #6087 supercooledith-patch-1 梁爽 2024-10-10 16:52:55 +0800
• 60d3ff11a0 [shardformer] optimize seq parallelism ver217 2024-10-10 15:44:32 +0800
• 5ecc27e150 fix wangbluo 2024-10-10 15:35:52 +0800
• f98384aef6 fix wangbluo 2024-10-10 15:17:06 +0800
• e234dfa236 [feat] support MixtralPipelineForwards--> mixtral_for_causal_lm_forward for zbv duanjunwen 2024-10-10 06:57:35 +0000
• 646b3c5a90
  [shardformer] fix linear 1d row and support uneven splits for fused qkv linear (#6084) Hongxin Liu 2024-10-10 14:34:45 +0800
• 72b507a7be [feat] update MixtralPipelineForwards --> mixtral_model_forward; support zbv; duanjunwen 2024-10-10 06:19:51 +0000
• 9ee80fc828 [fix] MixtralForCausalLMPolicy get_held_layer support zbv; duanjunwen 2024-10-10 05:40:22 +0000
• 1d726399b3 [tp] fix gather fused and add fused linear row #6084 ver217 2024-10-10 10:45:50 +0800
• 9557d28fe0 update Edenzzzz 2024-10-09 17:07:36 +0000
• 12bac5e039 improve comments Edenzzzz 2024-10-09 15:25:38 +0000
• c823dc82e9 improve comments Edenzzzz 2024-10-09 15:24:08 +0000
• b6e5f9da2e [tp] fix gpt2 mlp policy ver217 2024-10-09 16:41:56 +0800
• 71f6c14cfd [tp] support sp for fused linear ver217 2024-10-09 15:51:21 +0800
• e78689faa2 [tp] support uneven split for fused linear ver217 2024-10-09 15:43:22 +0800
• d46c8b2b06 [tp] hotfix linear row ver217 2024-10-09 15:43:00 +0800
• b635dd0669 fix wangbluo 2024-10-09 14:05:26 +0800
• 3f5bec8dc4 [feat] support zbv in mixtral benchmark; #6082 duanjunwen 2024-10-09 03:58:01 +0000
• 3532f77b90 fix wangbluo 2024-10-09 10:57:19 +0800
• 531773ff54
  Merge pull request #6077 from duanjunwen/dev/zero_bubble duanjunwen 2024-10-09 10:22:14 +0800
• b9ac0a6808 fix #6081 flybird11111 2024-10-08 13:08:13 +0000
• d50c0a1e0a example support zbv flybird11111 2024-10-08 11:25:08 +0000
• 42f2d0b1ff suport zbv all flybird11111 2024-10-08 11:14:23 +0000
• 97b146a1b3 fix flybird11111 2024-10-08 10:31:53 +0000
• 035f87ca69 fix flybird11111 2024-10-08 10:30:55 +0000
• cc500b3e25 [fix] fix mixtral policy; #6077 duanjunwen 2024-10-08 09:34:09 +0000
• 292a504bea [fix] fix mixtral policy; duanjunwen 2024-10-08 09:25:11 +0000
• a5f06706cb zbv support zero flybird11111 2024-10-08 09:02:18 +0000
• 1637c14af8 Merge branch 'feature/zerobubble' of github.com:flybird11111/ColossalAI into feature/zerobubble flybird11111 2024-10-08 08:56:56 +0000
• f4d023ca6e Merge branch 'feature/zerobubble' of github.com:hpcaitech/ColossalAI into dev/zero_bubble duanjunwen 2024-10-08 08:13:17 +0000
• 295dd2d9fe
  [zerobubble] rebase main (#6075) flybird11111 2024-10-08 15:58:00 +0800
• ceadef35d5 fix #6073 wangbluo 2024-10-07 10:29:58 +0800
• 6975c50f78 [fix] fix build ci; duanjunwen 2024-09-30 02:34:54 +0000
• 5c8bbf63a8 [feat] update optimizer bwd; ä¸ duanjunwen 2024-09-29 09:59:41 +0000
• d63479553c [feat] zerobubble support moehybridplugin; duanjunwen 2024-09-29 08:33:55 +0000
• 797d1ed6c9 [pre-commit.ci] auto fixes from pre-commit.com hooks #6075 pre-commit-ci[bot] 2024-09-29 07:57:38 +0000
• 3251e68049
  Merge branch 'feature/zerobubble' into feature/zerobubble flybird11111 2024-09-29 15:56:54 +0800
• 076794800d [plugin] hybrid support zero bubble pipeline (#6060) flybird11111 2024-09-27 14:48:55 +0800
• 993f3db3dc [fix] fix fwd branch, fwd pass both micro_batch & internal_inputs' duanjunwen 2024-09-20 07:34:43 +0000
• 9e90356175 [fix] fix mem assert; duanjunwen 2024-09-19 08:27:47 +0000
• df12ae7324 [fix] fix model zoo import; duanjunwen 2024-09-09 06:39:33 +0000
• 78ed432ba4 [fix] fix mem; use a new model shape; only assert mem less and equal than theo; duanjunwen 2024-09-09 06:38:31 +0000
• 93b3604f85 [fix] fix mem assertation duanjunwen 2024-09-09 05:41:39 +0000
• e666f5c6db [fix] fix mem check; duanjunwen 2024-09-04 10:57:38 +0000
• 7ba031dae0 [fix] fix bwd step if condition; remove useless comments and format info; duanjunwen 2024-09-03 08:56:08 +0000
• 4420dc130a [fix] rm output.data after send fwd; duanjunwen 2024-09-03 14:12:17 +0800
• 355a3afd02 [fix] fix optim bwd; duanjunwen 2024-09-03 02:40:26 +0000
• fe99ca329f [fix] fix optim bwd; duanjunwen 2024-09-02 11:19:42 +0000
• 262b27e37e [feat] update test; rm comments; duanjunwen 2024-09-02 09:50:47 +0000
• 4ac0d6ef70 [fix] fix optim bwd; add license for v_schedule; remove redundant attributes; fix schedule loop "while"--> "for"; add communication dict; duanjunwen 2024-08-30 05:42:43 +0000
• 93ede6b5c6 [feat] fix optimizer bwd b & w; support return accum loss & output duanjunwen 2024-08-29 08:54:45 +0000
• 21bf510862 [feat] add optim backward_b_by_grad duanjunwen 2024-08-29 03:16:59 +0000
• 0055c473e5 [fix] fix poc test; add comments in poc; duanjunwen 2024-08-28 05:47:53 +0000
• 49d68ebd01 [feat] fix poc format duanjunwen 2024-08-28 03:08:35 +0000
• d44e7e698d [feat] add test run_fwd_bwd automatic scheduling; duanjunwen 2024-08-26 11:21:56 +0000
• 28ee5a761c [update] update text; duanjunwen 2024-08-26 04:00:51 +0000
• 21c62b6e64 [feat] add zerobubble pp (just a frame now); add POC test for dx_dw; add test for zerobubble; duanjunwen 2024-08-22 10:25:34 +0000
• 2fd9d3e26a [plugin] hybrid support zero bubble pipeline (#6060) flybird11111 2024-09-27 14:48:55 +0800
• 4d3eaee48c [fix] fix test_pipeline_utils ci; duanjunwen 2024-09-26 07:18:16 +0000
• a3a797da20 [fix] fix zerobubble; support shardformer model type; duanjunwen 2024-09-26 06:11:56 +0000
• 8bc8bb0b14 [fix] fix pipeline util func deallocate --> release_tensor_data; fix bwd_b loss bwd branch; duanjunwen 2024-09-20 09:48:35 +0000
• 78a439ba5e [fix] fix fwd branch, fwd pass both micro_batch & internal_inputs' duanjunwen 2024-09-20 07:34:43 +0000
• f8d6f9853e [fix] fix mem assert; duanjunwen 2024-09-19 08:27:47 +0000
• 8ce22ae955 [fix] fix require_grad & deallocate call; duanjunwen 2024-09-19 05:53:03 +0000
• 3e2f2601de [fix] fix zerobubble pp for shardformer type input; duanjunwen 2024-09-18 07:14:34 +0000
• 9094cc35dd [feat] moehybrid support zerobubble; duanjunwen 2024-09-12 02:51:46 +0000
• 2683d26b71 [fix] fix model zoo import; duanjunwen 2024-09-09 06:39:33 +0000
• e80179c401 [fix] fix mem; use a new model shape; only assert mem less and equal than theo; duanjunwen 2024-09-09 06:38:31 +0000
• ae4cf5b883 [fix] fix mem assertation duanjunwen 2024-09-09 05:41:39 +0000
• 0825700e0f [fix] fix mem check; duanjunwen 2024-09-04 10:57:38 +0000
• 497d545525 [fix] fix bwd step if condition; remove useless comments and format info; duanjunwen 2024-09-03 08:56:08 +0000
• 4249a368d9 [fix] rm output.data after send fwd; duanjunwen 2024-09-03 14:12:17 +0800
• f347591b06 [fix] fix optim bwd; duanjunwen 2024-09-03 02:40:26 +0000
• ad8ad64b4a [fix] fix optim bwd; duanjunwen 2024-09-02 11:19:42 +0000
• cc5e7dcfa2 [fix] rm zbv in hybridplugin duanjunwen 2024-09-02 10:00:43 +0000
• 94a12f6ece [feat] update test; rm comments; duanjunwen 2024-09-02 09:50:47 +0000
• 5df5965b2e [fix] fix optim bwd; add license for v_schedule; remove redundant attributes; fix schedule loop "while"--> "for"; add communication dict; duanjunwen 2024-08-30 05:42:43 +0000