|
|
|
@ -6,7 +6,7 @@ All notable changes to this project will be documented in this file. |
|
|
|
|
|
|
|
|
|
|
|
### Added |
|
|
|
### Added |
|
|
|
|
|
|
|
|
|
|
|
- Unifed distributed layers |
|
|
|
- Unified distributed layers |
|
|
|
- MoE support |
|
|
|
- MoE support |
|
|
|
- DevOps tools such as github action, code review automation, etc. |
|
|
|
- DevOps tools such as github action, code review automation, etc. |
|
|
|
- New project official website |
|
|
|
- New project official website |
|
|
|
@ -33,4 +33,4 @@ The first beta version of Colossal-AI. Thanks to all contributors for the effort |
|
|
|
### Added |
|
|
|
### Added |
|
|
|
|
|
|
|
|
|
|
|
- Initial architecture of the system |
|
|
|
- Initial architecture of the system |
|
|
|
- Features such as tensor parallelism, gradient clipping, gradient accumulation |
|
|
|
- Features such as tensor parallelism, gradient clipping, gradient accumulation |
|
|
|
|
sohn
3 years ago
committed by