CTranslate2

Name: CTranslate2
Availability: OnlineOnly
Rating: 2.0 (4614 reviews)
Author: OpenNMT

OpenNMT/CTranslate2

Fast inference engine for Transformer models

★4.6kstars

C++

MIT

Updated: Today

GitHub

OpenNMT/CTranslate2

🏗️

📋 Project at a Glance

Tap to expand

What's this?Data & Infrastructure project leveraging avx and avx2, built with C++, open-source

Who made it?Maintained by OpenNMT team, 4.6K⭐ on GitHub, #399 out of 3133 in Data & Infrastructure

Why does it exist?As the Data & Infrastructure landscape evolved, the OpenNMT team identified the need for better avx solutions. CTranslate2 was created to simplify avx2 workflows.

What can it do?Key use cases: cpp, cuda, deep-learning

How to install with AI?Use an AI coding assistant to follow the README and automatically handle the install and environment setup.
🔗 github.com/OpenNMT/CTranslate2 | 官网 https://opennmt.net/CTranslate2

Topics

avxavx2cppcudadeep-learningdeep-neural-networksgemminferenceintrinsicsmachine-translationmklneonneural-machine-translationonednnopenmpopennmtparallel-computingquantizationthrusttransformer-models

More Data & Infrastructure projects ← Back to All Rankings

🔗 More tools-infra projects

sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based

★ 1.2kPython

umesimd

UME::SIMD A library for explicit simd vectorization.

★ 90C++

llama.cpp

C/C++ implementation of LLM inference. Runs on CPU, GPU, and edge devices. Suppo

★ 78.0kC

faster-whisper

Faster Whisper transcription with CTranslate2

★ 24.8kPython

CTranslate2

OpenNMT/CTranslate2

Fast inference engine for Transformer models

★4.6kstars

C++

MIT

Updated: Today

GitHub

OpenNMT/CTranslate2

🏗️

📋 Project at a Glance

Tap to expand

What's this?Data & Infrastructure project leveraging avx and avx2, built with C++, open-source

Who made it?Maintained by OpenNMT team, 4.6K⭐ on GitHub, #399 out of 3133 in Data & Infrastructure

Why does it exist?As the Data & Infrastructure landscape evolved, the OpenNMT team identified the need for better avx solutions. CTranslate2 was created to simplify avx2 workflows.

What can it do?Key use cases: cpp, cuda, deep-learning

Topics

avxavx2cppcudadeep-learningdeep-neural-networksgemminferenceintrinsicsmachine-translationmklneonneural-machine-translationonednnopenmpopennmtparallel-computingquantizationthrusttransformer-models

More Data & Infrastructure projects ← Back to All Rankings

🔗 More tools-infra projects

sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based

★ 1.2kPython

umesimd

UME::SIMD A library for explicit simd vectorization.

★ 90C++

llama.cpp

C/C++ implementation of LLM inference. Runs on CPU, GPU, and edge devices. Suppo

★ 78.0kC

faster-whisper

Faster Whisper transcription with CTranslate2

★ 24.8kPython