Deep Learning Frameworks994 / 60 projects

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A high-throughput and memory-efficient inference and serving engine for LLMs

The fastest path to AI-powered full stack observability, even for lean teams.

scikit-learn: machine learning in Python

Deep Learning for humans

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, including supervised learning, market dynamics modeling, and RL, and is now equipped with https://github.com/microsoft/RD-Agent to automate R&D process.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Making large AI models cheaper, faster and more accessible

Caffe: a fast open framework for deep learning.

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

The fastai deep learning library

Label Studio is a multi-type data labeling and annotation tool with standardized output format

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

The Modular Platform (includes MAX & Mojo)

LabelImg is now part of the Label Studio community. The popular image annotation tool created by Tzutalin is no longer actively being developed, but you can check out Label Studio, the open source data labeling tool for images, text, hypertext, audio, video and time-series data.

Faster Whisper transcription with CTranslate2

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Graph Neural Network Library for PyTorch

ncnn is a high-performance neural network inference framework optimized for the mobile platform

☁️ Build multimodal AI applications with cloud-native stack

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Open standard for machine learning interoperability

A WebGL accelerated JavaScript library for training and deploying ML models.

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

High-performance In-browser LLM Inference Engine

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Fast and accurate AI powered file content types detection

Datasets, Transforms and Models specific to Computer Vision

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

Topic Modelling for Humans

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

Machine Learning Toolkit for Kubernetes

🦉 Data Versioning and ML Experiments

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

Tensor library for machine learning

Nano vLLM

Image augmentation for machine learning experiments.

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

NLTK Source

ChatterBot is a machine learning, conversational dialog engine for creating chat bots

A toolkit for making real world machine learning and data analysis applications in C++

A very simple framework for state-of-the-art Natural Language Processing (NLP)

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Open-source simulator for autonomous driving research.

Open3D: A Modern Library for 3D Data Processing

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

Open Machine Learning Compiler Framework

A Library for Advanced Deep Time Series Models for General Time Series Analysis.

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Turi Create simplifies the development of custom machine learning models.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Refine high-quality datasets and visual AI models

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

An elegant PyTorch deep reinforcement learning library.

Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.

Large Language Model Text Generation Inference

Open source annotation tool for machine learning practitioners.

Fast and Accurate ML in 3 Lines of Code

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Content aware image resize library

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

Build, Manage and Deploy AI/ML Systems

A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.

X-AnyLabeling: A lightweight, efficient, and unified cross-platform desktop application for annotating text, image, video, and multimodal data, combining versatile built-in tools with state-of-the-art AI models and flexible multi-format export.

A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.

TensorFlow-based neural network library

Open-source, low-code AutoML platform for Python. PyCaret 4.0: sklearn-native engine + React control plane.

AI powered open source recommender system engine supports classical/LLM rankers and multimodal content via embedding

Deep learning library featuring a higher-level API for TensorFlow.

A python library for user-friendly forecasting and anomaly detection on time series.

Gathers machine learning and deep learning models for Stock forecasting including trading bots and simulations

Containers for machine learning

Running large language models on a single GPU for throughput-oriented scenarios.

ML.NET is an open source and cross-platform machine learning framework for .NET.

AutoML library for deep learning

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

ModelScope: bring the notion of Model-as-a-Service to life.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

The backtesting engine that gives you an unfair advantage. Run thousands of trading ideas before others finish one.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

Accessible large language models via k-bit quantization for PyTorch.

DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.

Production infrastructure for machine learning at scale

An open source python library for automated feature engineering

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, OpenCV Contrib, and OpenVINO.

Deep Learning and Reinforcement Learning Library for Scientists and Engineers

Visualizations for machine learning datasets

Easy Docker setup for Stable Diffusion with user-friendly UI

Alluxio, data orchestration for analytics and machine learning in the cloud

The Open Source Feature Store for AI/ML

🔮 Libraries & tools for enabling Machine Learning driven user-experiences on the web

A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning

Flower: A Friendly Federated AI Framework

The AI search platform

Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Postgres with GPUs for ML/AI apps.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

A Python scikit for building and analyzing recommender systems

A Flexible and Powerful Parameter Server for large-scale machine learning

Friendly machine learning for the web! 🤖

Transformer related optimization, including BERT, GPT

A flexible, high-performance serving system for machine learning models

The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.

A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

FlashInfer: Kernel Library for LLM Serving

Swift for TensorFlow

Time series Timeseries Deep Learning Machine Learning Python Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai

The Swift machine learning library.

A system for quickly generating training data with weak supervision

A framework for efficient model inference with omni-modality models

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

mlpack: a fast, header-only C++ machine learning library

A general-purpose encoder-decoder framework for Tensorflow

Deep Reinforcement Learning for Keras.

High-performance TensorFlow library for quantitative finance.

A C++ standalone library for machine learning

Build Graph Nets in Tensorflow

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.

Superduper: End-to-end framework for building custom AI applications and agents.

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/multiplatform CPU, AMD, NVIDIA GPU PyTorch support; voice-mixing, auto-stitching, captioned timestamps

cuML - RAPIDS Machine Learning Library

Simple and Distributed Machine Learning

Probabilistic time series modeling in Python

Brings SQL and AI together.

A library of extension and helper modules for Python's data analysis and machine learning libraries.

Image augmentation library in Python for machine learning.

A Python implementation of LightFM, a hybrid recommendation algorithm.

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，mlops算法链路全流程，算力租赁平台，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU虚拟化，边缘计算，标注平台自动化标注，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库，AI模型市场，支持国产cpu/gpu/npu 昇腾生态，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano等分布式

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

A machine learning software for extracting information from scholarly documents

Time series forecasting with PyTorch

Run Keras models in the browser, with GPU support using WebGL

Optimized primitives for collective multi-GPU communication

MlFinLab helps portfolio managers and traders who want to leverage the power of machine learning by providing reproducible, interpretable, and easy to use tools.

An easy to use PyTorch to TensorRT converter

On-device AI across mobile, embedded and edge for PyTorch

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

Lightning ⚡️ fast forecasting with statistical and econometric models.

A probabilistic programming language in TensorFlow. Deep generative models, variational inference.

An Engine-Agnostic Deep Learning Framework in Java

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T

MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to bring automation to complex causal inference problems. To date, the ALICE Python SDK (econml) implements orthogonal machine learning algorithms such as the double machine learning work of Chernozhukov et al. This toolkit is designed to measure the causal effect of some treatment variable(s) t on an outcome variable y, controlling for a set of features x.

Relax! Flux is the ML library that doesn't make you tensor

A Rust machine learning framework.

JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.

Data augmentation for NLP

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

Fast inference engine for Transformer models

🤗 AutoTrain Advanced

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.

Tengine is a lite, high performance, modular inference engine for embedded device

Lightning fast C++/CUDA neural network framework

A unified, comprehensive and efficient recommendation library

Merlion: A Machine Learning Framework for Time Series Intelligence

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

Visual Object Tagging Tool: An electron app for building end to end Object Detection Models from Images and Videos.

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

Simplify your onnx model

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

A JavaScript deep learning and reinforcement learning library.

Massively Parallel Deep Reinforcement Learning. 🔥

Serve, optimize and scale PyTorch models in production

A library for scientific machine learning and physics-informed learning

NeuralProphet: A simple forecasting package

modular quant framework.