A high-throughput and memory-efficient inference and serving engine for LLMs
-
Updated
Sep 20, 2024 - Python
A high-throughput and memory-efficient inference and serving engine for LLMs
The Open Source Feature Store for Machine Learning
Materials for the useR!2024 conference workshop "Deploy and Monitor ML Pipelines with R, Open Source, and Free Applications"
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
Simple server to manage compound AI
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
Production Grade Nifi & Nifi Registry. Deploy for VM (Virtual Machine) with Terraform + Ansible, Helm & Helmfile for Kubernetes (EKS)
Label Studio is a multi-type data labeling and annotation tool with standardized output format
Materials for the AI Dev 2024 conference workshop "Deploy and Monitor ML Pipelines with Python, Open Source, and Free Applications"
💻 Machine Learning Enthusiast | Data Science Explorer | eager about solving problems with help of data.
The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!
🚀 Build and manage real-life ML, AI, and data science projects with ease!
AI Observability & Evaluation
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
AI-dataframe to enrich, transform and analyze data from cloud storages for ML training and LLM apps
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
Fully reproducible, Dockerized, step-by-step, tutorial on training and serving a simple sklearn classifier model using mlflow. Detailed blog post published on Towards Data Science.
data & learning flywheel for LLM systems
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
Add a description, image, and links to the mlops topic page so that developers can more easily learn about it.
To associate your repository with the mlops topic, visit your repo's landing page and select "manage topics."