Tag · 6 repos

model-serving

Repositories carrying the model-serving tag.

Exact tag match6 sample repositories

vllm-project/vllm-omni

A framework for efficient model inference with omni-modality models

PythonLLM Inference & ServingImage Generation & Editing

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

PythonLLM Inference & Serving

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

PythonMachine Learning & Data ScienceLLM Inference & Serving

logicalclocks/hopsworks

Hopsworks - Data-Intensive AI platform with a Feature Store

JavaMachine Learning & Data ScienceLLM Inference & Serving

bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

PythonLLM Inference & ServingMachine Learning & Data Science

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

GoCloud & KubernetesMachine Learning & Data Science