OpenLLM
Author: bentoml
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Type
org
Skills
7
Claimed
No
Verified
No
Review boundary
Author information helps you judge provenance; different skills from the same author may still have different source states, so review each one before install.
Published skills
Inspect each skill on the cards before install.
Author: bentoml
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Author: bentoml
Everything you need to know about LLM inference
Author: bentoml
A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.
Author: bentoml
Benchmark and optimize LLM inference across frameworks with ease
Author: bentoml
Self-host LLMs with vLLM and BentoML