trt-llm-as-openai-windows

This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.

Pre-install review · source, risk, and alternatives

NVIDIAAuthor unclaimedClear sourceView repository

C · Review first

Trust level

87 · High trust

Strong recovered source and maintenance signals.

Risk decision

Review required

metadata-only

Install readiness

script-backed · copy-only command

SkillTrust only shows install guidance and copy actions; it never executes installs.

Install guidance

Review before install

Supported tools can change install steps; Universal entries need source review.

Copy-only command

Universal

git clone https://github.com/NVIDIA/trt-llm-as-openai-windows.git

Risk warning

metadata-only