Higress
Gateway for AI and service traffic.
GitHub Stars 9599 · v2.2.5
Apache-2.0
Runtime requirements Unspecified
Source checked 10/20/2026, 12:53:25 PM
Higress
Gateway for AI and service traffic.
Three costs to check before self-hosting
Model accessHosting costsMaintenance effort
Evaluate all three costs separately; free deployment is not free inference.
Compare paid API optionsDeployment & runtime
Template: verify the official image tag, authentication and persistent storage first
Choose a method from the official docs; no unverified launch command is generated.
Official deployment docsChoose hosting for your needs
Provider links below; no unverified starting prices. Choose for actual concurrency, memory and network needs.
RackNerd
Official link; not an affiliateUnspecified
Payment methods Unspecified
Locations Unspecified
Source checked Not checked · Stale; awaiting refresh
View hosting optionsBandwagonHost
Official link; not an affiliateUnspecified
Payment methods Unspecified
Locations Unspecified
Source checked Not checked · Stale; awaiting refresh
View hosting optionsHetzner Cloud
Official link; not an affiliateUnspecified
Payment methods Unspecified
Locations Unspecified
Source checked Not checked · Stale; awaiting refresh
View hosting optionsVultr
Official link; not an affiliateUnspecified
Payment methods Unspecified
Locations Unspecified
Source checked Not checked · Stale; awaiting refresh
View hosting options