Introduction

​

Heurist LLM Gateway

Access open source LLMs in Heurist instantly and transform your AI capabilities using the familiar OpenAI SDK. Simply replace the base URL setting in OpenAI libraries with https://llm-gateway.heurist.xyz.

​

Key Features

• OpenAI Compatibility: Heurist LLM Gateway is designed to be fully compatible with the OpenAI SDK, allowing you to use the same familiar interface to interact with decentralized LLMs.
• Decentralized AI at Low Cost: Leverage the benefits of decentralized computing to access powerful LLMs while significantly reducing operational costs.
• Simple Integration: You can start using Heurist Gateway with just 3 lines of code. No complicated setup required.
• Streaming Responses: Get real-time results from LLMs with built-in support for streaming responses, enabling interactive experiences like chatbots and live content generation.
• Open-Source Ecosystem: Heurist supports a wide range of open source LLMs, allowing you to choose the best model for your use case, from conversational agents to code generation.

​

Getting Started

To get started with the Heurist LLM Gateway, you’ll first need an API key from Heurist. Once you have your API token, integrating it into your application is as simple as a few lines of code.

Here’s how you can use the Heurist LLM Gateway in different languages.

Heurist LLM Gateway integrates seamlessly with the official OpenAI libraries. You can easily replace the baseURL in your client configuration to use Heurist’s decentralized models, gaining low-cost and uncensored AI capabilities. Refer to your language-specific OpenAI SDK docs for endpoint configuration.