Introduction

Cinna LLM Gateway

Access powerful open-source language models through the Cinna Gateway using the same interface as OpenAI. Just update your base URL to:

arduinoCopy codehttps://llm-gateway.cinna.ai

---

Core Advantages

Compatible with OpenAI SDK Use your existing OpenAI libraries without changes. The Cinna Gateway mirrors the OpenAI interface, so integration is fast and intuitive.

Runs on Decentralized Infrastructure Models are served across compute nodes in the Cinna network, powered by Solana. This structure ensures low latency, transparency, and cost efficiency.

Simple Setup No complex onboarding. Start generating results with just three lines of code.

Supports Streaming Get real-time responses for interactive use cases like chatbots, AI agents, and live content tools.

Built for Open Source Access top-tier open-source models for language, reasoning, and generation. Ideal for developers who want freedom and control.

---

Getting Started

First, request your Cinna API key. Then integrate it into your app like this:

Node Example

tsCopy codeimport OpenAI from "openai"

const openai = new OpenAI({
  apiKey: process.env["CINNA_API_TOKEN"],
  baseURL: "https://llm-gateway.cinna.ai"
})

const response = await openai.chat.completions.create({
  model: "mistralai/mixtral-8x7b-instruct",
  messages: [
    {
      role: "user",
      content: "Write rap lyrics about Solana"
    }
  ],
  maxTokens: 64,
  stream: true
})

for await (const part of response) {
  process.stdout.write(part.choices[0]?.delta?.content || "")
}

Cinna Gateway connects directly with official OpenAI libraries. Just change the base URL and use your key. All responses come from decentralized nodes, ensuring privacy, speed, and affordability.