Chat completions — POST /v1/chat/completions

The chat completions endpoint is the primary way to run inference on Darkbloom. It is fully compatible with the OpenAI Chat Completions API, so any OpenAI SDK works by setting the base URL to https://api.darkbloom.dev/v1. The coordinator routes your request to a hardware-attested Apple Silicon provider, encrypts the request body with the provider’s X25519 key before forwarding it, and returns the response through the standard OpenAI response shape. Every response includes provider attestation headers so you can independently verify the hardware that served your request. POST /v1/responses is an alias for the OpenAI Responses API. The coordinator auto-detects whether the body uses input (Responses format) or messages (Chat Completions format) and routes through the same handler.

Authentication

All inference endpoints require a Bearer token. Pass your API key in the Authorization header:

Authorization: Bearer eigeninference-...

Get your API key from the Darkbloom console.

Request

string

required

The model ID to use for this request. See Models for the list of available model IDs.Example: "qwen3.5-27b-claude-opus-8bit"

object[]

required

The conversation history as an array of message objects. Each object must have a role and a content field.

role — "system", "user", or "assistant"
content — the message text (string)

boolean

default:"false"

When true, the response is delivered as a stream of Server-Sent Events (SSE). Each event carries a data: field with a JSON chunk. The stream ends with data: [DONE].

integer

Maximum number of tokens to generate. If not set, the coordinator injects a default of 8192 to bound the worst-case cost. Set this explicitly if you need longer generations.

number

Sampling temperature between 0 and 2. Higher values make output more random; lower values make it more deterministic.

number

Nucleus sampling parameter. The model considers only the tokens comprising the top top_p probability mass.

string | string[]

One or more sequences at which generation stops. The stop sequence itself is not included in the output.

integer

Fixed random seed for reproducible outputs. Two requests with the same seed and parameters will produce identical results when served by the same provider.

Response (non-streaming)

string

Unique identifier for the request.

string

Always "chat.completion" for non-streaming responses.

object[]

Array of completion choices. Standard requests return exactly one choice.

Show choice fields

object

The generated message.

Show message fields

string

Always "assistant".

string

The generated text.

string

Why generation stopped. "stop" means the model reached a natural end; "length" means max_tokens was reached.

object

Token counts for the request.

Show usage fields

integer

Tokens consumed by the input messages.

integer

Tokens generated in the response.

integer

Sum of prompt and completion tokens.

Streaming

When stream: true, the response is a sequence of SSE events:

data: {"id":"...","object":"chat.completion.chunk","choices":[{"delta":{"content":"Hello"},"finish_reason":null}]}

data: {"id":"...","object":"chat.completion.chunk","choices":[{"delta":{"content":" world"},"finish_reason":null}]}

data: [DONE]

Just before [DONE], the coordinator may emit a final event carrying the provider’s Secure Enclave signature over the response hash:

{"choices":[],"se_signature":"<base64>","response_hash":"<hex>"}

Response headers

Every response (streaming and non-streaming) includes attestation headers that describe the provider that served the request.

Header	Description
`X-Provider-Attested`	`"true"` if the provider passed the most recent challenge-response attestation cycle
`X-Provider-Trust-Level`	`"self_signed"` or `"hardware"` — the provider’s verified trust level
`X-Provider-Chip`	Apple Silicon chip name, e.g. `"Apple M3 Max"`
`X-Provider-Id`	Internal provider identifier
`X-Provider-Model`	Mac hardware model identifier
`X-Provider-Serial`	Provider device serial number
`X-Provider-Secure-Enclave`	`"true"` if the provider has a Secure Enclave
`X-Provider-Mda-Verified`	`"true"` if Apple MDA hardware attestation was verified
`X-Attestation-Se-Public-Key`	Provider’s Secure Enclave P-256 public key (base64)
`X-Attestation-Device-Serial`	Device serial matching the attestation record
`X-Inference-Job-ID`	Job UUID for this request, useful for correlating with usage records (streaming only)

Examples

curl https://api.darkbloom.dev/v1/chat/completions \
  -H "Authorization: Bearer eigeninference-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen3.5-27b-claude-opus-8bit",
    "messages": [
      {"role": "user", "content": "Explain what a Merkle tree is."}
    ],
    "max_tokens": 512
  }'

curl https://api.darkbloom.dev/v1/chat/completions \
  -H "Authorization: Bearer eigeninference-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen3.5-27b-claude-opus-8bit",
    "messages": [
      {"role": "user", "content": "Explain what a Merkle tree is."}
    ],
    "stream": true
  }'

from openai import OpenAI

client = OpenAI(
    base_url="https://api.darkbloom.dev/v1",
    api_key="eigeninference-..."
)

response = client.chat.completions.create(
    model="qwen3.5-27b-claude-opus-8bit",
    messages=[
        {"role": "user", "content": "Explain what a Merkle tree is."}
    ],
    max_tokens=512,
)

print(response.choices[0].message.content)

from openai import OpenAI

client = OpenAI(
    base_url="https://api.darkbloom.dev/v1",
    api_key="eigeninference-..."
)

stream = client.chat.completions.create(
    model="qwen3.5-27b-claude-opus-8bit",
    messages=[
        {"role": "user", "content": "Explain what a Merkle tree is."}
    ],
    stream=True,
)

for chunk in stream:
    if chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="", flush=True)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.darkbloom.dev/v1",
  apiKey: "eigeninference-...",
});

const response = await client.chat.completions.create({
  model: "qwen3.5-27b-claude-opus-8bit",
  messages: [
    { role: "user", content: "Explain what a Merkle tree is." },
  ],
  max_tokens: 512,
});

console.log(response.choices[0].message.content);

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.darkbloom.dev/v1",
  apiKey: "eigeninference-...",
});

const stream = await client.chat.completions.create({
  model: "qwen3.5-27b-claude-opus-8bit",
  messages: [
    { role: "user", content: "Explain what a Merkle tree is." },
  ],
  stream: true,
});

for await (const chunk of stream) {
  process.stdout.write(chunk.choices[0]?.delta?.content ?? "");
}

Example response

{
  "id": "a3f1c2e7-84bb-4d9a-91f3-2b7e6d4a0c18",
  "object": "chat.completion",
  "choices": [
    {
      "message": {
        "role": "assistant",
        "content": "A Merkle tree is a hash-based data structure where every leaf node contains the hash of a data block, and every non-leaf node contains the hash of its child nodes..."
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 14,
    "completion_tokens": 87,
    "total_tokens": 101
  }
}

Inference

Account

Network

Chat completions — POST /v1/chat/completions

Authentication

Request

Response (non-streaming)

Streaming

Response headers

Examples

Example response

​Authentication

​Request

​Response (non-streaming)

​Streaming

​Response headers

​Examples

​Example response

Authentication

Request

Response (non-streaming)

Streaming

Response headers

Examples

Example response