Confidential Chat

Create confidential chat completions

This handler processes chat completion requests in a confidential manner, providing additional encryption and security measures for sensitive data processing. It supports both streaming and non-streaming responses while maintaining data confidentiality through AEAD encryption and TEE hardware, for full private AI compute.

Returns

Returns a Result containing either:

An HTTP response with the chat completion result
A streaming SSE connection for real-time completions
An AtomaProxyError error if the request processing fails

Errors

Returns AtomaProxyError::InvalidBody if:

The ‘stream’ field is missing or invalid in the payload

Returns AtomaProxyError::InternalError if:

The inference service request fails
Response processing encounters errors
State manager updates fail

Security Features

Utilizes AEAD encryption for request/response data
Supports TEE (Trusted Execution Environment) processing
Implements secure key exchange using X25519
Maintains confidentiality throughout the request lifecycle

POST

confidential

chat

completions

import { AtomaSDK } from "atoma-sdk";

const atomaSDK = new AtomaSDK({
  bearerAuth: process.env["ATOMASDK_BEARER_AUTH"] ?? "",
});

async function run() {
  const completion = await atomaSDK.confidentialChat.create({
    messages: [
      {"role": "developer", "content": "You are a helpful assistant."},
      {"role": "user", "content": "Hello!"}
    ],
    model: "meta-llama/Llama-3.3-70B-Instruct"
  });

  console.log(completion.choices[0]);
}

run();

{
  "ciphertext": "<string>",
  "nonce": "<string>",
  "response_hash": "<string>",
  "signature": "<string>",
  "usage": null
}

Authorizations

Authorization

string

header

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json

A request for confidential computation that includes encrypted data and associated cryptographic parameters

Response

200

application/json

Confidential chat completions

Represents a response from a confidential compute request

Create chat completions Create confidential embeddings

import { AtomaSDK } from "atoma-sdk";

const atomaSDK = new AtomaSDK({
  bearerAuth: process.env["ATOMASDK_BEARER_AUTH"] ?? "",
});

async function run() {
  const completion = await atomaSDK.confidentialChat.create({
    messages: [
      {"role": "developer", "content": "You are a helpful assistant."},
      {"role": "user", "content": "Hello!"}
    ],
    model: "meta-llama/Llama-3.3-70B-Instruct"
  });

  console.log(completion.choices[0]);
}

run();

{
  "ciphertext": "<string>",
  "nonce": "<string>",
  "response_hash": "<string>",
  "signature": "<string>",
  "usage": null
}

Get Started

Completions

Confidential Completions

Chat

Confidential Chat

Confidential Embeddings

Confidential Images

Embeddings

Health

Images

Models

Nodes