Component Overview

Core Components

  1. Atoma Service

    • Main entry point for client requests
    • Handles API endpoints for inference, embeddings, and image generation
    • Manages request routing and response handling
    • Integrates with the inference services
  2. Inference Services

    • Containerized services that perform the actual AI inference
    • See more in the Inference Services section
  3. Authentication Middleware

    • Verifies client signatures using Sui wallet
    • Manages cryptographic operations
    • Handles access control and request validation
    • Integrates with confidential compute service
  4. State Manager

    • Maintains node state and synchronization
    • Manages database operations
    • Handles task queuing and execution
    • Tracks compute units and settlements
  5. Sui Event Subscriber

    • Listens to blockchain events
    • Processes on-chain state changes
    • Manages node registration and task assignments
    • Handles settlement verification
  6. Confidential Compute Service

    • Provides secure enclave operations
    • Manages encryption/decryption of sensitive data
    • Ensures privacy guarantees for compute tasks
    • Handles attestation proofs
  7. Atoma Daemon

    • Manages node operations and maintenance
    • Handles node registration and subscriptions
    • Processes stack settlements
    • Manages node rewards and claims

Supporting Components

  1. Sui Client
    • Interfaces with Sui blockchain
    • Manages transaction submissions
    • Handles smart contract interactions
    • Processes blockchain events

External Integrations

  1. Database
    • Stores node state and configuration
    • Maintains task and compute records
    • Tracks settlements and disputes
    • Manages node subscriptions

This architecture ensures secure, scalable, and verifiable AI compute operations while maintaining decentralization through blockchain integration and confidential computing capabilities.