Skip to content

Features - MCP Server - Interaction LoopΒΆ

This interaction loop is supported by comprehensive observation of UI state and performant frame rate observation to determine UI idling. Together, that allows for accurate and precise exploration with the action tool calls.

sequenceDiagram
    participant Agent as AI Agent
    participant MCP as MCP Server
    participant Device as Device

    Agent->>MCP: πŸ€– Interaction Request
    MCP->>Device: πŸ‘€ Observe
    Device-->>MCP: πŸ“± UI State/Data (Cached)

    MCP->>Device: ⚑ Execute Actions
    Device-->>MCP: βœ… Result

    MCP->>Device: πŸ‘€ Observe
    Device-->>MCP: πŸ“± UI State/Data
    MCP-->>Agent: πŸ”„ Interaction Response with UI State