SYSTEM OVERVIEW

Your voice agent,
in one container.

VOICE GATEWAYStoppedAssemblyAI → A2A → Grok

AGENT BACKENDMockLocal A2A runtime

CONFIGURATIONNot configuredNo saved revision

01ListenAssemblyAI streaming STT

→

02ThinkA2A agent gateway

→

03SpeakGrok streaming TTS

Console-first workflow

Build in Pi Console, then invoke /skill:publish-agent or run !agentctl validate and !agentctl publish. Agent Preview starts a fresh context after publication.

SPEECH ROUTING

Voice Providers

Choose a speech mode, select its provider, and configure one focused profile at a time.

ACTIVE ROUTEAssemblyAI → A2A → Grok

01Speech mode

02Provider

SELECTED PROFILEAssemblyAI Needs setup

STT PROFILE

AssemblyAI

Low-latency streaming speech recognition.

Streaming

API keyStored privately and never returned to the browser. Language End-of-turn confidence Minimum end silence (ms) Maximum turn silence (ms)

NVCF / NGC API keyThis key can be different from the NVIDIA TTS key. Function ID Model name gRPC server Language code Sample rate Speaker diarization Maximum speakers

API keyUsed only by the managed voice runtime. Voice

Saved profiles load their available voices automatically. You can also enter a custom voice ID. Speech speed Language

NVCF / NGC API keyThis key can be different from the NVIDIA STT key. Function ID Model name gRPC server Voice

Saved profiles load voices from GetRivaSynthesisConfig automatically. You can also enter a custom voice ID. Language code Sample rate Quality

APPLIANCE SETUP

Connect your services.

Secrets are stored separately with owner-only permissions and are never returned to this browser.

Speech providers are configured separately

Use the view to select and test the active STT and TTS route.

01

Agent backend

Start with the mock, develop in Pi, or connect an external A2A service.

Backend OpenRouter API key Custom NVIDIA API keyUsed by the default custom-nvidia provider below. Development modelDefaults to NVIDIA GPT-5.6 Sol for Pi Console only. The published starter agent remains on Gemini. Development thinking A2A base URL A2A message path A2A health path A2A protocol A2A authentication A2A API key

02

Custom model providers

Edit Pi's development models.json. Reference credentials as $ENV_VAR; never paste an API key into this editor.

Loading provider configuration…

03

Client access

Use an open client for local development or protect every voice session with Auth0.

Authentication Agent display name Auth0 domain Auth0 client ID Auth0 API audience Required scopes Public voice URL Allowed origins

04

NAT traversal

For remote WebRTC, configure either Twilio Network Traversal or an explicit TURN server.

TURN server URL TURN username TURN password Twilio account SID Twilio auth token

OWNER-LEVEL DEVELOPMENT

Pi Builder Console

Pi can edit the draft, use loaded reference documents, run Preview turns, test tools, inspect runtime logs, and restart managed services. The published agent remains separately allowlisted.

RUN ON THE DOCKER HOSTdocker exec -it --user voiceagent a2a-voice-agent pi-console

REFERENCE DOCUMENTS

No documents loaded.

pi@voice-agent:/workspace/builder

TEXT-ONLY TEST BENCH

Agent Preview

Test the published A2A agent, its tools, and authenticated user behavior before opening a voice session.

Checking authenticationReading Auth0 configuration…

π

Published agentReady for a test message

A2A test sessionACTIVE RELEASELoading…

πStart a test conversationType a message below. Press Enter to send.

PORTABLE AGENTS

Move the agent.
Keep secrets separate.

Agent packages contain definitions and resources only. Credentials use their own password-encrypted backup and never include the administrator token or internal service key.

01 / AGENT PACKAGE

Agent definition and resources

Export the immutable active release for migration, or the current draft for safekeeping. Import always validates and replaces only the draft; it never publishes automatically.

Import only packages you trust: agents may contain executable extensions. The previous draft is retained under /workspace/agent/import-backups.

02 / ENCRYPTED CREDENTIALS

Credentials backup

Exports configured API keys, tool secrets, and Pi provider authentication. Argon2id and AES-256-GCM protect the backup independently from the agent package.

New backup password Confirm password

Replace credentials that already exist on this appliance Imported credentials take effect after services restart and Pi Console is reopened.

03 / PRODUCTION DEPLOYMENT

Hugging Face Docker Space

Freeze the active release into a standalone, runtime-only repository. The archive contains one Docker container, the public voice UI, the Pi/A2A runtime, and generated deployment documentation—never credentials, drafts, or development tools.

PUBLIC VOICE UI · PORT 7860ANONYMOUS ACCESS · ISOLATED SESSIONSSELECTED STT → PI/A2A → SELECTED TTS

For reliable hosted WebRTC, configure TURN or Twilio credentials in the Space. The generated README lists every required Variable and Secret discovered from the published agent.

RUNTIME OUTPUT

Service Logs

No logs yet.