- Home
- Skills
- Agents & Orchestration
- Talking Humanoids — Voice Interaction for Robots
Talking Humanoids — Voice Interaction for Robots
Provider-agnostic voice interaction pipeline for humanoid robots with sub-800ms latency and motor noise cancellation.
$39
Works with the AI Agents you already use
Talking Humanoids — Voice Interaction for Robots
Example session with this skill installed
Configure a voice interaction pipeline for a humanoid robot using Whisper for ASR and a local LLM, ensuring safety validation for physical movement commands.
- Read your context and instructions
- Compiled the talking humanoids
Voice interaction pipeline initialized. Integrated Whisper ASR with local LLM inference and safety-wrapped skill execution.
Humanoid Voice Pipeline Configuration
| Component | Provider/Method | Latency Target | Safety Policy |
|---|---|---|---|
| Acoustics | AEC + Beamforming | < 50ms | Motor noise suppression active |
| ASR | Whisper (Streaming) | < 200ms | Multi-lingual auto-detect |
| Dialogue | Local Llama-3 | < 300ms | Tool-call schema restricted |
| Validator | action_validator.py | < 50ms | Mandatory confirmation for 'fetch' |
| TTS | Piper (Streaming) | < 150ms | Viseme generation enabled |
# Initialization snippet for robot skill mapping
from voice_system import Pipeline, SafetyValidator
# Define restricted skills
robot_skills = [
{"name": "walk_to", "requires_confirmation": True},
{"name": "point", "requires_confirmation": False},
{"name": "fetch", "requires_confirmation": True}
]
# Initialize validator with allowlist
validator = SafetyValidator(allowlist=robot_skills)
# Setup streaming pipeline
pipeline = Pipeline(
asr_provider="whisper-local",
llm_provider="local-llm",
tts_provider="piper",
validator=validator,
barge_in=True
)
pipeline.start()
Next steps
- Record 30 minutes of robot motor noise (idle/walking) to calibrate the AEC.
- Define the JSON schemas for your specific robot skills in the
skills/directory. - Set
ASR_BASE_URLandLLM_BASE_URLin your environment variables.
Connects securely to your tools. The creator never sees your data.
About this skill
Sub-second spoken conversation, barge-in, motor-noise-proof, safe by design (bring your own keys).
Give a humanoid (or any service robot) natural spoken conversation - microphone array and echo cancellation against motor noise, wake word and voice activity detection, streaming speech recognition, an LLM dialogue layer that can only trigger robot skills through a safety validator, streaming text-to-speech with lip/gesture sync, barge-in, multilingual support and a sub-second latency budget. Provider-agnostic (bring your own ASR/LLM/TTS keys). Use when the user wants a robot that listens and talks, a voice interface for a humanoid, or faster and safer robot conversations.
Includes an EXPERT.md reference (exact parameters, thresholds, failure diagnosis).
Acceptable use: civil and commercial applications only. Any military, paramilitary or weapon-related use is prohibited, as stated in the skill itself.
How to use
Skills on Agensi run inside your AI agent. Copy the prompt, paste it into your agent, and it connects to Agensi and installs this skill for you. If a payment is needed, your agent shows it to you first.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill passes our trust checks below.
Security scanned
Passed our 8-point scan before listing
Fresh listing
Recently published to Agensi
Money-back guarantee
Doesn't do what its page promises? You get your money back.
Trust & safety
Security scanned
Verified clean today
- Passed all security checks, Safe to install