XiaoZhi AI Chatbot Documentation Center | XiaoZhi.Dev

XiaoZhi AI Chatbot Documentation Center | XiaoZhi.Dev

📖 XiaoZhi AI Documentation Center

XiaoZhi AI is an open-source intelligent voice robot built on the ESP32 family (S3, C3, C5, C6, P4 and more), integrating wake word detection, AI conversation, device control, and multi-protocol communication capabilities. This documentation center provides complete technical guides from hardware assembly to AI integration.

Project Features:

  • 🎙️ Wake Word Detection: Supports 26 wake words including “Hello XiaoZhi”, <200ms response
  • 🧠 Conversation: LLMs are integrated on the server side; the device talks to the server over WebSocket or MQTT + UDP
  • 🏠 IoT Control: Integrates MQTT, MCP protocols for smart home control
  • 🔧 Open Source Hardware: Covers ESP32, C3, C5, C6, S3 and P4 platforms, complete open-source solution

🚀 Quick Start

Beginner’s Guide

🔧 Hardware Setup
ESP32-S3 board assembly, wiring solutions and component lists
💾 Firmware Flashing
Pre-compiled firmware download, flashing tools and configuration guide
🌐 Network Configuration
Wi-Fi setup, device connection and network troubleshooting
🎤 Feature Usage
Voice interaction, AI conversation and device control features

📚 Documentation Navigation

🛠️ User Guide

Complete tutorials for users

💻 Development Documentation

In-depth technical guides for developers

🔧 ESP32 Development Guide

Complete ESP32-S3 platform development tutorial

🤖 AI Feature Capabilities

AI technology integration and capability overview

  • 🎯 Voice Processing: Local wake word + cloud recognition hybrid solution
  • 🧠 LLM Integration: Connected on the server side; the device is not tied to a specific model
  • ⚡ On-device Wake Word: Espressif WakeNet / MultiNet, available depending on chip and PSRAM
  • 🎵 Voice Synthesis: Synthesized on the server and delivered as Opus audio

🛠️ Technical Features

Hardware Platform

  • Main Controller: ESP32-S3 dual-core 240MHz, 16MB Flash + 8MB PSRAM
  • Audio Processing: INMP441 digital microphone + MAX98357A digital amplifier
  • Display Output: SSD1306 OLED display + RGB status lights
  • Network Communication: Wi-Fi (supported chips can pick the 5 GHz band automatically) + 4G Cat.1 communication (optional)

Software Architecture

  • Development Framework: ESP-IDF v6.0.1+
  • AI Engine: Espressif Wake Word Engine + cloud LLMs
  • Communication Protocols: WebSocket + MQTT + MCP Protocol
  • Audio Encoding: 16kHz PCM + Opus compression transmission

📊 Performance Metrics

Feature ModulePerformance MetricsNotes
Wake Word Detection<200ms latency, >99% accuracyLocal offline processing
Speech Recognition<1s latency, >95% accuracyChinese recognition accuracy
AI Conversation<3s response, supports 5+ LLMsDeepSeek recommended
Device Control<100ms command responseLocal + cloud hybrid
Power Management5mA standby, 150mA activeSmart power optimization

🗂️ Documentation Index

Documentation CategoryDocument NameMain ContentUpdate Time
User GuideHardware Setup GuideESP32-S3 assembly, wiring diagrams, component lists2025-03-19
User GuideFirmware DownloadPre-compiled firmware, flashing tools, configuration guide2025-03-18
User GuideNetwork ConfigurationWi-Fi setup, troubleshooting, advanced settings2025-03-18
User GuideFeature TutorialVoice interaction, device control, personalization settings2025-03-18
User GuideESP32 Budget VersionLow-cost ESP32 development board construction solution2025-03-18
User GuideFAQUsage issues, troubleshooting, technical support2025-03-18
User GuideSelf-Hosted ServerOTA URL, community servers, security warning2026-10-23
Development GuideEcosystem ProjectsCommunity servers, clients and ports2026-10-23
Development DocumentationESP-IDF Environment SetupDevelopment environment configuration, compilation toolchain installation2025-03-06
Development DocumentationWebSocket ProtocolCommunication protocol specifications, message format definitions2025-03-06
Development DocumentationMCP Protocol SpecificationModel Context Protocol interaction flow2025-03-20
Development DocumentationMCP Usage GuideSpecific applications of IoT device control2025-03-20
Development DocumentationMQTT+UDP ProtocolControl channel and audio channel hybrid communication2025-03-20
Development DocumentationEmoji Emotion DisplayLLM emotion state expression protocol2025-03-06
ESP32 DevelopmentChip and Storage SpecsSupported chips, audio engines, partition tables2026-10-23
ESP32 DevelopmentFirmware Code TourDirectory layout, state machine, development rules2026-10-23
ESP32 DevelopmentAdvanced Extension PointsNetwork types, wake words, MCP, asset customization2026-10-23
ESP32 DevelopmentTroubleshootingBuild, flashing, audio and assets issues2026-10-23
AI FeaturesAI CapabilitiesDevice and server roles, wake words, camera, languages2026-10-23

🔗 Related Resources

Community Resources

Technical Support: