?i/ `UdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z ddl Z ddl Z ddlmZmZmZddlmZmZejejd ejd Ze d pd Zd Zd ZdZdZe dpdZdZe e!d<Gdde"eZ#GddeZ$GddeZ%GddeZ&GddeZ'da(e j)dze!d<de j)fdZ*d e+de"fd!Z,d"e"d#e"de"fd$Z-d"e"de+fd%Z.d&ed'e"d(e'd#e"ddf d)Z/d&ed*e+d(e'ddfd+Z0d&ed(e'd#e"ddfd,Z1ed d-.Z2e23d/d&eddfd0Z4e25d1de6e"e"ffd2Z7e8d3krddl9Z9e9j:d4d5d6d78dSdS)9uTopenclaw-proxy — async WebSocket gateway between XiaoZhi ESP32 and OpenClaw agent.N)Enum)which)Literal)FastAPI WebSocketWebSocketDisconnect) BaseModelValidationErrorz1%(asctime)s [%(levelname)s] %(name)s: %(message)s)levelformatzopenclaw-proxyopenclawmainxbasezzh-CN-XiaoxiaoNeuralffmpegiMAX_AUDIO_BUFFER_BYTESceZdZdZdZdZdZdS)HardwareActionz+Actions reported by XiaoZhi ESP32 hardware.key_downkey_up wake_wordN)__name__ __module__ __qualname____doc__KEY_DOWNKEY_UP WAKE_WORD%/root/projects/openclaw-proxy/main.pyrr's#55H FIIIr rc(eZdZUdZeed<eed<dS) HardwareEventz"Incoming JSON frame from hardware.typeactionN)rrrrstr__annotations__rrr r!r#r#/s-,, III r r#c,eZdZUdZdZeed<eed<dS)StateNotificationzEOutgoing state frame pushed to hardware (e.g. breathing LED trigger).stater$statusNrrrrr$r&r'rr r!r)r)6s/OOD# KKKKKr r)c,eZdZUdZdZeed<eed<dS) TextReplyz.Outgoing text reply carrying the LLM response. text_replyr$textNr,rr r!r.r.=s/88D# IIIIIr r.cpeZdZUdZddiZdZeded<gZe e ed<de fd Z de fd Z d d Zd S) SessionStatez9Per-connection state machine for press-to-talk buffering.arbitrary_types_allowedTidle)r4 listening processingr+ audio_chunksreturnc>td|jDS)z*Return total buffered audio size in bytes.c34K|]}t|VdS)N)len).0cs r! z+SessionState.buffer_size..Ns(55a3q66555555r )sumr7selfs r! buffer_sizezSessionState.buffer_sizeLs"554#4555555r cld|j}|j|S)z)Join and clear all buffered audio chunks.r )joinr7clear)rAaudios r! drain_audiozSessionState.drain_audioPs0*++ !!! r NcFd|_|jdS)z&Reset state to idle with empty buffer.r4N)r+r7rEr@s r!resetzSessionState.resetVs$  !!!!!r r8N)rrrr model_configr+rr'r7listbytesintrBrGrIrr r!r2r2DsCC-t4L9?FG5 6??? "L$u+"""6S6666U """"""r r2_whisper_modelr8ct9tdtt jtatS)z3Return the Whisper model, loading it on first call.NuLoading Whisper '%s' model…)rOloggerinfoWHISPER_MODEL_SIZEwhisper load_modelrr r!_get_whisper_modelrVas7 35GHHH +,>?? r audio_bytescKtdt|t}t jdd5}|||tj |j |j dd{V}dddn #1swxYwY|d }td ||S) zConvert Opus audio to text via Whisper. Args: audio_bytes: Raw Opus-encoded audio from ESP32. Returns: Transcribed text string. z$STT: received %d bytes of Opus audioz.opusT)suffixdeletezh)languageNr0uSTT: transcribed → %s) rQrRr;rVtempfileNamedTemporaryFilewriteflushasyncio to_thread transcribenamestrip)rWmodelfresultr0s r! process_sttrims) KK6K8H8HIII  E  $GD A A A Q    (  aft                        &>   ! !D KK)4000 KsAB,,B03B0r0 session_idc8Ktd|tjtddt d|d|ddt ttjj tjj  d {V}| d {V\}}|j d kr[| d  }td |j |td|t!j| }|didg}|std|d dd}td||S)aFSend text to OpenClaw agent via CLI and return its reply. Args: text: User utterance transcribed by STT. session_id: Per-connection session ID for multi-turn conversation. Returns: Agent reply string. Raises: RuntimeError: If the CLI call fails or returns unexpected output. uLLM: sending to OpenClaw → %sagentz--agentz --session-idz-mz--jsonz --timeout)stdoutstderrNrreplaceerrorszOpenClaw CLI failed (rc=%d): %szOpenClaw CLI error: rhpayloadsz OpenClaw returned empty payloadsr0uLLM: reply ← %s)rQrRracreate_subprocess_exec OPENCLAW_CLIOPENCLAW_AGENT_IDr&OPENCLAW_TIMEOUT subprocessPIPE communicate returncodedecodereerror RuntimeErrorjsonloadsget) r0rjprocrmrnerr_msgdatarrreplys r! call_openclawrs KK14888/g$  dS)**!&!&         D ++--------NFF !--y-117799 6QQQ;';;<<< :fmmoo & &Dxx"%%))*b99H ?=>>> QKOOFB ' 'E KK#U+++ Lr c@Ktd|tj|t}g}|23d{V}|ddkr||d/6d|}tj tdd d d d d dddddddtj j tj j tj j d{V}| |d{V\}}|jdkr[|d}td|j|t%d|tdt'||S)zConvert text to Opus audio via edge-tts and ffmpeg. Args: text: Text to synthesize. Returns: Opus-encoded audio bytes. Raises: RuntimeError: If ffmpeg conversion fails. uTTS: synthesising → %s)r0voiceNr$rFrr z-izpipe:0z-c:alibopusz-b:a24kz-ar16000z-ac1z-fopuszpipe:1)stdinrmrn)inputrrorpzffmpeg failed (rc=%d): %szffmpeg TTS conversion error: z%TTS: generated %d bytes of Opus audio)rQrRedge_tts CommunicateEDGE_TTS_VOICEstreamappendrDrart FFMPEG_BINrxryrzr{r|rer}r~r;) r0rz mp3_chunkschunk mp3_bytesr opus_bytesrnrs r! process_ttsrs KK*D111&DGGGK J"))++-------e =G # #   eFm , , ,,$$I/D( 65 ws fh %!&!&      D $//i/@@@@@@@@J !--y-117799 0$/7KKKD7DDEEE KK7ZIII sA>wsrawr*cK tj|}n1#tj$rtd|YdSwxYw t d i|}nE#t $r8}td|Yd}~dSd}~wwxYwtd|j j |j tj tj fvr|jdkr3td|jd|_t#d}||d{VdS|j tjkrM|jdkr"td|jdSd |_t+|||d{VdSdS) zParse and route an incoming JSON text frame. Args: ws: Active WebSocket connection. raw: Raw text payload received from client. state: Per-connection session state. session_id: Per-connection session ID. z Malformed JSON (ignored): %.120sNzInvalid hardware event: %szHardware event: %sr5u0Re-key_down while listening — resetting bufferr+u key_up in '%s' state — ignoredr6r)rrJSONDecodeErrorrQwarningr#r rqrRr%valuerrrr+r7rEr) send_textmodel_dump_jsonrhandle_pipeline)rrr*rjpayloadeventexcacks r!handle_text_framers*S//  93???(((( 3SZZ\\BBB KK$el&8999 |/1IJJJ <; & & KKJ K K K   $ $ & & &" {333ll3..0011111111111 . . . <; & & NN=u| L L L F# b%44444444444 / .s'*AA A B"-BBrcK|jdkr"td|jdS|t |zt kr/td|dS|j|tdt ||dS)zBuffer an audio binary frame if in listening state. Args: ws: Active WebSocket connection. data: Raw Opus audio bytes. state: Per-connection session state. r5u&Binary frame in '%s' state — droppedNu/Audio buffer full (%d bytes) — dropping framezBuffered %d bytes (total: %d)) r+rQrrBr;rr7rrR)rrr*s r!handle_binary_framers |{""?NNN SYY&)???H%J[J[J]J]^^^ d### KK/TE.heartbeat0s mA&&&&&&&&&,,)<<<LLNN!EE  s;A A*)A*)r0z#Pushing %d bytes of audio to clientrJ)rGrQrrIrirr)rra create_taskrcancelr.rrRr; send_bytes) rr*rjrFr0rheartbeat_taskr tts_audios ` r!rrs     E GHHH   ''''''''ll,J???OOQQRRRRRRRRR      !,YY[[99 $'j99999999E  ! ! # # # #N ! ! # # # #ll9%000@@BBCCCCCCCCC&e,,,,,,,,  93y>>JJJmmI&&&&&&&&&  s& A2F+>C)F+)C??BF++Gz0.1.0)titleversionz/chatcK|d{V|jr|jjd|jjnd}dt jjdd}t}t d|| | d{V}|dd krn_| d }| d }|t||||d{Vn|t|||d{Vn#t$rYnwxYwt d ||dS#t d ||wxYw) z3Main WebSocket endpoint for XiaoZhi ESP32 hardware.N:unknownzxiaozhi-z!Client connected: %s (session=%s)Tr$zwebsocket.disconnectr0rMz$Client disconnected: %s (session=%s))acceptclienthostportuuiduuid4hexr2rQrRreceiverrrr)rpeerrjr*message text_data byte_datas r!websocket_chatrPs ))++359 Kbin / /ry~ / / /)D2DJLL,RaR022J NNE KK3T:FFFN @JJLL((((((Gv"888 F++I G,,I$'IujIIIIIIIIII&)"i????????? @        :D*MMMMM :D*MMMMs+BDE D$!E#D$$EE#z/healthcKddiS)zLiveness probe.r+okrrr r!healthrms d r __main__zmain:appz0.0.0.0i@T)rrreload);rrarloggingr]renumrshutilrtypingrrrTfastapirrrpydanticr r basicConfigINFO getLoggerrQrurvrwrSrrrrNr'r&rr#r)r.r2rOWhisperrVrMrirrrrrapp websocketrrdictrruvicornrunrr r!rs;ZZZ  ;;;;;;;;;;//////// , >  + , ,uZ  .J ' U8__ ( .... S$I  """""9"""4*.$&---GO5S,'c's's''''T(C(E((((\&5&5&5$0&5>A&5 &5&5&5&5RQ)Q5QQRVQQQQ(00&0470 0000jg$g666wNYN4NNNN8d38n zNNNGK dCCCCCCr