Goal

Let NextChat voice input use a self-hosted FunASR/SenseVoice transcription service without bundling a Python or model runtime into the NextChat application.

Proposed first milestone

Reuse the OpenAI-compatible multipart contract:

POST <configurable-base-url>/v1/audio/transcriptions
Content-Type: multipart/form-data

The initial integration should:

• keep the existing transcription behavior as the default;
• allow a configurable transcription base URL, model name, and optional bearer token;
• send the recorded audio using the existing multipart flow and consume the standard { "text": "..." } response;
• keep credentials on the existing server-side/configuration boundary and avoid leaking them into logs or shareable settings;
• work with any compatible endpoint rather than adding a hard dependency on the funasr Python package.

This contract can point to a local FunASR deployment while remaining useful for other self-hosted transcription servers.

Capability and license scope

• FunASR is a toolkit; capabilities depend on the selected model and runtime.
• SenseVoiceSmall supports Chinese, Cantonese, English, Japanese, and Korean, plus speech-event and emotion tags. Its model card links the applicable model license.
• Fun-ASR-Nano-2512 is a separate model with Apache-2.0 weights.
• The FunASR and SenseVoice repository source code is MIT. Model weights must be evaluated under each model card license.

Performance should be documented for the exact checkpoint, hardware, dtype, audio set, and concurrency used; this issue intentionally makes no universal speed or language-count claim.

Example request

curl -X POST "${TRANSCRIPTION_BASE_URL}/v1/audio/transcriptions" \
  -H "Authorization: Bearer ${TRANSCRIPTION_API_KEY}" \
  -F "file=@voice.webm" \
  -F "model=${TRANSCRIPTION_MODEL}"

The requested product change is therefore a configurable compatible endpoint, not a FunASR-only runtime embedded in NextChat.