Process speech understanding | AssemblyAI

curl -X POST https://llm-gateway.assemblyai.com/v1/understanding \
     -H "Authorization: <apiKey>" \
     -H "Content-Type: application/json" \
     -d '{
  "transcript_id": "12345",
  "speech_understanding": {
    "request": {
      "translation": {
        "target_languages": [
          "es",
          "de"
        ],
        "formal": true,
        "match_original_utterance": true
      }
    }
  }
}'

{
  "speech_understanding": {
    "request": {
      "translation": {
        "target_languages": [
          "es",
          "de"
        ],
        "formal": true,
        "match_original_utterance": true
      },
      "speaker_identification": {
        "speaker_type": "name",
        "speakers": [
          {
            "name": "Michel Martin",
            "description": "Hosts the program and interviews the guests",
            "company": "NPR",
            "title": "Host Morning Edition"
          },
          {
            "name": "Peter DeCarlo",
            "description": "Answers questions from the interview",
            "company": "Johns Hopkins University",
            "title": "Professor and Vice Chair of Environmental Health and Engineering"
          }
        ]
      },
      "custom_formatting": {
        "date": "mm/dd/yyyy",
        "phone_number": "(xxx)xxx-xxxx",
        "email": "username@domain.com"
      }
    },
    "response": {
      "translation": {
        "status": "completed"
      },
      "speaker_identification": {
        "mapping": {
          "A": "Michel Martin",
          "B": "Peter DeCarlo"
        },
        "status": "completed"
      },
      "custom_formatting": {
        "status": "completed",
        "mapping": {
          "2024-12-25": "12/25/2024",
          "555-1234-5678": "(555)123-45678"
        },
        "formatted_text": "Call me at (555)123-45678 on 12/25/2024",
        "formatted_utterances": [
          {
            "confidence": 0.92,
            "start": 0,
            "end": 2500,
            "text": "Hi, I'm the interviewer. Call me at (555)123-45678 on 12/25/2024",
            "speaker": "interviewer"
          },
          {
            "confidence": 0.95,
            "start": 2500,
            "end": 5000,
            "text": "Thanks! I'll reach out then.",
            "speaker": "candidate"
          }
        ]
      }
    }
  },
  "translated_texts": {
    "es": "Hola, soy el entrevistador. Llámame al cinco cinco cinco uno dos tres cuatro cinco seis siete ocho el veinticinco de diciembre de dos mil veinticuatro. ¡Gracias! Me pondré en contacto entonces.",
    "de": "Hallo, ich bin der Interviewer. Rufen Sie mich an unter fünf fünf fünf eins zwei drei vier fünf sechs sieben acht am fünfundzwanzigsten Dezember zweitausendvierundzwanzig. Danke! Ich werde mich dann melden."
  },
  "utterances": [
    {
      "translated_texts": {
        "es": "Hola, soy el entrevistador. Llámame al cinco cinco cinco uno dos tres cuatro cinco seis siete ocho el veinticinco de diciembre de dos mil veinticuatro",
        "de": "Hallo, ich bin der Interviewer. Rufen Sie mich an unter fünf fünf fünf eins zwei drei vier fünf sechs sieben acht am fünfundzwanzigsten Dezember zweitausendvierundzwanzig"
      },
      "confidence": 0.92,
      "start": 0,
      "end": 2500,
      "text": "Hi, I'm the interviewer. Call me at five five five one two three four five six seven eight on December twenty fifth twenty twenty four",
      "speaker": "interviewer"
    },
    {
      "translated_texts": {
        "es": "¡Gracias! Me pondré en contacto entonces.",
        "de": "Danke! Ich werde mich dann melden."
      },
      "confidence": 0.95,
      "start": 2500,
      "end": 5000,
      "text": "Thanks! I'll reach out then.",
      "speaker": "candidate"
    }
  ],
  "words": []
}

To use our EU server for LLM Gateway, replace llm-gateway.assemblyai.com with llm-gateway.eu.assemblyai.com.

Perform various speech understanding tasks like Translation, Speaker Identification, and Custom Formatting.

<llms-only> > For the complete documentation index, see [llms.txt](https://www.assemblyai.com/docs/llms.txt) </llms-only> <Note>To use our EU server for LLM Gateway, replace `llm-gateway.assemblyai.com` with `llm-gateway.eu.assemblyai.com`.</Note> Perform various speech understanding tasks like [Translation](https://www.assemblyai.com/docs/speech-understanding/translation), [Speaker Identification](https://www.assemblyai.com/docs/speech-understanding/speaker-identification), and [Custom Formatting](https://www.assemblyai.com/docs/speech-understanding/custom-formatting).

Authentication

Authorizationstring

API Key authentication via header

Request

Request body for speech understanding tasks.

transcript_idstringRequired

The ID of the transcript to process.

speech_understandingobjectRequired

The speech understanding task to perform. Supports Translation, Speaker Identification, and Custom Formatting. Click into the request object below to see the available options.

Response

Successful response containing the speech understanding results.

LLMGatewayTranslationResponseobject

LLMGatewaySpeakerIdentificationResponseobject

LLMGatewayCustomFormattingResponseobject