Summarize your audio data

Basic summary example

If you want to send a custom prompt to the LLM, you can use the LeMUR Task endpoint to apply the model to your transcribed audio files.

1
import assemblyai as aai
2
3
aai.settings.api_key = "<YOUR_API_KEY>"
4
5
# Step 1: Transcribe an audio file.
6
# audio_file = "./local_file.mp3"
7
audio_file = "https://assembly.ai/sports_injuries.mp3"
8
9
transcriber = aai.Transcriber()
10
transcript = transcriber.transcribe(audio_file)
11
12
# Step 2: Define a summarization prompt.
13
prompt = "Provide a brief summary of the transcript."
14
15
# Step 3: Apply LeMUR.
16
result = transcript.lemur.task(
17
    prompt, final_model=aai.LemurModel.claude3_5_sonnet
18
)
19
20
print(result.response)

Example output

1
The transcript describes several common sports injuries - runner's knee,
2
sprained ankle, meniscus tear, rotator cuff tear, and ACL tear. It provides
3
definitions, causes, and symptoms for each injury. The transcript seems to be
4
narrating sports footage and describing injuries as they occur to the athletes.
5
Overall, it provides an overview of these common sports injuries that can result
6
from overuse or sudden trauma during athletic activities

Summary with specialized endpoint

The LeMUR Summary endpoint requires no prompt engineering and facilitates more deterministic and structured outputs. See the code examples below for more information on how to use this endpoint.

You can add additional context to provide information that is not explicitly referenced in the audio data, as well as specify an answer format. For this, use the optional parameters context and answer_format.

1
import assemblyai as aai
2
3
aai.settings.api_key = "<YOUR_API_KEY>"
4
5
audio_url = "https://assembly.ai/meeting.mp4"
6
transcript = aai.Transcriber().transcribe(audio_url)
7
8
result = transcript.lemur.summarize(
9
    final_model=aai.LemurModel.claude3_5_sonnet,
10
    context="A GitLab meeting to discuss logistics",
11
    answer_format="TLDR"
12
)
13
14
print(result.response)

Custom summary example (Advanced)

In this example, we’ll run a custom LeMUR task with an advanced prompt to create custom summaries:

More summarization prompt examples

Try any of these prompts to get started:

For more use cases and prompt examples, see LeMUR examples.

API reference

• LeMUR Task endpoint
• LeMUR Summary endpoint

Improve the results

To improve the results, see the following resources:

• Optimize your prompt with the prompt engineering guide.
• To alter the outcome, see Change model and parameters.