Summarization

Distill important information by summarizing your audio files.

The Summarization model generates a summary of the resulting transcript. You can control the style and format of the summary using Summary models and Summary types.

Summarization and Auto Chapters

You can only enable one of the Summarization and Auto Chapters models in the same transcription.

Quickstart

Enable Summarization by setting summarization to true in the transcription config. Use summary_model and summary_type to change the summary format.

If you specify one of summary_model and summary_type, then you must specify the other.

The following example returns an informative summary in a bulleted list.

1import assemblyai as aai
2
3aai.settings.api_key = "<YOUR_API_KEY>"
4
5# audio_file = "./local_file.mp3"
6audio_file = "https://assembly.ai/wildfires.mp3"
7
8config = aai.TranscriptionConfig(
9  summarization=True,
10  summary_model=aai.SummarizationModel.informative,
11  summary_type=aai.SummarizationType.bullets
12)
13
14transcript = aai.Transcriber().transcribe(audio_file, config)
15
16print(transcript.summary)

Open In Colab

Example output

1- Smoke from hundreds of wildfires in Canada is triggering air quality alerts throughout the US. Skylines from Maine to Maryland to Minnesota are gray and smoggy. In some places, the air quality warnings include the warning to stay inside.
2- Air pollution levels in Baltimore are considered unhealthy. Exposure to high levels can lead to a host of health problems. With climate change, we are seeing more wildfires. Will we be seeing more of these kinds of wide ranging air quality consequences?
Custom Summaries Using LeMUR

If you want more control of the output format, see how to generate a Custom summary using LeMUR.

API reference

Request

$curl https://api.assemblyai.com/v2/transcript \
>--header "Authorization: <YOUR_API_KEY>" \
>--header "Content-Type: application/json" \
>--data '{
>  "audio_url": "YOUR_AUDIO_URL",
>  "summarization": true,
>  "summary_model": "informative",
>  "summary_type": "bullets"
>}'
KeyTypeDescription
summarizationbooleanEnable Summarization.
summary_typestringSummary type to use for the transcription.
summary_modelstringSummary model to use for the transcription.

Response

KeyTypeDescription
summarystringA summary of the audio file.

The response also includes the request parameters used to generate the transcript.

Summary types

The summary type determines both the length and the format of the summary, for example as a bulleted list or a paragraph.

ValueDescriptionExample
bullets (default)A bulleted summary with the most important points.- The human brain has nearly tripled in mass in two million years.
- One of the main reasons that our brain got so big is because it got a new part, called the frontal lobe.
bullets_verboseA longer bullet point list summarizing the entire transcription text.Dan Gilbert is a psychologist and a happiness expert. His talk is recorded live at Ted conference. He explains why the human brain has nearly tripled in size in 2 million years. He also explains the difference between winning the lottery and becoming a paraplegic.\n- In 1994, Pete Best said he’s happier than he would have been with the Beatles. In the free choice paradigm, monet prints are ranked from the one they like the most to the one that they don’t. People prefer the third one over the fourth one because it’s a little better.\n- People synthesize happiness when they change their affective. Hedonic aesthetic to make up your mind and change your mind is the friend of natural happiness. But it’s the enemy of synthetic happiness. The psychological immune system works best when we are stuck. This is the difference between dating and marriage. People don’t know this about themselves and it can work to their disadvantage.\n- In a photography course at Harvard, 66% of students choose not to take the course where they have the opportunity to change their mind. Adam Smith said that some things are better than others. Dan Gilbert recorded at Ted, 2004 in Monterey, California, 2004.
gistA few words summarizing the entire transcription text.A big brain
headlineA single sentence summarizing the entire transcription text.The human brain has nearly tripled in mass in two million years.
paragraphA single paragraph summarizing the entire transcription text.The human brain has nearly tripled in mass in two million years. It went from the one-and-a-quarter-pound brain of our ancestor, habilis, to the almost three-pound meatloaf everybody here has between their ears.

Summary models

The summary model determines the style and tone of the summary.

ValueWhen to useSupported summary typeRequired parameters
informative (default)Best for files with a single speaker, such as presentations or lectures.bullets, bullets_verbose, headline, or paragraphpunctuate and format_text set to true
conversationalBest for any 2-person conversation, such as customer/agent or interview/interviewee calls.bullets, bullets_verbose, headline, or paragraphpunctuate, format_text, and speaker_labels or multichannel set to true
catchyBest for creating video, podcast, or media titles.headline, or gistpunctuate and format_text set to true

Frequently asked questions

The inference speed of the Summary model depends on the desired output length. However, a single batch can be processed in less than 1 second.

No. Summarization only generates a single abstractive summary of the entire audio file, and doesn’t provide word-level information or speaker labels. If you need word-level information, consider using Word-level timestamps and Speaker Diarization instead.

Built with