Speech
Understanding
Gain maximum value from voice data with audio intelligence models, and leverage LLM capabilities with LeMUR to extract insights, generate summaries, and more.
Feature-rich AI models
Leverage our AI-powered Summarization models to automatically summarize audio/video data in your products at scale. Customize the summary types to best fit your use case.
Detect sensitive content in your audio and video files - such as hate speech, violence, sensitive social issues, alcohol, drugs, and more.
With Sentiment Analysis, AssemblyAI can detect the sentiment of each sentence of speech spoken in your audio files.
Identify a wide range of entities that are spoken in your audio files, such as person and company names, email addresses, dates, and locations.
Identify and remove Personally Identifiable Information, such as phone numbers and social security numbers, from the transcription text before it is returned to you.
Label the topics that are spoken in your audio and video files. The predicted topic labels follow the standardized IAB Taxonomy, which makes them suitable for contextual targeting.
Automatically generate a summary over time for audio and video files.
Accurately identify significant words and phrases, enabling you to extract the most pertinent concepts or highlights from your audio/video file.
Leverage LLM capabilities and take action on your audio data
Injury: Runner's knee
Symptoms: Pain behind or around the kneecap, Pain when walking
Sprained ankle
Injury: Sprained ankle
Symptoms: Pain and difficulty moving the ankle, Swelling around the ankle, Bruising
Meniscus tear
Injury: Meniscus tear
Symptoms: Stiffness and swelling, Pain in your knee, Catching or locking of your knee
Rotator cuff tear
Injury: Rotator cuff tear
Symptoms: Pain when lifting and lowering your arm, Weakness when lifting or rotating your arm, Pain when lying on the affected shoulder
ACL tear
Injury: ACL tear
Symptoms: Severe pain and tenderness in knee, Loss of full range of motion, Swelling around the knee
Participating in sports and physical activity comes with the risk of injury. Some of the most common sports injuries include runner's knee, sprained ankles, meniscus tears, rotator cuff tears, and ACL tears. Being aware of the causes, symptoms, and treatments for these injuries can help athletes prevent and recover from them.
Runner's Knee
Runner's knee, also known as patellofemoral pain syndrome, is characterized by pain behind or around the kneecap. It is often caused by overuse, muscle imbalance, and inadequate stretching. Symptoms include pain under or around the kneecap, especially when walking. Treatment focuses on rest, icing the knee, strengthening exercises, stretching, and modifying training.
Sprained Ankle
A sprained ankle happens when the ankle rolls, twists, or turns beyond its normal range of motion, which can tear the ligaments. Symptoms include pain, swelling, and bruising around the ankle. Treatment includes resting the ankle, icing it, compressing it, and elevating it to reduce swelling. Physical therapy exercises can help strengthen the ankle and prevent future sprains.
Meniscus Tear
The meniscus is a piece of cartilage that cushions the knee joint. A meniscus tear occurs when the knee is forcibly twisted, often when bearing full body weight. Symptoms include knee stiffness, swelling, pain, and locking. Minor tears may heal with rest and physical therapy. More severe tears require surgical repair.
Rotator Cuff Tear
The rotator cuff is a group of muscles and tendons that stabilize the shoulder joint. Rotator cuff tears can occur from falls, lifting heavy objects, or overuse. Symptoms include shoulder pain and weakness when lifting or rotating the arm. Rest, pain relief, steroid injections, and physical therapy can help minor tears. Major tears may require surgery.
ACL Tear
The ACL provides stability to the knee joint. It can tear when the knee is forced to suddenly change direction or slow down quickly. Symptoms include severe knee pain, swelling, and loss of full range of motion. Minor tears may heal with bracing and physical therapy. Complete tears require reconstructive surgery to restore knee stability.
Being aware of common sports injuries and their treatments can help athletes stay active while reducing injury risk. Rest, icing, compression, elevation, medication, bracing, physical therapy, and surgery are all options to help the body heal.
Rapidly ship high-quality Generative AI features with voice data
Unifies your AI stack for audio
LeMUR is a single API that connects all of the spoken data in your application to an LLM to build generative features in your product. No need to chain multiple technologies together to go from audio file to LLM output.
Powered by AssemblyAI’s speech recognition models
High-quality LLM outputs on audio data start with quality transcriptions. LeMUR operates over AssemblyAI’s state-of-the-art speech recognition models, to ensure LLM outputs are top-notch.
Continuously updated with the latest in research
We are constantly experimenting with the latest research in LLMs and updating LeMUR with new techniques in retrieval, compression, prompt engineering, LLM performance, and more.
Launch quickly & effortlessly scale
Find product-market fit faster and ship new AI features at scale. The LeMUR API enables you to process over 200 hours of audio in a single API call, and handles over 1M tokens as input. The API is priced to scale as your audio data grows.
The accuracy was strong, but the great documentation and unique models like Auto Chapters and Sentiment Analysis is what really won us over.
Turn voice data into unparalleled product experiences
Partner with the leader in Speech AI to build powerful products with breakthrough industry impact.
