AssemblyAI Unveils Enhanced PII Redaction And Entity Detection Features

Jessie A Ellis Jul 26, 2024 05:52

AssemblyAI introduces advanced PII Redaction in 47 languages and adds 16 new entity types to its Entity Detection model, ensuring 99% accuracy.

AssemblyAI Unveils Enhanced PII Redaction and Entity Detection Features

AssemblyAI has announced significant upgrades to its PII Redaction and Entity Detection features, aimed at enhancing data security and extracting key insights from audio transcripts. According to AssemblyAI, the latest updates include support for PII Text Redaction across 47 languages and the addition of 16 new entity types to its Entity Detection model, bringing the total to 44.

Enhanced PII Redaction Capabilities

The updated PII Text Redaction feature now supports 47 languages, ensuring comprehensive protection of personally identifiable information (PII) across diverse regions. This upgrade allows users to identify and remove sensitive data such as addresses, phone numbers, and credit card details from their transcripts. Additionally, users can generate transcripts with PII removed or use the tool to "beep out" sensitive information in audio files.

An example of how to use the API for PII redaction is provided by AssemblyAI:

import assemblyai as aai

aai.settings.api_key = "YOUR API KEY"

audio_url = "https://github.com/AssemblyAI-Community/audio-examples/raw/main/20230607_me_canadian_wildfires.mp3"

config = aai.TranscriptionConfig(speaker_labels=True).set_redact_pii(
  policies=[
    aai.PIIRedactionPolicy.person_name,
    aai.PIIRedactionPolicy.organization,
    aai.PIIRedactionPolicy.occupation,
  ],
  substitution=aai.PIISubstitutionPolicy.hash,
)

transcript = aai.Transcriber().transcribe(audio_url, config)

for utterance in transcript.utterances:
  print(f"Speaker {utterance.speaker}: {utterance.text}")
  
print(transcript.text)

Users can refer to AssemblyAI's documentation for more detailed examples and an in-depth dive into the updates.

Expanded Entity Detection

The Entity Detection model has been upgraded with 16 new entity types, allowing for the automatic identification and categorization of critical information in transcripts. This brings the total number of supported entity types to 44, which includes names, organizations, addresses, and more. The model ensures 99% accuracy in major languages, making it a robust tool for extracting valuable insights from audio data.

An example of how to use the API for Entity Detection is also provided:

import assemblyai as aai

aai.settings.api_key = "YOUR API KEY"

audio_url = "https://github.com/AssemblyAI-Community/audio-examples/raw/main/20230607_me_canadian_wildfires.mp3"

config = aai.TranscriptionConfig(entity_detection=True)

transcript = aai.Transcriber().transcribe(audio_url, config)

for entity in transcript.entities:
  print(entity.text)
  print(entity.entity_type)
  print(f"Timestamp: {entity.start} - {entity.end}\n")

Additional Resources

AssemblyAI has also shared several new blog posts and tutorials to help users get the most out of their products. Topics include using Claude 3.5 Sonnet with audio data, understanding Microsoft's Florence-2 image model, and creating a real-time language translation service with AssemblyAI and DeepL in JavaScript.

For more information on these updates and to explore additional resources, visit AssemblyAI's official blog.

Image source: Shutterstock
RECENT NEWS

Ether Surges 16% Amid Speculation Of US ETF Approval

New York, USA – Ether, the second-largest cryptocurrency by market capitalization, experienced a significant surge of ... Read more

BlackRock And The Institutional Embrace Of Bitcoin

BlackRock’s strategic shift towards becoming the world’s largest Bitcoin fund marks a pivotal moment in the financia... Read more

Robinhood Faces Regulatory Scrutiny: SEC Threatens Lawsuit Over Crypto Business

Robinhood, the prominent retail brokerage platform, finds itself in the regulatory spotlight as the Securities and Excha... Read more

Surprise Crypto Surge May Come This Week – Here Are The Top Coins To Keep An Eye On

This week’s crypto market shift has investors buzzing—find out which digital currencies could be poised for a breako... Read more

CFTC Wins $36m Victory In California Crypto Fraud Case

New York resident William Koo Ichioka agreed to pay $36 million in a CFTC case alleging cryptocurrency and forex fraud. ... Read more

Experts Predict 5000% Gains For This Solana Memecoin Set To Rival Dogecoins 2021 Surge

Discover a new memecoin on Solana, inspired by Dogecoin, with analysts predicting gains of up to 5,000%. #partnercontent Read more