Deepgram | liteLLM (original) (raw)

LiteLLM supports Deepgram's /listen endpoint.

Property Details
Description Deepgram's voice AI platform provides APIs for speech-to-text, text-to-speech, and language understanding.
Provider Route on LiteLLM deepgram/
Provider Doc Deepgram ↗
Supported OpenAI Endpoints /audio/transcriptions

Quick Start​

from litellm import transcription
import os 

# set api keys 
os.environ["DEEPGRAM_API_KEY"] = ""
audio_file = open("/path/to/audio.mp3", "rb")

response = transcription(model="deepgram/nova-2", file=audio_file)

print(f"response: {response}")

LiteLLM Proxy Usage​

Add model to config​

  1. Add model to config.yaml
model_list:
- model_name: nova-2
  litellm_params:
    model: deepgram/nova-2
    api_key: os.environ/DEEPGRAM_API_KEY
  model_info:
    mode: audio_transcription
    
general_settings:
  master_key: sk-1234

Start proxy​

litellm --config /path/to/config.yaml 

# RUNNING on http://0.0.0.0:4000

Test​

curl --location 'http://0.0.0.0:4000/v1/audio/transcriptions' \
--header 'Authorization: Bearer sk-1234' \
--form 'file=@"/Users/krrishdholakia/Downloads/gettysburg.wav"' \
--form 'model="nova-2"'