Gradio——语音对话demo

本文讲述了如何在Gradio中集成AzureOpenAI和KimiAPI,实现音频转文字、聊天bot互动及TTS功能,展示了技术在内容社区中的应用实例。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

import gradio as gr
import os
import random
import json
import requests
import time

from openai import  AzureOpenAI

# audio to text here
def audio_to_text(audio_path):
    """
    audio to text here,目前是openai whisper

    Parameters:
        audio_path: str, 音频文件路径
    Returns:
        transcription.text: str, 音频转换的文本
    """

    if audio_path == None or "":
        return None
        
    print(f"正在处理audio_path:{
     audio_path}")
    client = AzureOpenAI(
        api_key='',
        api_version = "",
        azure_endpoint="https://speech-01.openai.azure.com/"
    )

    audio_file= open(audio_path, "rb")
    transcription = client.audio.transcriptions.create(
        model="whisper", 
        file=audio_file
    )
    print(transcription.text)
    return transcription.text

def chat_completions(messages, gr_states, history):
    """
    chat completion here,目前是kimi free api

    Parameters:
        messages: openai 格式 messages
    Returns:
        response: dict, openai chat api返回的结果
    """
    if not messages:
        return gr_states, history
    
    headers = {
    
        "Content-Type": "application/json",
        "Authorization": "Bearer " + "{your refresh token here}"
        }

    max_retry = 5
    retry = 0
    while retry < max_retry:
        try:
            retry += 1
            response = requests.post(
                url="{your free kimi api deploy url here}",
                headers=headers,
                data=json.dumps({
   
                    "model": "kimi",  
                    "messages": messages,
                    "stream": False,
                    # "temperature": 0.8,
                }),
            )
            
            print(response.json())
            content = response.json(
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值