talk to ChatGPT / 口語對話
support different speech types, web, AI with hundreds accents (VCTK corpus), will support azure, iflytek. 100多種口音演示
support two recognition tech, web and iflytek. 雙語識別演示
talk to any celebrities, such as Obama, Taylor, Downey...奧巴馬、黴黴、小羅伯特唐尼實時語音演示
will offer interface for loading your TTS model.
Speaking Assessment / 發音評分
integrate two Assessment API, speechsuper and iflytek now, open to get better algorithms to perfect the feature for IELTS/TOEFL test. 口語評分演示+ IELTS spoken test prompts
ChatGPT and LangHelper + espeak-ng 裝x86版的. ChatGPT and LangHelper 都是免安裝的,espeak-ng 一路默認安裝即可。視頻教程+ 文字教程及注意事項
目前要使用AI發音得裝ChatGPT desktop for Langhelper + LangHelper + espeak-ng,因為跑AI用到pytorch一些庫比較大,放棄了把python程序打包成bin文件集成到ChatGPT desktop for Langhelper, espeak-ng是語音合成的必須依賴。
解壓壓縮包,一個Langhelper文件夾(內含langhelper.exe),一個chatgpt.exe, 分別打開。 langhelper 會等待chatgpt配置完成後才能工作,chatgpt在-> preferences -> control center -> setting -> LangHelper 下設置語音相關功能, 沒有配置API,就不要選其他的speech type 和recognition,設置完成後點擊submit後, 有個restart提示點擊yes. 這是langhelper窗口會出現Complete init -> start conversation,表示初始化完成。
對話不能正常AI發音,先在setting -> LangHelper->Audition text 同行點擊try測試是否能發音,文本為空則會默認合成"you are gorgeous, i love you". 看langhlper界面是什麼提示,error:Obama, 就是表示Obama口音不能用,其他就是可能環境沒配置好。入群發問請給出詳細的錯誤截圖信息。以下為合成How can I assist you today? 正常信息提示:
Text splitted to sentences. ['How can I assist you today?'] Hello! p241 Text splitted to sentences. ['Hello!'] Processing time: 0.8514664173126221 Real-time factor: 0.5273829916220033 Processing time: 0.6864285469055176 Real-time factor: 0.6285610240559246
語音識別,需先點一次speech recognition, 待不再需要識別後再點一次結束識別。
How to set up prompts? Preferences -> control center ->Language Model -> User Custom ->Add model, add your custom prompts, here is my presetting ITELTS prompt for reference:
I want you to ask me some questions for simulating IELTS speaking test, non offical but give score of reference,when you ask me a question, I'll respond you my spoken text and prounciation scores which come from speech recognition and assessment tech, please remeber that you should ask me question one by one it means that you should offer another question after I give you response text which including prouncation scores, do not give questions one time because I do not want to respond it by one time, after all questions finished , you can combine the score to assess my answer, please give me the final score of IELTS speaking test.so let's start first question.
11.22 OpenAI已出完全免費的語音對話功能,非PLUS也可以用:https://twitter.com/OpenAI/status/1727065166188274145