San Francisco: Sam Altman-run OpenAI on Monday announced it is rolling out new voice and image capabilities in ChatGPT that can now help the AI chatbot see, hear and speak.
These capabilities offer a new, more intuitive type of interface by allowing you to have a voice conversation or show ChatGPT what you’re talking about, the company said in a statement.
“Voice mode and vision for chatGPT! really worth a try,” Altman posted on X.
The company said it is rolling out voice and images in ChatGPT to Plus and Enterprise users over the next two weeks.
“Voice is coming on iOS and Android (opt-in in your settings) and images will be available on all platforms,” said the Microsoft-backed company.
The new voice capability is powered by a new text-to-speech model, capable of generating human-like audio from just text and a few seconds of sample speech.
“We collaborated with professional voice actors to create each of the voices. We also use Whisper, our open-source speech recognition system, to transcribe your spoken words into text,” said OpenAI.
Image understanding is powered by multimodal GPT-3.5 and GPT-4. These models apply their language reasoning skills to a wide range of images, such as photographs, screenshots, and documents containing both text and images.
The new voice technology opens doors to many creative and accessibility-focused applications.
However, “these capabilities also present new risks, such as the potential for malicious actors to impersonate public figures or commit fraud,” the company noted.
“This is why we are using this technology to power a specific use case — voice chat. Voice chat was created with voice actors we have directly worked with,” it added.
Spotify is using the power of this technology for the pilot of their Voice Translation feature, which helps podcasters expand the reach of their storytelling by translating podcasts into additional languages in the podcasters’ own voices.
“We’ve also taken technical measures to significantly limit ChatGPT’s ability to analyze and make direct statements about people since ChatGPT is not always accurate and these systems should respect individuals’ privacy,” said the company. – IANS
Israel, Hamas agree to extend truce, more int’l mediation in place
Doha/Gaza: With the four-day ceasefire expiring on Tuesday, Israel and Hamas have agreed to extend the humanitarian pause by two days, a Qatari Foreign Ministry spokesperson confirmed. "The State of...
COP28: India too has no ‘option’ than to invest in nature
New Delhi: India is also facing the serious consequences of climate change and it has no option than to invest in nature. At COP28, leaders from across the globe must...
Biomass burning, vehicle pollution, secondary aerosols worsened Delhi’s air quality in Nov
New Delhi, Nov 27 (IANS) The Real-time source apportionment study data has highlighted biomass burning, secondary aerosols and vehicles as some of the main contributors to the worrying air quality...
Hamas seeks to extend four-day truce with Israel
Tel Aviv: Hamas has said that it seeks to extension of the ongoing four-day truce with Israel, which has so far witnessed the release of three groups of Israeli hostages...
Freedom fighter’s daughter proves citizenship after three-year legal battle
Guwahati: After fighting a legal battle for more than three years, Seje Bala Ghosh, daughter of a freedom fighter from Assam's Bongaigaon district, has finally been successful in proving that...
Poll management holds the key as cliffhanger awaits Telangana
Hyderabad: With just five days left for polling, Telangana is set for a cliffhanger as the ruling Bharat Rashtra Samithi (BRS) and the opposition Congress are locked in a neck...
Hamas to release 14 Israel hostages, 42 Palestinians also to be freed
Tel Aviv, Nov 25 (IANS) As part of the truce deal between Israel and Hamas, the latter will release 14 Israeli hostages while Israel will release 42 Palestinians on Friday...
Israeli army withdraws from Gaza’s largest hospital
Gaza: The Israeli army withdrew on Friday from the Al Shifa Hospital in Gaza after raiding the premises for over a week, a Palestinian security source said. The source, who...
Sunderbans women show the world how mangroves reduce impact of cyclones
Kolkata: At a time when West Bengal is hitting the national headlines for all the wrong reasons, there is at least one area where the state has been acclaimed nationally...
Pakistan confirms making formal request to join BRICS
Islamabad: The Pakistani Foreign Ministry confirmed that the nation has made a formal request to join th BRICS -- Brazil, Russia, India, China, South Africa -- bloc, saying it is...
Centre gives 7-day deadline to social media platforms to address deepfakes
New Delhi: The Centre on Friday gave a seven-day deadline to social media platforms to tweak their policies as per Indian regulations in order to address the spread of deepfakes...
4-day humanitarian pause deal between Hamas-Israel comes into effect
Gaza: A four-day humanitarian pause deal agreed by Israel and Hamas came into effect in Gaza on Friday, which allow the release of at least 50 hostages in the duration...
