Section 1.1: Engaging in Voice Conversations

With the new voice feature, ChatGPT can function like a voice assistant, akin to Siri. Simply press a button to initiate a dialogue with it. You can request bedtime stories, inquire about various topics, or seek advice. The best part? You can keep the conversation flowing by asking follow-up questions after receiving a response.

If you are among the fortunate ChatGPT Plus users with this feature, here’s how to enable it in the mobile app:

1. Go to Settings
2. Select New Features
3. Opt into voice conversation
4. Tap the headphone icon below

OpenAI utilizes its Whisper speech recognition technology to convert your spoken input into text. While it excels at transcribing English, it may struggle with languages that utilize non-Roman scripts. Users can select from five distinct AI voices, which closely mimic human tones. My personal favorite is Cove, reminiscent of narrators from previous audiobooks I enjoyed.

Additionally, Spotify is collaborating with OpenAI to pilot a Voice Translation feature, enabling podcasters to translate their content into multiple languages, all while retaining their unique vocal characteristics. Remarkable, isn't it?

Section 1.2: Conversing About Images

ChatGPT is also equipped to analyze images, allowing you to discuss content presented in photographs. This functionality is beneficial for everyday challenges, such as troubleshooting a broken appliance, planning meals based on visual ingredient lists, or interpreting data from graphs.

To illustrate this, check out the following demonstration from OpenAI.

For those with access to these features, new icons will appear when using ChatGPT.

To engage, simply tap the photo icon to capture or upload an image. You can even draw on the image to provide guidance for your assistant!