ChatGPT Breaks Free: It Can Now See, Speak, & Hear!

So ChatGPT has been upgraded with a new text to speech model and a new vision model that allow it to interact with voice and images. I've always wondered why this wasn't added before as it would be really helpful and it's finally here. But before we dive in, please subscribe and remember to turn on notifications so you're always informed. Alright, let's begin now. ChatGPT has become even smarter and more creative with the new update. OpenAI has added two new features to ChatGPT that make it more interactive and versatile. Voice interaction and image interaction. Let me explain what these features are and how they work. ChatGPT now has the capability to speak and hear you just like a regular conversation. Instead of typing to it, you can use your voice and listen to its responses, which makes it feel like you're chatting with an actual person.

We want to hear a bedtime story. Tell us a story about the super duper sunflower hedgehog named Larry. Start with telling us a little bit about him. Larry was a unique hedgehog unlike any other. He had bright sunflower petals instead of spines.

How did OpenAI make this happen? Well, they used a new text to speech model that they developed in collaboration with professional voice actors. This model uses deep neural networks to turn text into high quality speech. It can change the tone, pitch, speed and emotion of the speech, making it sound very natural. Plus it can understand and respond in various accents, languages and dialects, allowing you to converse with ChatGPT in the language you're comfortable with.

Growing up with my sister, she had this touch that made regular days feel special.

Now, image interaction is the ability of ChatGPT to see and analyze images that you show it. This means you can share pictures with ChatGPT, ask questions about them, or even learn something new from them. You can even request ChatGPT to create images based on text you give or make changes to images you already have. OpenAI introduced a new vision model named GPT Vision, also known as GPT V. This model is a variation of GPT3, but it's specially trained using a big collection of images and their corresponding text from the Internet. With this training, the model can understand what's in an image and produce appropriate descriptions or titles. It's also skilled in different image examinations like identifying objects, recognizing faces, distinguishing different parts of a scene, and more. On Top of that, GPT V is now paired with OpenAI's Dall E3, an image creation model. This lets ChatGPT make pictures from your text descriptions so you can tell ChatGPT to draw things like a cat with a hat or a cheese house or whatever you want. You can even ask it to edit pictures you already have, like changing colors or adding effects. With these new features, you can do a lot with ChatGPT. It can help with tech problems, study graphs, help with meal plans, teach you something new, or just let you have fun with voice and pictures. Now, if you're curious about how to try these features, there are two ways. A free one and a paid one for free. You can use Microsoft's Bing search engine, which essentially lets you talk with ChatGPT by typing or speaking. You can also send pictures to ChatGPT through Bing or from your own device. Now, if you want to use it in its native format, you can pay for ChatGPT plus it's better than the free version, giving you quicker answers, first dibs on new things, and more. It costs $20 each month and is available everywhere. Okay, now ChatGPT isn't the only AI project receiving attention and improvements. Other major tech companies are also developing their own AI technologies and competing with OpenAI. Take Amazon as an example. Even though they've been involved in areas like cloud computing and machine learning for years, they were somewhat late to focus heavily on AI compared to other big Silicon Valley companies. But now Amazon is making a big move. They are investing in Anthropic, which actually competes with OpenAI. Initially, Amazon will invest $1.25 billion, but this might increase to $4 billion. In return, Anthropic will use Amazon's cloud services and AI chips for their projects. This doesn't mean Amazon is the top player in AI, as companies like Google and Microsoft lead the field. However, the deal might benefit Amazon in the future. They aim to make their AI chips Trainium and Inferentia, as renowned as Nvidia's AI chips. This move can also boost its service Amazon Bedrock, which supports AI app development. So Amazon is getting serious about AI, and the market seems to like it. After they announced the deal, Amazon's value went up by $21 billion. That's a big win for an initial investment of $1.25 billion. Alright, if you enjoyed this video, don't forget to hit the like button. Subscribe to my channel and click the Bell icon to stay updated on all my future uploads. Thanks for tuning in and I'll catch you in the next one.