Through a Twitter post, OpenAI announced a substantial enhancement to its latest artificial intelligence (AI) model, GPT-4 Turbo, introducing computer vision capabilities on April 9, according to an Analytics India Magazine report.
Among the highlighted features powered by GPT-4 Turbo with Vision are the AI coding assistant Devin and Healthify’s Snap feature.
Integration of computer vision capabilities into OpenAI’s latest AI model, GPT-4 Turbo with Vision, represents a significant advancement in AI technology.
The announcement, shared via OpenAI Developers’ official X (formerly known as Twitter) account, emphasized the availability of GPT-4 Turbo with Vision in the API, enhancing accessibility for developers.
GPT-4 Turbo with Vision builds upon the GPT-4 model, integrating Turbo’s heightened token outputs with improved computer vision capabilities.
Through a Twitter post, OpenAI announced a substantial enhancement to its latest artificial intelligence (AI) model, GPT-4 Turbo, introducing computer vision capabilities on April 9, according to an Analytics India Magazine report. This development equips the AI model with the ability to process and analyze multimedia inputs such as images and videos, expanding its utility beyond text-based interactions.
Among the highlighted features powered by GPT-4 Turbo with Vision are the AI coding assistant Devin and Healthify’s Snap feature. Devin assists in navigating complex coding tasks, leveraging the model’s vision capabilities within its sandbox environment. Healthify’s Snap feature enables users to capture images of meals, with the platform now utilizing GPT-4 Turbo with Vision to estimate calorie intake and provide personalized recommendations for healthier eating habits.
Why this matters?
Integration of computer vision capabilities into OpenAI’s latest AI model, GPT-4 Turbo with Vision, represents a significant advancement in AI technology. By enabling the analysis of multimedia inputs such as images and videos, this development expands the model’s utility beyond text-based interactions, opening up new possibilities for real-world applications in fields such as coding assistance, health, and beyond. Additionally, the upcoming release of Voice Engine and GPT-5 further underscores OpenAI’s commitment to pushing the boundaries of AI innovation, promising even more sophisticated capabilities in natural language processing and reasoning, which could have profound implications for various industries and everyday life.
The announcement, shared via OpenAI Developers’ official X (formerly known as Twitter) account, emphasized the availability of GPT-4 Turbo with Vision in the API, enhancing accessibility for developers. Additionally, the rollout of this feature within ChatGPT expands its reach and usability.
GPT-4 Turbo with Vision builds upon the GPT-4 model, integrating Turbo’s heightened token outputs with improved computer vision capabilities. This combination enhances the model’s ability to analyze multimedia files, offering diverse applications for end-users and developers alike.
With a context window of 128,000 tokens and training data extending up to December 2023, the unveiled AI model represents a significant advancement in AI capabilities.
Furthermore, OpenAI has revealed its recent development, Voice Engine, designed to generate natural-sounding speech from text input and a mere 15-second audio sample. Notably, Voice Engine can create emotive and realistic voices using this brief audio input, although it has not yet been made available to the public.
Additionally, OpenAI has indicated that its next model, GPT-5, is on the horizon with improved reasoning skills. Brad Lightcap, OpenAI’s chief operating officer, mentioned in an interview with the Financial Times that GPT-5 will focus on tackling tough problems, especially in the area of reasoning.
Also Read:
STAY ON TOP OF TECH NEWS: Our daily newsletter with the top story of the day from MediaNama, delivered to your inbox before 9 AM. Click here to sign up today!
