Artificial intelligence is rapidly advancing, and OpenAI is leading the way by making AI technology accessible to everyone. The company has recently announced its ChatGPT and Whisper API, making cutting-edge AI technology available to everyone. This new offering from OpenAI will enable developers to quickly and easily create powerful AI applications.
The company has recently announced its ChatGPT & Whisper API, making cutting-edge AI technology available to everyone. This new offering from OpenAI will enable developers to quickly and easily create powerful AI applications.
Cost Reduction and Better Access
Since December 2022, OpenAI has significantly decreased the cost of ChatGPT by 90%. The cost savings are now being extended to API users, enabling more businesses to utilize OpenAI’s language and speech-to-text capabilities. This will lead to the development of next-generation apps that are powered by ChatGPT and Whisper.
OpenAI aims to ensure that anyone can create with AI. In response to feedback from developers, the company has updated its API terms of service to better meet their requirements.
ChatGPT API: GPT-3.5-Turbo
OpenAI has recently launched a new model family called GPT-3.5-Turbo, specifically designed for non-chat applications. The pricing for this model is significantly cheaper than the existing GPT-3.5 models, costing only $0.002 per 1k tokens. This model provides excellent performance and is compatible with ChatGPT.
The GPT-3.5-Turbo model uses Chat Markup Language (ChatML) format, which allows input to be rendered as a sequence of tokens for the model to process. OpenAI is committed to improving the ChatGPT models and making these upgrades available to developers.
OpenAI has recently introduced a new feature called “dedicated instances” that enables users to have greater control over their model versions and system performance. Dedicated instances are available for developers who wish to reserve compute infrastructure solely for their requests and pay for a specified period.
With dedicated instances, developers have complete autonomy over the instance’s load, the choice to enable longer context limits, and the ability to pin the model snapshot. For developers who process over approximately 450M tokens per day, dedicated instances can be a cost-effective option.
Whisper API: Large-v2 Model
In September 2022, OpenAI released an open-source API called Whisper, which is a speech-to-text model. Since its release, developers have praised the Whisper API, but some have found it challenging to use. In response, OpenAI is now offering the large-v2 model through its API to make it more accessible to developers. The API provides on-demand access at a rate of $0.006 per minute. The Whisper API can be used through transcriptions or translation endpoints, allowing for the transcription or translation of source language into English.
OpenAI values the feedback provided by developers and has taken steps to enhance its API terms of service to cater to their requirements. The organization has pledged to enhance its uptime in the coming months to ensure that all users receive a dependable service.
In response to developer feedback, OpenAI has implemented various changes, such as seeking consent from the organization before using data provided through the API for service enhancements, implementing a default data retention policy of 30 days, improving its developer documentation, and streamlining its usage policies and Terms of Service.
OpenAI’s ChatGPT and Whisper models are now more accessible and affordable for developers. With dedicated instances, new models, and convenient on-demand access to Whisper’s speech-to-text model, developers can leverage cutting-edge technology to build the next generation of AI-powered apps. OpenAI’s commitment to improving its service and responsiveness to developer feedback shows that the company is dedicated to making AI technology accessible to everyone.