OpenAI's ChatGPT, which produces life-like responses to text prompts, is taking the internet by storm.Ray comes from $1 billion startup Anyscale and is also the likely framework behind GPT-4.
Ray is already earning top marks in the field. Prior to deploying it, OpenAI used a hodgepodge set of custom tools to develop early models and products.
"AI is incredibly fast-moving and new approaches and people are trying new approaches all the time," Anyscale CEO Robert Nishihara told Insider."ChatGPT combined a lot of the previous work on large language models with reinforcement as well. Underlying this you need to have infrastructure that enables that flexibility and innovate quickly and scale different algorithms and approaches.
Sometimes it's not even the same hardware — and can contain a mix of products like Google Cloud, AWS, and others working on the same problem. Tapping Ray removes that immense layer of complexity, opening up more time and energy for a company like OpenAI to focus on their key competency.Ray is just one in a series of rapidly emerging next-generation machine learning tools that are quickly upending the way development happens. Google's JAX framework, for example, is also gathering enormous traction., as it's already achieved widespread adoption in its DeepMind and Google Brain divisions.