Explainer: What is Generative AI, the technology behind OpenAI’s ChatGPT?

The responses might also incorporate biases inherent in the content the model has ingested from the internet, but there is often no way of knowing whether that’s the case. Both of these shortcomings have caused major concerns regarding the role of generative AI in the spread of misinformation. Generative AI is, therefore, a machine-learning framework, but all machine-learning Yakov Livshits frameworks are not generative AI. When you click through from our site to a retailer and buy a product or service, we may earn affiliate commissions. This helps support our work, but does not affect what we cover or how, and it does not affect the price you pay. Indeed, we follow strict guidelines that ensure our editorial content is never influenced by advertisers.

Generative AI’s breakthroughs in writing and images have captured news headlines and people’s imaginations. Building a custom generative AI app requires a model, as well as adjustments such as human-supervised fine-tuning or a layer of data specific to a use case. These are just a few of the many generative AI tools available for businesses. It’s important to carefully evaluate each tool and choose the one that best meets your specific needs and requirements. By detecting patterns and anomalies in these images, generative AI can assist radiologists in identifying potential health issues and making more accurate diagnoses. The necessary infrastructure, including hardware and software resources, is prepared to host the generative AI model in a production environment.

What are some examples of generative AI models?

Consider how CarMax leveraged GPT-3, a large language model, to improve the car-buying experience. CarMax used Microsoft’s Azure OpenAI Service to access a pretrained GPT-3 model to read and synthesize more than 100,000 customer reviews for every vehicle the company sells. The model then generated 5,000 helpful, easy-to-read summaries for potential car buyers, a task CarMax said would have taken its editorial team 11 years to complete. When ChatGPT launched in late 2022, it awakened the world to the transformative potential of artificial intelligence (AI). Across business, science and society itself, it will enable groundbreaking human creativity and productivity. Yes, generative AI can potentially generate biased content if it is trained on biased or unrepresentative datasets.

Accenture has identified Total Enterprise Reinvention as a deliberate strategy that aims to set a new performance frontier for companies and the industries in which they operate. Centered around a strong digital core, it helps drive growth and optimize operations by simultaneously transforming every part of the business through technology and new ways of working. Embedded into the enterprise digital core, generative AI will emerge as a key driver of Total Enterprise Reinvention. With the complex technology underpinning generative AI expected to evolve rapidly at each layer, technology innovation will be a business imperative. An effective, enterprise-wide data platform and architecture and modern, cloud-based infrastructure will be essential to capitalize on new capabilities and meet the high computing demands of generative AI.

Product Downloads

In RLHF, a generative model outputs a set of candidate responses that humans rate for correctness. Through reinforcement learning, the model is adjusted to output more responses like those highly rated by humans. This style of training results in an AI system that can output what humans deem as high-quality conversational text. In 2017, Google reported on a new type of neural network architecture that brought significant improvements in efficiency and accuracy to tasks like natural language processing. The breakthrough approach, called transformers, was based on the concept of attention. Generative AI starts with a prompt that could be in the form of a text, an image, a video, a design, musical notes, or any input that the AI system can process.

This involves training an AI on a dataset until it can make educated “guesses” about how to create new data similar to what it has been trained on. First described in a 2017 paper from Google, transformers are powerful deep neural networks that learn context and therefore meaning by tracking relationships in sequential data like the words in this sentence. That’s why this technology is often used in NLP (Natural Language Processing) tasks. Discriminative algorithms try to classify input data given some set of features and predict a label or a class to which a certain data example belongs.

At its core, generative AI is a subset of artificial intelligence that leverages machine learning models to create new data from existing ones. As if you were giving your computer the ability to dream, imagine, and create. Generative AI is a type of artificial intelligence that can produce various types of data — images, text, video, audio, etc. — after being fed large volumes of training data. Generative AI models are trained by feeding their neural networks large amounts of data that is preprocessed and labeled — although unlabeled data may be used during training. A generative adversarial network or GAN is a machine learning algorithm that puts the two neural networks — generator and discriminator — against each other, hence the “adversarial” part.

Yakov Livshits
Founder of the DevEducation project
A prolific businessman and investor, and the founder of several large companies in Israel, the USA and the UAE, Yakov’s corporation comprises over 2,000 employees all over the world. He graduated from the University of Oxford in the UK and Technion in Israel, before moving on to study complex systems science at NECSI in the USA. Yakov has a Masters in Software Development.

This step ensures the model’s reliability and stability in a production environment. There are many tools that are currently available for text, visual and audio domains. Let’s further explore the most commonly used tools that employ generative AI via the diagram below. The landscape of risks and opportunities is likely to change rapidly in coming weeks, months, and years. New use cases are being tested monthly, and new models are likely to be developed in the coming years.

Divi Products & Services

Generative AI has a wide range of applications in a variety of industries, including art, music, literature, and video games. The most popular examples of generative AI are in the field of language, where language models such as ChatGPT have become widely used. These models have been trained on vast amounts of text data and are able to generate new content that is often indistinguishable from content written by a human. By leveraging advanced deep learning algorithms and neural networks, Dall-E can create highly detailed images based on simple input phrases.

• Below you will find a few prominent use cases that already present mind-blowing results.
• A transformer is made up of multiple transformer blocks, also known as layers.
• Even before ChatGPT captured headlines (and began writing its own), generative AI systems were good at mimicking human writing.
• If the company is using its own instance of a large language model, the privacy concerns that inform limiting inputs go away.
• GPT-4, a newer model that OpenAI announced this week, is “multimodal” because it can perceive not only text but images as well.
• School systems have fretted about students turning in AI-drafted essays, undermining the hard work required for them to learn.

Below, we will quickly look at a list of generative artificial intelligence applications in different industries. Many interactive applications require fast generation speeds, such as real-time image editing, for content creation workflows. As such, the speed at which a generative model can produce outputs is also important Yakov Livshits to consider when evaluating its effectiveness. To create a DeepDream image, the algorithm takes an input image and passes it through multiple layers of a pre-trained neural network. At each layer, the algorithm tries to enhance certain image features by amplifying the patterns that the network recognizes.

Content

When users enter a prompt, artificial intelligence generates responses based on what it has learned from existing examples on the internet, often producing unique and creative results. A generative adversarial network, or GAN, is based on a type of reinforcement learning, in which two algorithms compete against one another. One generates text or images based on probabilities derived from a big data set.

These transformers are run unsupervised on a vast corpus of natural language text in a process called pretraining (that’s the P in GPT), before being fine-tuned by human beings interacting with the model. Generative AI has been around for years, arguably since ELIZA, a chatbot that simulates talking to a therapist, was developed at MIT in 1966. But years of work on AI and machine learning have recently come to fruition with the release of new generative AI systems. You’ve almost certainly heard about ChatGPT, a text-based AI chatbot that produces remarkably human-like prose.

It can detect even subtle anomalies that could indicate a threat to your business and autonomously respond, containing the threat in seconds. It’s also worth noting that generative AI capabilities will increasingly be built into the software products you likely use everyday, like Bing, Office 365, Microsoft 365 Copilot and Google Workspace. This is effectively a “free” tier, though vendors will ultimately pass on costs to customers as part of bundled incremental price increases to their products. Gartner sees generative AI becoming a general-purpose technology with an impact similar to that of the steam engine, electricity and the internet. The hype will subside as the reality of implementation sets in, but the impact of generative AI will grow as people and enterprises discover more innovative applications for the technology in daily work and life.

With the help of generative AI, models become multimodal, which means they are able to process several modalities at a time, such as text and images, which expands their areas of application and makes them more versatile. Such models can be absolutely new or stem from 2D images previously entered into it. And 2D pictures can also be generated by the technology to find further use in specific game and cartoon genres. Together with cinema, the video game industry is another entertainment realm that relies on moving images, and generative AI can lend a helping hand as well.