The number of parameters refers to the size of the model, with larger models generally being more skilled. In 2019, researchers found that creating a generative AI model called BERT with 110 million parameters consumed the energy of a round-trip transcontinental flight for one person. The exact energy cost of a single AI model is difficult to estimate, and includes the energy used to manufacture the computing equipment, create the model and use the model in production. However, it only recently gained the ability to generate humanlike language and realistic photos. It has long been used in applications like smart speakers to generate audio responses, or in autocomplete to suggest a search query. Generative AI can create much more complex outputs, such as a sentence, a paragraph, an image or even a short video. An example of a discriminative output is choosing whether to approve a loan application. The alternative is “discriminative” AI, which chooses between a fixed number of options and produces just a single number. “Generative” refers to the ability of an AI algorithm to produce complex data. What does the emergence of increasingly more powerful generative AI models mean for society’s future carbon footprint? The more powerful the AI, the more energy it takes. But how hot is it making the planet?Īs an AI researcher, I often worry about the energy costs of building artificial intelligence models. Generative AI is the hot new technology behind chatbots and image generators.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |