Researchers in both industry and academia found that the most popular and upcoming AI image generators can “memorize” images from the data they’re trained on. Instead of creating something completely new, certain prompts will get the AI to simply reproduce an image. Some of these recreated images could be copyrighted. But even worse, modern AI generative models have the capability to memorize and reproduce sensitive information scraped up for use in an AI training set.
Source: Researchers Prove AI Art Generators Can Simply Copy Existing Images