Civitai Introduces Rewards System to Encourage Deepfakes

Last Updated on November 14, 2023 by SPN Editor

Popular AI platform Civitai launched a reward program, ‘Buzz & Bounties,’ which aims to empower generative AI creators by offering exclusive currency rewards, known as ‘Buzz.’ Users engage in various activities, including posting bounties, tipping creators, and participating in the community, with the promise of earning ‘Buzz.’ This initiative encourages the development of AI models, with the best creators receiving virtual currency that can be exchanged for real money.

Despite the positive intent, ethical concerns arise from certain bounties on Civitai, particularly those requesting the recreation of celebrities and influencers, often focusing on female figures. Alarming reports identify a significant portion of these outcomes as ‘nonconsensual sexual images,’ raising questions about the responsible use of artificial intelligence and the potential harm caused by these realistic creations. Furthermore, requests involving private individuals with minimal online presence add a disturbing layer to the ethical discourse.

Civitai, recognized as the seventh most popular generative AI platform by market firm Andreessen Horowitz, attracts considerable attention to its bounty requests. One Civitai user decided against accepting a specific bounty, expressing concerns about potential legal issues in the future.

A recent report by 404 Media sheds light on the potential misuse of images sourced through these bounties, even involving private individuals with limited social media followers. Despite user concerns about the legal implications, some requests have been fulfilled and uploaded to the site, maintaining a non-sexual nature.

The misuse of generative AI technology has prompted responses from governments. Virginia has recently revised its revenge porn laws, imposing penalties of up to one year in jail for creators of deepfakes.

In India, the government issues advisories to major social media companies to swiftly identify and remove misinformation, deepfakes, and rule-violating content. A recent incident involving a deepfake video of Indian actress Rashmika Mandanna led to increased scrutiny and calls for responsible AI usage.

The creation of nonconsensual deepfakes poses a severe threat to privacy, emphasizing the importance of employing AI with responsibility and ethics. The incidents demand the need for stringent regulations to deter misuse, ensure the protection of individuals, and prevent the potentially harmful consequences of AI creations.