What's the Buzz?

Nightshade, a newly developed tool, allows artists to discreetly modify their digital art. If these altered artworks are used without permission to train AI models, the results can be chaotic. Think of cars turning into cows or dogs morphing into cats!

Why Does This Matter?

1. Theft of Art: Some AI corporations have been accused of training their models using artists’ works without obtaining consent.

2. Shifting the Power: Nightshade aims to give the control back to artists, forcing companies to reconsider using art without permission.

3. Peek into the Future: If this tool is widely adopted, AI models trained on unauthorized data could produce bizarre outputs.

Deep Dive into Nightshade

• Sister Tool: There’s another tool called Glaze that masks an artist’s unique style, making it harder for AI to scrape and recognize. Nightshade will soon be integrated into Glaze.

• Open Source: Nightshade is going public, encouraging more people to customize and use it, thereby increasing its potency.

• The Mechanism: Nightshade subtly tweaks image pixels, undetectable to humans but confusing for AIs. This data corruption spreads throughout the AI, causing it to associate unrelated objects.

What Have They Found?

Researchers observed that when certain AI models, like Stable Diffusion, were trained on just a few Nightshade-altered images:

• With 50 altered images: Generated creatures had too many limbs.

• With 300 altered images: Dogs appeared as cats.

The Risks

• While Nightshade can be a boon for artists, it’s not devoid of risks.

• There's potential misuse for malicious intents.

• Defenses against such tools are currently unknown, creating a possible vulnerability in AI models.

Voices from the Field

• Vitaly Shmatikov, an AI security expert, stresses the urgency of finding defenses against such attacks.

• Gautam Kamath praises the research, emphasizing the increasing vulnerabilities of modern AI models.

• Junfeng Yang believes Nightshade might make companies more considerate of artists' rights.

Artists Speak Out

Eva Toorenent, an illustrator, believes tools like Nightshade could force AI companies to act more ethically. Another artist, Autumn Beverly, shared her renewed confidence in posting her work online, thanks to such protective tools.

In a nutshell, while AIs are taking leaps in technological advancement, artists are not sitting idle. Nightshade and similar tools represent the artists' stand against unauthorized use of their creations.

source: This new data poisoning tool lets artists fight back against generative AI

Hope you enjoyed today's newsletter

Follow me on Twitter and Linkedin for more AI news and resources.

Did you know you can add Superpower Daily to your RSS feed https://rss.beehiiv.com/feeds/GcFiF2T4I5.xml

⚡️ Join over 200,000 people using the Superpower ChatGPT extension on Chrome and Firefox.