15
6 Comments

Let users generate anything with AI - 10% of results were NSFW

Built anycrap.shop where users can generate any product with AI. They generated everything. Including 1000+ dildos. Manually moved them to a new NSFW category. My life choices are questionable.

What Happened

Gave users unlimited AI product generation.
Expected: fun and quirky absurd stuff
Got: That plus a LOT of adult products
Like, a concerning amount.

The Solution (Manual Labor Edition)

Spent weekends manually reviewing and moving ~1500 products to a new NSFW category.
Yes, manually.
I hope, all of them.
No, I don't want to talk about it.

Current Status

  • NSFW category: exists

  • Products: categorized by hand

  • My browser history: cursed

  • Automatic filtering: in the backlog

Lessons Learned

1. "Generate anything" is too powerful
The internet will use ALL of it.

2. Manual moderation doesn't scale
This worked for 1000 products. Won't work for 10,000.

3. Should've added filters from Day 1
Hindsight is 20/20. Foresight was 0/20.

4. The internet remains undefeated
Always has been. Always will be.

What's Next

Build actual content filtering before this gets worse.
Keyword detection? AI moderation? Just disabling generation entirely?
Still figuring it out.


Tech: Next.js, Cloudflare Workers AI, regret
Current approach: Manual categorization (send help)
Future approach: Actual filters (hopefully)
Anyone else manually moderate AI-generated content? How's your therapy going?

posted toAvatar for product Anycrap
Anycrap
  1. 2

    This is so freaking funny. Wishing you lots of luck setting up all the filters for workarounds people can find for these things 😂

  2. 2

    This is hilarious and painfully relatable. “Generate anything” really does mean anything. Props to you for pushing through the manual moderation — that’s some real founder grit right there. Definitely learned the hard way that filters aren’t optional!

  3. 2

    Not surprising lol

  4. 2

    Funny how people use powerfull tools for "joy".

  5. 2

    what do you use for image generation ? the image generated are pretty nice.

    are the prompts for image generation also generated by AI ?

    1. 2

      It's flux-1-schnell model, and prompt is pretty unique for each product (the random combo of background, camera setup, lighting, product details)