Oddbean new post about | logout
▲ ▼
Rif'at Ahdi R | 3 months ago (raw) | root | parent | reply | flag +3 
 Sorry to hear that Quentin, thank you for your service. It is really hard to handle those issue as media service provider.

Maybe, you can take a look on
https://github.com/atrifat/nsfw-detector-api and might be modify it.

I've used that as module for nfrelay.app . It is effective and really help to handle the issue. Hopefully, it can also help you.
▲ ▼
The Fishcake🐶🐾 | 3 months ago (raw) | root | parent | reply | flag +3 
 Already doing it, but CSAM requires and has a different solution 🐶🐾🫡
▲ ▼
Rif'at Ahdi R | 3 months ago (raw) | root | parent | reply | flag 
 I have some idea to improve and adjust it to be able detect CSAM. Is it ok to send through to your DM (Regular DM or Gift-Wrapped DM) Fishcake?
▲ ▼
The Fishcake🐶🐾 | 3 months ago (raw) | root | parent | reply | flag +3 
 There is PhotoDNA that is free of charge and does it well. I don’t think we should spend our limited resources on that. 
If I were to do it, I could have a age detection AI model and nude detection model in a multimodel setup, but PDNA is definitely better and an industry standard 🐶🐾🫡
DM me if you wish, but consider the above
▲ ▼
Rif'at Ahdi R | 3 months ago (raw) | root | parent | reply | flag +1 
 Well, you already said very similar strategy that i want to propose. No need to DM amymore 😄

Yes, PhotoDNA for known data while multimodel setup using nude detection + age detection model for unknown data. It is also my proposal idea.
▲ ▼
The Fishcake🐶🐾 | 3 months ago (raw) | root | parent | reply | flag +2 
 We could work on the multimodal thingy together then. @quentin and I have been experimenting with general detection of safe/unsafe media. I can share my repo (still closed source for now until I am sure the code is safe and clean) and take it from there. Interested? 🐶🐾🤔
▲ ▼
Rif'at Ahdi R | 3 months ago (raw) | root | parent | reply | flag 
 Yes, i'm interested. I think i can probably join helping 1 month later. I need to finish some of pending work in nfrelay.app for the moment.
▲ ▼
The Fishcake🐶🐾 | 3 months ago (raw) | root | parent | reply | flag +2 
 Excellent! The more the merrier! Ping me in the DM if/when your are available 🐶🐾🫡
▲ ▼
Rif'at Ahdi R | 3 months ago (raw) | root | parent | reply | flag 
 Yes, will do 🫡
▲ ▼
The Fishcake🐶🐾 | 3 months ago (raw) | root | parent | reply | flag +2 
 Ok, I implemented age prediction for unsafe content, we’ll see how it goes 🐶🐾🫡
▲ ▼
Rif'at Ahdi R | 3 months ago (raw) | root | parent | reply | flag 
 Oh nice, is it already running for nostr.build and nostrcheck.me? 👀 . 

Hopefully it can help both of your services.
▲ ▼
The Fishcake🐶🐾 | 3 months ago (raw) | root | parent | reply | flag +2 
 It runs on NB, @quentin will need to update api call and it’ll work 🐶🐾🫡
▲ ▼
Rif'at Ahdi R | 3 months ago (raw) | root | parent | reply | flag 
 Glad to hear. 🫂
▲ ▼
captjack | 3 months ago (raw) | root | parent | reply | flag 
 nostr content filtering experts @The Fishcake🐶🐾 @Rif'at Ahdi R @quentin
▲ ▼
captjack | 3 months ago (raw) | root | parent | reply | flag +1 
 this is very good tip for #photoDNA or any selfhosted AI model @quentin to integrate this foss software into nostrcheck package. (using external free/paid indexing or content searching means dependency on another 3rd party service i.e. BAD by design) - there is nohing gives 100% guarantee in cat n mouse game BUT MITIGATING 80% solves good part the problem. also look POW and/or NIP-42 also which limit attackers limit resource also.