RFC: Message Anti-Spam Module

[oca]

RFC: Message Anti-Spam Module

[hbrunn]

sounds technically interesting, but what's your reasoning not to let the mailserver do this? And maybe add a module that reacts to the headers spamassassin or whoever sets?

[yajo]

On one side, it's an amazing project, some ideas that came to my mind:

• A good job for TensorFlow? That's what Google uses AFAIK...
• Maybe you could benefit from magma project.

On the other side, @hbrunn's idea might be much easier to implement, with quite close results.

[lasley]

@hbrunn - My main intent behind this is not necessarily to combat messages coming through email, but instead messages coming through the web interface.

One of the current blockers for me getting rid of Wordpress is the ability to have a blog that isn't immediately spammed to hell. I currently use Akismet, but it's non-free so I don't want to bother making an Odoo plugin.

@yajo - TensorFlow looks much easier than sklearn, thanks for the pointer. But what is this magma project you speak of?

[lasley]

Oh sweet yeah as I've been learning the ML required for this, I've realized it can be used for a lot of other things. Mackma Project sounds interesting, I was unaware that it was being abstracted for base use. I'm not really able to find much information on it though, so maybe @OSevangelist can enlighten a bit more?

Hah I made that ReCaptcha plugin @yajo - it's my spam stopgap for CRM for the moment, but I don't want a captcha on my blog comments. Some spammers are just incredibly low wage humans too, which isn't stopped by the ReCaptcha unfortunately.

[yajo]

No experience on that at all, but it seems a good choice. Honestly I don't feel like being able to judge about a machine learning PR, but a PR that uses a library can be easily evaluated. I feel we are not the anti-spam design crew.

[rafaelbn]

😲 Thats could be great!

[tarteo]

@rafaelbn agree!

[yajo]

OK I had a couple of mistakes there. I didn't remember the name of the man who was in charge of the project (I found him now: @OSevangelist 😊), and the project is Mackma Project, not Magma 😆. He spoke about it in last OCA sprint. They are planning to implement big data management inside Odoo by adding a Hadoop backend to its ORM if I'm not wrong; I hope he can enlighten us to know if this issue would fit in their project (or vice-versa).

[yajo]

BTW, this might give you some ideas too @lasley: https://github.com/OCA/website/tree/10.0/website_crm_recaptcha

[lasley]

Alright so the machine learning on this ended up being an insane rabbit hole. I learned a lot, but I think anything I implement will still be sub-par.

That said, I recently found PyZor, which could serve our needs. It's basically just a crowd-sourced message signature checker, which works pretty damned well from my initial tests.

Has anyone used PyZor before? The authors seem to have some other interesting Spam things such as an OS drop-in replacement for SpamAssassin, so it seems they know what they're doing.

[liebana]

We are going to take a look to PyZor, does anyone have any news to share?

[lasley]

I've played with it now and think it's a good fit for this project. At this point, it's successfully identified all spam that has come through on an unsecured form honeytrap.

We're a bit overloaded at the moment though & this is somewhat of a side thing for me, so I haven't been able to allocate any dev time to create the actual module. IMO the hardest part is going to be the workflow - PyZor was a few lines.

[lasley]

Closing to track in #193