Koozali.org: home of the SME Server

BayesFiltering for SpamAssasin

d_gerst

BayesFiltering for SpamAssasin
« on: August 18, 2006, 10:16:35 PM »
Hello,

Are there some interests on a installationscript for activation bayesfiltering with spamassasin?

Swert Knudsen doesn't activate this feature in his contribs.

What's that?
So you could train your spamassasine to missed spam and junkmails. Every user could do this on the SME6/7 server, all you have todo is to move the missed spammail into a special folder. SpamAssasin will be trained automatically with this mails, to identify this kind of used pattern next time when receiving mails from the internet.

If so, just let me know and I'll put it online.

Best regards,
Daniel

Offline mercyh

  • *
  • 824
  • +0/-0
    • http://mercyh.org
BayesFiltering for SpamAssasin
« Reply #1 on: August 18, 2006, 10:52:46 PM »
d_gerst,

There has been a lengthy off topic thread going on this. I would say that there is definitely interest.

Check out the thread here.

http://forums.contribs.org/index.php?topic=32158.0

Royce H.

d_gerst

BayesFiltering for SpamAssasin
« Reply #2 on: August 19, 2006, 12:11:13 PM »
Hello,

Ok, I'll write tomorrow an installationscript, cause I have to test it on SME7 (actually I only test it on SME6, but it should be the same),  but without GUI.

Supported Features will be:
- Automatically create new Folder "JunkMailMissed" for each User, which is also be used to train Neuronal Networks (BayesFilter)
- Automatically train Spamassasine with SA-Learn (JunkMail and JunkMailMissed are used to train Spamassasin)
- CronJob for autolearning.

Best regards,
Daniel

d_gerst

BayesFiltering for SpamAssasin
« Reply #3 on: August 20, 2006, 05:53:41 PM »
Hello,

as i promised here it is, a installation script for spamassassines BayesFilter on SME7.

Features:
- Every SME-User will get new folders junkmailmissed and hamlearning
- Folders junkmail, junkmailmissed and hamlearning will be used to train Spamassassin BayesFilter
- all modification to run BayesFilter will be done by installations script
- Learning will be driven by a cronjob, which executes a learning script
- report of learning will be sent to admin account

Installation:
wget http://www.gerst.no-ip.com/SME7/spamassassin/install_sa-learn.sh
sh install_sa-learn.sh

Please test it an report bugs or success.

Best regards,
Daniel

Offline cool34000

  • *
  • 339
  • +0/-0
BayesFiltering for SpamAssasin
« Reply #4 on: August 21, 2006, 01:56:25 AM »
Thx for the rpm...

I've installed it with no errors and all seemed to run fine.

Nevertheless, i can't find the folders witch were supposed to be created...
Where are they ?

Do I have to use IMAP instead on POP to see them ?
Tried anyway on the webmail but it's the same : no folders but junkmail...

Thx

d_gerst

BayesFiltering for SpamAssasin
« Reply #5 on: August 21, 2006, 06:47:34 AM »
Hello cool34000,

Yes you have to use IMAP instead of POP3

Best regrads,
Daniel

d_gerst

BayesFiltering for SpamAssasin
« Reply #6 on: August 21, 2006, 07:38:13 AM »
Hello,

Please reinstall the script cause I found a little bug in the bayes script. I would apologize me for this.

Best regards,
Daniel

Offline Mace

  • **
  • 65
  • +0/-0
BayesFiltering for SpamAssasin
« Reply #7 on: August 21, 2006, 11:35:21 AM »
Thank you! This is a great contrib.

Regards,
Sterling

Offline cool34000

  • *
  • 339
  • +0/-0
BayesFiltering for SpamAssasin
« Reply #8 on: August 21, 2006, 01:50:24 PM »
Thx for your reply, i'll try with IMAP after work and let you know if it worked...
No one is complaining, so I guess it should work for me too !

Offline mercyh

  • *
  • 824
  • +0/-0
    • http://mercyh.org
BayesFiltering for SpamAssasin
« Reply #9 on: August 21, 2006, 05:45:16 PM »
Cool34000,

Quote
Do I have to use IMAP instead on POP to see them ?


You will need to use IMAP or webmail to move any missed spam to the junkmailmissed folder. (This cannot be done with POP as far as I know.) So you will need to setup your users with IMAP accounts to make it work. On the users I have that normally use POP and are not the type that are easily trained to change  :roll: , I have setup another e-mail account with IMAP and only set the junkmailmissed folder to show. The user then has a new tree in their e-mail client that only contains that folder. They can then drop any mail that they want learned as spam into that folder.

d_gerst

BayesFiltering for SpamAssasin
« Reply #10 on: August 21, 2006, 08:48:16 PM »
Hello,

I still miss the logging of spamd in /var/log/maillog, on a SME6 system logging works fine and you see what be done by spamd, but on a SME7 system I don't see the logging output.

On SME6 you have to chwown of bayes_db files to work correctly (i saw this on the logging output of maillog). So howto enable the logging for spamd to see if it is correctly working on SME7?

Best regards,
Daniel

Offline cool34000

  • *
  • 339
  • +0/-0
BayesFiltering for SpamAssasin
« Reply #11 on: August 21, 2006, 10:47:00 PM »
Tried IMAP a looooooong time ago... The whole thing i remembered about it is that IT'S STRANGE !!! When i first saw it, i though that it was a future design... made in 1960 ! Remember old versions of lotus... See what i mean ?  :-D

Then tonight, i retryed it to meet the conf... And WOW !!!
Now i know it's more powerfull than POP !!! But still, it's a really strange way to show mails !

I could get used to it, but not my customers !!!
After 3 years of explaining them webmail and outlook, someone asked me to trash his (windows) recyle bin because someone (trying to mail him...) told him that his mailbox was full... Since a week...:hammer:


IMAP is too powerfull, better chance in getting them back to handwriting, problems were just about ink and papers :roll:

Offline cool34000

  • *
  • 339
  • +0/-0
BayesFiltering for SpamAssasin
« Reply #12 on: August 21, 2006, 11:20:57 PM »
I forgot the essential :

Folders that you've told are still not created for me...

How wierd is that :
My SME is a french version, so horde is translated in french (think this could have a matter)

In the webmail, i see 3 folders :
- Boite de réception (that's the translation of inbox in french)
- Courrier indésirable (that's the translation of junkmail in french)
- junkmail (not junkmailmissed)

In Outlook, i see that :
Boite de réception (that's the translation of inbox in french)
Courrier indésirable (that's the translation of junkmail in french)

Why am i seeing only 2 folders in outlook and 3 in the webmail ?

I didn't have the junkmail folder (the one written in english) before i installed your script (tried also with the new one), so maybe your install assumes that junkmail's folder have to be named junkmail somewhere in your code ? Am i right ?

d_gerst

BayesFiltering for SpamAssasin
« Reply #13 on: August 22, 2006, 06:24:38 AM »
Hello,

Just use winscp or putty and have a look into user folders /home/e-smith/files/users/username/Maildir there must be the folders.

For your outlook you must set something like display folder, to show it.

Best regards,
Daniel

Offline azche24

  • *
  • 163
  • +0/-0
    • http://az-law.de
BayesFiltering for SpamAssasin
« Reply #14 on: August 22, 2006, 03:10:34 PM »
Hi,
Quote from: "d_gerst"
/home/e-smith/files/users/username/Maildir there must be the folders.


Great contrib! The folders are created at first run of sh_bayesfilter.sh ; so you have to wait for the next day or have to run script manually first.
Alexander Ziemann, Berlin - DE