Koozali.org: home of the SME Server

Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?

Offline david000

  • ****
  • 192
  • +0/-0
Hi All,

We had some odd issues this morning.

It started when outgoing mail 'hung' in the browser (Round cube) at which point I restarted the SME server. Following on mail refused to send, returning a 'unable to scan for viruses' message. Turning off the virus scan in the email settings allowed mail to send.

At the same time, we started to get Fetchmail cron emails containing:

Code: [Select]
fetchmail: another foreground fetchmail is running at 3664.
fetchmail: another foreground fetchmail is running at 3664.
fetchmail: another foreground fetchmail is running at 3664.

and I noticed the server wasn't collecting external email.

I cleaned the dozen or so remaining emails on the ISPs mailbox (SMS collected from our ISP's mail account) most of which was spammy or malware. This fixed the mail collection issue.

However, I still can't send mail with the 'Virus scanning' enabled in the manager. I'm not sure if the two events this morning were related but it's a little odd.

Any suggestions as to how to enable 'Virus scanning' again?

Thanks in advance,

David

EDIT - the fetchmail emails still coming through :(

EDIT 2 - the issue seems to be the 'Email Filtering Settings'.  Enabling Spam filtering causes the fetchmail problem and non collection of mail.


« Last Edit: December 04, 2019, 12:57:45 PM by david000 »

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #1 on: December 04, 2019, 05:18:39 PM »
So, tell us a bit more about your server.

Version, history, any updates?

Something must have changed so it is trying to find out what.

Can you also go to Server Manager, lower left, and do a 'Report a Bug' and then 'Create configuration report' so we can see how much you have been hacking your server ;-)
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #2 on: December 04, 2019, 05:32:01 PM »
So, tell us a bit more about your server.

Version, history, any updates?

Something must have changed so it is trying to find out what.

Can you also go to Server Manager, lower left, and do a 'Report a Bug' and then 'Create configuration report' so we can see how much you have been hacking your server ;-)

LOL - we're on 9.2 and it should be up to date. I apply updates as they come though, the last being a week or so ago. I've not touched it since then. In terms of other mods, the last thing I did was implement the Affa backup to a second SME server, but that was maybe 12months ago.   I've ran SME for a number of years now and it's been exemplary.   
Code: [Select]
Configuration report created Wed 04 Dec 2019 04:25:51 PM GMT

==================
Base configuration
==================

SME server version: 9.2
SME server mode:    serveronly
Running Kernel:     2.6.32-754.24.3.el6.x86_64



===========================
New RPMs not in base system
===========================
       
Loaded plugins: fastestmirror, post-transaction-actions, smeserver
Loading mirror speeds from cached hostfile
 * base: mozart.ee.ic.ac.uk
 * smeaddons: ftp.nluug.nl
 * smeos: ftp.nluug.nl
 * smeupdates: ftp.nluug.nl
 * updates: mozart.ee.ic.ac.uk
Extra Packages
imapsync.noarch                          1.684-1.el6                @epel       
libmcrypt.x86_64                         2.5.8-9.el6                @smecontribs
perl-Data-Uniqid.noarch                  0.12-2.el6                 @epel       
perl-IO-Socket-INET6.noarch              2.72-1.of.el6              @smecontribs
perl-IO-Tee.noarch                       0.64-1.el6                 @epel       
perl-Mail-IMAPClient.noarch              3.37-1.el6                 @epel       
perl-NTLM.noarch                         1.09-1.el6                 @epel       
perl-Parse-RecDescent.noarch             1.965-1.el6                @epel       
php-kolab-net-ldap3.noarch               1.0.7-2.el6                @smecontribs
php-pear-Mail-mimeDecode.noarch          1.5.5-1.el6                @smecontribs
php-pear-Net-IDNA2.noarch                0.1.1-3.el6                @smecontribs
php-pear-Net-LDAP2.noarch                2.1.0-1.el6                @smecontribs
php-pear-Net-Sieve.noarch                1.3.4-1.el6                @smecontribs
roundcubemail.noarch                     1.1.3-101.el6.sme          @smecontribs
roundcubemail_plugins.noarch             1.2-2.el6.sme              @smecontribs
smeserver-diskusage.noarch               0.2.0-2.el6.sme            @smecontribs
smeserver-dovecot-extras.noarch          0.1.1-2.el6.sme            @smecontribs
smeserver-fetchmail.noarch               1.6-14.el6.sme             @smecontribs
smeserver-roundcube.noarch               1.2-9.el6.sme              @smecontribs
sqlite.x86_64                            3.7.17-9.el6.sme           @smecontribs
 



===========================
Custom and modified templates
===========================




===========================
Modified events
===========================




=======================
Additional repositories
=======================

base: enabled
centosplus: disabled
contrib: disabled
epel: disabled
extras: disabled
fasttrack: disabled
smeaddons: enabled
smecontribs: disabled
smedev: disabled
smeextras: enabled
smeos: enabled
smetest: disabled
smeupdates: enabled
smeupdates-testing: disabled
stephdl: disabled
updates: enabled
   

DONE!

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #3 on: December 04, 2019, 05:48:42 PM »
LOL - we're on 9.2 and it should be up to date.

Hehehe.... and looks like you have been pretty exemplary too - can't remember the last one I saw with no custom templates!!

Quote
I apply updates as they come though, the last being a week or so ago.

Hmm - no reboot required after?

Quote
I've ran SME for a number of years now and it's been exemplary.   

Nice to hear !

Just wonder if something is amiss here:

https://bugs.koozali.org/show_bug.cgi?id=10290

I think you can enable increased logging as per here:

https://wiki.contribs.org/Fetchmail#Additional_information

You ought to enable it and see what gets thrown up.

Can you also do:

Code: [Select]
rpm -qa |grep qpsmtpd
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #4 on: December 04, 2019, 06:27:48 PM »
Hmm - no reboot required after?

I reconfigure using the server manager after updates. It's possible I forgot but did a reconfigure reboot again this morning 'just in case'.

Quote
Just wonder if something is amiss here:

https://bugs.koozali.org/show_bug.cgi?id=10290

Reading the description, I don't think so. In my case it seems that the mail isn't being collected, or is taking a very long time to collect (hence the multiple fetchmail instances) - this IF the spam filtering is enabled. (there were only 4 or 5 small emails in the account to collect)

As the virus check in the same module also causes issues with outgoing mail I wonder if it's an issue in whichever code looks after the email filtering in the server manager interface.

Quote
I think you can enable increased logging as per here:

https://wiki.contribs.org/Fetchmail#Additional_information

You ought to enable it and see what gets thrown up.

Can you also do:

Code: [Select]
rpm -qa |grep qpsmtpd

OK - I'll do both.

Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #5 on: December 04, 2019, 06:31:47 PM »
Sorry -

Code: [Select]
rpm -qa |grep qpsmtpd
What does this do ?

Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #6 on: December 04, 2019, 06:42:52 PM »
Following on, I'm a little confused now /blush/.

So while I do have fetchmail installed to retrieve mail from a couple of external pop mail boxes, the 'non collection' issue relates to the default main email box specified in the "E-mail settings" in the server manager. This opposed to the "Mail Retrieval" section under 'collaboration'.

I'm not sure if that changes things or if fetchmail does both functions ?

 

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #7 on: December 04, 2019, 10:00:09 PM »
Sorry -
Code: [Select]
rpm -qa |grep qpsmtpdWhat does this do ?

Tells us which version of qpsmtpd you have installed. Just checking.....
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #8 on: December 04, 2019, 10:02:02 PM »
Following on, I'm a little confused now /blush/.
LOL !!

Quote
So while I do have fetchmail installed to retrieve mail from a couple of external pop mail boxes, the 'non collection' issue relates to the default main email box specified in the "E-mail settings" in the server manager. This opposed to the "Mail Retrieval" section under 'collaboration'.
I'm not sure if that changes things or if fetchmail does both functions ?

They both go to generate /etc/fetchmail

So, can you do this:

Code: [Select]
cat /etc/fetchmail
Remove the obvious sensitive stuff like passwords and paste the remainder here.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline mmccarn

  • *
  • 2,626
  • +10/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #9 on: December 05, 2019, 02:10:07 PM »
You may want to check the mailbox that fetchmail is scanning -- I seem to remember problems with fetchmail if the offsite catch-all mailbox ends up containing so many emails that one fetchmail session cannot complete in the time allowed between fetchmail runs.

Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #10 on: December 05, 2019, 03:37:24 PM »
You may want to check the mailbox that fetchmail is scanning -- I seem to remember problems with fetchmail if the offsite catch-all mailbox ends up containing so many emails that one fetchmail session cannot complete in the time allowed between fetchmail runs.

In this case I don't think that's the issue as the mailbox it was struggling to collect from was almost empty. It could be that the second mail box was at issue but that gets emptied periodically as SME-Server collects all mail again at each server restart, which is a pain.


Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #11 on: December 05, 2019, 03:48:47 PM »
So, can you do this:

Code: [Select]
cat /etc/fetchmail

OK:

Code: [Select]
# rpm -qa |grep qpsmtpd
qpsmtpd-0.96-11.el6.sme.noarch
smeserver-qpsmtpd-2.4.0-39.el6.sme.noarch
qpsmtpd-plugins-0.0.1-5.el6.sme.noarch

and:
Code: [Select]
cat /etc/fetchmail
#!/bin/sh
#------------------------------------------------------------
#              !!DO NOT MODIFY THIS FILE!!
#
# Manual changes will be lost when this file is regenerated.
#
# Please read the developer's guide, which is available
# at http://www.contribs.org/development/
#
# Copyright (C) 1999-2006 Mitel Networks Corporation
#------------------------------------------------------------



# multi-drop configuration; fetchmail retrieves all mail from a remote POP mailbox:

/usr/bin/fetchmail --syslog --silent --auth password --fetchmailrc - <<EOF

set postmaster "postmaster@mediacopy.local"
set bouncemail
set properties ""

poll host50.servers.prgn.misp.co.uk
envelope "Deliver-To:"
    protocol POP3
    no dns
    localdomains 3d-alchemy.co.uk mediacopy.co.uk mediacopy.local text-connect.co.uk
       username "info@mcpy.co.uk" password "PW" to * here
           smtphost 127.0.0.200/25
           fetchall
           forcecr

EOF
#
#   Mail N1 Account for : stuff - Affa backup server. Collecting system emails.
/usr/bin/fetchmail -l15000000 -d0 --silent --syslog --fetchmailrc - <<EOF
set postmaster "postmaster@mediacopy.local"
set bouncemail
set no softbounce
set properties ""
poll 172.16.16.74 with proto POP3 timeout 60 and options uidl no dns
  user 'admin' smtpaddress mediacopy.local with password 'PW' is stuff here keep
  smtphost 127.0.0.200/25
  antispam 550
EOF
#
#   Mail N2 Account for : stuff
/usr/bin/fetchmail -l15000000 -d0 --silent --syslog --fetchmailrc - <<EOF
set postmaster "postmaster@mediacopy.local"
set bouncemail
set no softbounce
set properties ""
poll mail.davidtapley.co.uk with proto POP3 timeout 60 and options uidl no dns
  user 'djt\@davidtapley.co.uk' smtpaddress mediacopy.local with password 'PW' is stuff here keep
  smtphost 127.0.0.200/25
  antispam 550
EOF

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #12 on: December 06, 2019, 12:10:00 AM »
Edit your fetchmail file and change each
Code: [Select]
--silent to
Code: [Select]
--verbose (might be a config entry but anyways....)

Let it run and watch your logs.... can't remember which one right now.

You can restore the file with

Code: [Select]
expand-template /etc/fetchmail
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #13 on: December 08, 2019, 08:30:43 PM »
Edit your fetchmail file and change each
Code: [Select]
--silent to
Code: [Select]
--verbose (might be a config entry but anyways....)

Let it run and watch your logs.... can't remember which one right now.

You can restore the file with

Code: [Select]
expand-template /etc/fetchmail

OK-  I'll set some time aside when the office is empty and switch back on email filtering. At the moment with filtering switched off email is collecting which takes the pressure off a little.


Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #14 on: December 20, 2019, 04:33:41 PM »
A quick update -

I noticed a contribs fetchmail update came through last week and duly installed it. I've just had chance to turn back on AntiSpam and antivirus in the email settings and all seems to be working ok - so far :)

Thanks for your help.


Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #15 on: December 20, 2019, 05:36:52 PM »
Hmm.

The latest update was only a language translation patch that didn't affect any code.

The previous patch a year ago was the same.

So the last time any active code was changed was in March 2018.

Code: [Select]
%changelog
* Sat Dec 07 2019 SME Translation Server <translations@contribs.org> 1.6-15.sme
- apply locale 2019-12-07 patch

* Fri Dec 14 2018 John Crisp <jcrsip@safeandsoundit.co.uk> 1.6.14.sme
- apply locale 2018-12-14 patch

* Sun Mar 11 2018 Jean-Philipe Pialasse <tests@pialasse.com> 1.6-13.sme
- fix no spamcheck anymore for fetchmail [SME: 10290]

* Sat Dec 02 2017 SME Translation Server <translations@contribs.org> 1.6-12.sme
- apply locale 2017-12-02 patch


Hey ho - if you are working then fine!!
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline david000

  • ****
  • 192
  • +0/-0
Re: Odd issues this morning. Fetchmail \ Virus scanning issue - unrelated ?
« Reply #16 on: December 20, 2019, 05:43:32 PM »
I tested after installing the most recent update(s), so perhaps something changed there.

I'll keep an eye on it :)