Koozali.org: home of the SME Server

Mail Issue

Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #30 on: December 26, 2018, 12:20:03 AM »
maillog

Dec 26 01:06:51 smemail fetchmail[2986]: Warning: the connection is insecure, continuing anyways. (Better use --sslcertck!)
Dec 26 01:06:55 smemail fetchmail[2986]: terminated with signal 6
Dec 26 01:08:24 smemail fetchmail[3029]: Warning: the connection is insecure, continuing anyways. (Better use --sslcertck!)
Dec 26 01:08:27 smemail fetchmail[3029]: terminated with signal 6
Dec 26 01:10:02 smemail fetchmail[3064]: Warning: the connection is insecure, continuing anyways. (Better use --sslcertck!)
Dec 26 01:10:06 smemail fetchmail[3064]: terminated with signal 6
Dec 26 01:13:37 smemail fetchmail[3324]: Warning: the connection is insecure, continuing anyways. (Better use --sslcertck!)
Dec 26 01:13:40 smemail fetchmail[3324]: terminated with signal 6
Dec 26 01:15:02 smemail fetchmail[3361]: Warning: the connection is insecure, continuing anyways. (Better use --sslcertck!)
Dec 26 01:15:05 smemail fetchmail[3361]: terminated with signal 6
Dec 26 01:17:06 smemail fetchmail[3411]: Warning: the connection is insecure, continuing anyways. (Better use --sslcertck!)
Dec 26 01:17:09 smemail fetchmail[3411]: terminated with signal 6
« Last Edit: December 26, 2018, 03:37:08 PM by Bud »

Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #31 on: December 26, 2018, 12:26:30 AM »
ReetP

could it be a firewall issue? - I TESTED AND THERE IS NO ISSUE WITH THE FIREWALL

how can i test if the sme server is not being blocked by the firewall from downloading email? - TESTED THE PORTS

any help greatly appreciated
« Last Edit: December 26, 2018, 01:07:10 AM by Bud »

Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #32 on: December 26, 2018, 12:31:41 AM »
ReetP

your question
Do you really have 2,700 + messages to collect??

i have over 3300 messages to collect from the catchall account

ok, i have established that the new mail server is working perfectly.

how? by connecting to another catchall account and download all the mail

the issue is the volume of mail that i need to download

how do i collect them manually from the catchall mailbox and where do i place the mail in the sme 9.2 mail server for distribution??  :o
« Last Edit: December 26, 2018, 01:05:01 AM by Bud »

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Mail Issue
« Reply #33 on: December 26, 2018, 01:20:27 AM »
Quote
why do i keep getting
*** buffer overflow detected ***: /usr/bin/fetchmail terminated

That's the $64 million question, and most likely the reason you can't download mail.

It's unlikely a firewall issue. I believe it is some thing core to your machine.

Your maillog no longer has the full entries because you haven't enabled 'verbosity' again as above.

Nonetheless I don't think that will change unless we solve the error.

I did ask you for some server details above. Newrpms/templates etc etc.

Can you please give us that information.

Sime server history may help too. When did this start?

You said you did a fresh install, but what else did you do?? Restore? Update? Add other packages??

You need to be a bit more expansive withb your answers to try and give us a clue.

Can you also just try:

Code: [Select]
/usr/bin/fetchmail -v
Does that cause an error anywhere?
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #34 on: December 26, 2018, 01:31:49 AM »
ReetP

thank you for your patience

I did ask you for some server details above. Newrpms/templates etc etc. - i will send this now

Sime server history may help too. When did this start? - a week ago

You said you did a fresh install, but what else did you do?? Restore? Update? Add other packages?? - i did a clean install. i did not do a restore

Code: [Select]
/usr/bin/fetchmail -v

fetchmail: WARNING: Running as root is discouraged.
fetchmail: no mailservers have been specified.


Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #35 on: December 26, 2018, 01:33:04 AM »
/sbin/e-smith/audittools/newrpms
Loaded plugins: fastestmirror, post-transaction-actions, smeserver
Loading mirror speeds from cached hostfile
 * base: centos.mirror.ac.za
 * smeaddons: ftp.nluug.nl
 * smeos: ftp.nluug.nl
 * smeupdates: ftp.nluug.nl
 * updates: centos.mirror.ac.za
Extra Packages
advancedprompt.noarch              0.1-2.el6.sme                   @smecontribs
automysqlbackup.noarch             3.0.RC6-5.el6.sme               @smecontribs
awstats.noarch                     7.1-1.el6.rf                    @smecontribs
gd-last.x86_64                     2.2.5-5.el6.remi                @remi-safe
hddtemp.x86_64                     0.3-0.20.beta15.el6             @smecontribs
libmcrypt.x86_64                   2.5.8-9.el6                     @smecontribs
libwebp.x86_64                     0.4.3-3.el6                     @smecontribs
libzip5.x86_64                     1.5.1-1.el6.remi                @remi-safe
lshw.x86_64                        2.17-1.el6.rf                   @smecontribs
nmap.x86_64                        2:6.25-1.el6.rfx                @smecontribs
perl-Digest-MD5-File.noarch        0.08-1.el6                      @epel
perl-File-Find-Rule.noarch         0.34-1.el6.sme                  @smecontribs
perl-Unicode-IMAPUtf7.noarch       2.00-1.el6.rf                   @smecontribs
php-fedora-autoloader.noarch       1.0.0-1.el6                     @smecontribs
php-php-gettext.noarch             1.0.12-1.el6                    @smecontribs
php-tcpdf.noarch                   6.2.13-1.el6                    @smecontribs
php-tcpdf-dejavu-sans-fonts.noarch 6.2.13-1.el6                    @smecontribs
php54.x86_64                       2.1-4.el6.remi                  @remi-safe
php54-php.x86_64                   5.4.45-16.el6.remi              @remi-safe
php54-php-bcmath.x86_64            5.4.45-16.el6.remi              @remi-safe
php54-php-cli.x86_64               5.4.45-16.el6.remi              @remi-safe
php54-php-common.x86_64            5.4.45-16.el6.remi              @remi-safe
php54-php-enchant.x86_64           5.4.45-16.el6.remi              @remi-safe
php54-php-gd.x86_64                5.4.45-16.el6.remi              @remi-safe
php54-php-imap.x86_64              5.4.45-16.el6.remi              @remi-safe
php54-php-ldap.x86_64              5.4.45-16.el6.remi              @remi-safe
php54-php-mbstring.x86_64          5.4.45-16.el6.remi              @remi-safe
php54-php-mcrypt.x86_64            5.4.45-16.el6.remi              @remi-safe
php54-php-mysqlnd.x86_64           5.4.45-16.el6.remi              @remi-safe
php54-php-pdo.x86_64               5.4.45-16.el6.remi              @remi-safe
php54-php-pear.noarch              1:1.10.7-3.el6.remi             @remi-safe
php54-php-pecl-zip.x86_64          1.15.4-1.el6.remi               @remi-safe
php54-php-process.x86_64           5.4.45-16.el6.remi              @remi-safe
php54-php-soap.x86_64              5.4.45-16.el6.remi              @remi-safe
php54-php-tidy.x86_64              5.4.45-16.el6.remi              @remi-safe
php54-php-xml.x86_64               5.4.45-16.el6.remi              @remi-safe
php54-runtime.x86_64               2.1-4.el6.remi                  @remi-safe
php55.x86_64                       2.1-5.el6.remi                  @remi-safe
php55-php.x86_64                   5.5.38-10.el6.remi              @remi-safe
php55-php-bcmath.x86_64            5.5.38-10.el6.remi              @remi-safe
php55-php-cli.x86_64               5.5.38-10.el6.remi              @remi-safe
php55-php-common.x86_64            5.5.38-10.el6.remi              @remi-safe
php55-php-enchant.x86_64           5.5.38-10.el6.remi              @remi-safe
php55-php-gd.x86_64                5.5.38-10.el6.remi              @remi-safe
php55-php-imap.x86_64              5.5.38-10.el6.remi              @remi-safe
php55-php-ldap.x86_64              5.5.38-10.el6.remi              @remi-safe
php55-php-mbstring.x86_64          5.5.38-10.el6.remi              @remi-safe
php55-php-mcrypt.x86_64            5.5.38-10.el6.remi              @remi-safe
php55-php-mysqlnd.x86_64           5.5.38-10.el6.remi              @remi-safe
php55-php-pdo.x86_64               5.5.38-10.el6.remi              @remi-safe
php55-php-pear.noarch              1:1.10.7-3.el6.remi             @remi-safe
php55-php-pecl-jsonc.x86_64        1.3.10-1.el6.remi               @remi-safe
php55-php-pecl-zip.x86_64          1.15.4-1.el6.remi               @remi-safe
php55-php-process.x86_64           5.5.38-10.el6.remi              @remi-safe
php55-php-soap.x86_64              5.5.38-10.el6.remi              @remi-safe
php55-php-tidy.x86_64              5.5.38-10.el6.remi              @remi-safe
php55-php-xml.x86_64               5.5.38-10.el6.remi              @remi-safe
php55-runtime.x86_64               2.1-5.el6.remi                  @remi-safe
php56.x86_64                       2.3-1.el6.remi                  @remi-safe
php56-php.x86_64                   5.6.39-1.el6.remi               @remi-safe
php56-php-bcmath.x86_64            5.6.39-1.el6.remi               @remi-safe
php56-php-cli.x86_64               5.6.39-1.el6.remi               @remi-safe
php56-php-common.x86_64            5.6.39-1.el6.remi               @remi-safe
php56-php-enchant.x86_64           5.6.39-1.el6.remi               @remi-safe
php56-php-gd.x86_64                5.6.39-1.el6.remi               @remi-safe
php56-php-imap.x86_64              5.6.39-1.el6.remi               @remi-safe
php56-php-ldap.x86_64              5.6.39-1.el6.remi               @remi-safe
php56-php-mbstring.x86_64          5.6.39-1.el6.remi               @remi-safe
php56-php-mcrypt.x86_64            5.6.39-1.el6.remi               @remi-safe
php56-php-mysqlnd.x86_64           5.6.39-1.el6.remi               @remi-safe
php56-php-pdo.x86_64               5.6.39-1.el6.remi               @remi-safe
php56-php-pear.noarch              1:1.10.7-3.el6.remi             @remi-safe
php56-php-pecl-jsonc.x86_64        1.3.10-1.el6.remi               @remi-safe
php56-php-pecl-zip.x86_64          1.15.4-1.el6.remi               @remi-safe
php56-php-process.x86_64           5.6.39-1.el6.remi               @remi-safe
php56-php-soap.x86_64              5.6.39-1.el6.remi               @remi-safe
php56-php-tidy.x86_64              5.6.39-1.el6.remi               @remi-safe
php56-php-xml.x86_64               5.6.39-1.el6.remi               @remi-safe
php56-runtime.x86_64               2.3-1.el6.remi                  @remi-safe
php70.x86_64                       1.0-5.el6.remi                  @remi-safe
php70-php.x86_64                   7.0.33-1.el6.remi               @remi-safe
php70-php-bcmath.x86_64            7.0.33-1.el6.remi               @remi-safe
php70-php-cli.x86_64               7.0.33-1.el6.remi               @remi-safe
php70-php-common.x86_64            7.0.33-1.el6.remi               @remi-safe
php70-php-enchant.x86_64           7.0.33-1.el6.remi               @remi-safe
php70-php-gd.x86_64                7.0.33-1.el6.remi               @remi-safe
php70-php-imap.x86_64              7.0.33-1.el6.remi               @remi-safe
php70-php-json.x86_64              7.0.33-1.el6.remi               @remi-safe
php70-php-ldap.x86_64              7.0.33-1.el6.remi               @remi-safe
php70-php-mbstring.x86_64          7.0.33-1.el6.remi               @remi-safe
php70-php-mcrypt.x86_64            7.0.33-1.el6.remi               @remi-safe
php70-php-mysqlnd.x86_64           7.0.33-1.el6.remi               @remi-safe
php70-php-pdo.x86_64               7.0.33-1.el6.remi               @remi-safe
php70-php-pear.noarch              1:1.10.7-3.el6.remi             @remi-safe
php70-php-pecl-mysql.x86_64        1.0.0-0.9.20151007git294ce3b.el6.remi
                                                                   @remi-safe
php70-php-pecl-zip.x86_64          1.15.4-1.el6.remi               @remi-safe
php70-php-process.x86_64           7.0.33-1.el6.remi               @remi-safe
php70-php-soap.x86_64              7.0.33-1.el6.remi               @remi-safe
php70-php-tidy.x86_64              7.0.33-1.el6.remi               @remi-safe
php70-php-xml.x86_64               7.0.33-1.el6.remi               @remi-safe
php70-runtime.x86_64               1.0-5.el6.remi                  @remi-safe
php71.x86_64                       1.0-1.el6.remi                  @remi-safe
php71-php.x86_64                   7.1.25-2.el6.remi               @remi-safe
php71-php-bcmath.x86_64            7.1.25-2.el6.remi               @remi-safe
php71-php-cli.x86_64               7.1.25-2.el6.remi               @remi-safe
php71-php-common.x86_64            7.1.25-2.el6.remi               @remi-safe
php71-php-enchant.x86_64           7.1.25-2.el6.remi               @remi-safe
php71-php-gd.x86_64                7.1.25-2.el6.remi               @remi-safe
php71-php-imap.x86_64              7.1.25-2.el6.remi               @remi-safe
php71-php-json.x86_64              7.1.25-2.el6.remi               @remi-safe
php71-php-ldap.x86_64              7.1.25-2.el6.remi               @remi-safe
php71-php-mbstring.x86_64          7.1.25-2.el6.remi               @remi-safe
php71-php-mcrypt.x86_64            7.1.25-2.el6.remi               @remi-safe
php71-php-mysqlnd.x86_64           7.1.25-2.el6.remi               @remi-safe
php71-php-pdo.x86_64               7.1.25-2.el6.remi               @remi-safe
php71-php-pear.noarch              1:1.10.7-3.el6.remi             @remi-safe
php71-php-pecl-mysql.x86_64        1.0.0-0.15.20160812git230a828.el6.remi
                                                                   @remi-safe
php71-php-pecl-zip.x86_64          1.15.4-1.el6.remi               @remi-safe
php71-php-process.x86_64           7.1.25-2.el6.remi               @remi-safe
php71-php-soap.x86_64              7.1.25-2.el6.remi               @remi-safe
php71-php-tidy.x86_64              7.1.25-2.el6.remi               @remi-safe
php71-php-xml.x86_64               7.1.25-2.el6.remi               @remi-safe
php71-runtime.x86_64               1.0-1.el6.remi                  @remi-safe
phpMyAdmin.noarch                  4.0.10.20-1.el6                 @smecontribs
qmail-autoresponder.x86_64         0.97-1                          @fws
randpw.noarch                      9:0.0.4-2.el6.sme               @smecontribs
shellinabox.x86_64                 2.20-5.el6                      @epel
smeserver-automysqlbackup.noarch   2:3.0.RC6-8.el6.sme             @smecontribs
smeserver-awstats.noarch           1.3-3.el6.sme                   @smecontribs
smeserver-crontab_manager.noarch   2.4-3.el6.sme                   @smecontribs
smeserver-dhcpmanager.noarch       2.0.4-8.el6.sme                 @smecontribs
smeserver-diskusage.noarch         0.2.0-2.el6.sme                 @smecontribs
smeserver-displayconf.noarch       0.3-1                           @reetp
smeserver-email-management.noarch  1.3-2.el6.sme                   @smecontribs
smeserver-expire-accounts.noarch   0.1.6-1.el6.fws                 @fws
smeserver-fetchmail.noarch         1.6-10.el6.sme                  @smecontribs
smeserver-hwinfo.noarch            1.2-2.el6.sme                   @smecontribs
smeserver-lazy_admin_tools.noarch  1.1-4.el6.sme                   @smecontribs
smeserver-mailsorting.noarch       1.4-10.el6.sme                  @smecontribs
smeserver-mailstats.noarch         1.1-9.el6.sme                   @smecontribs
smeserver-mod_dav.noarch           1.1-2.el6.sme                   @smecontribs
smeserver-password.noarch          1.2.0-10.el6.sme                @smecontribs
smeserver-php-scl.noarch           0.4-16.el6.sme                  @smecontribs
smeserver-phpmyadmin.noarch        4.0.10.2-3.el6.sme              @smecontribs
smeserver-phpsysinfo.noarch        3.2.3-1.el6.sme                 @stephdl
smeserver-qmHandle.noarch          1.4-11.el6.sme                  @smecontribs
smeserver-raidstatus.noarch        0.3-1.el6.sme                   @stephdl
smeserver-remoteuseraccess.noarch  1.3-2.el6.sme                   @smecontribs
smeserver-service_control.noarch   2.2-11.el6.sme                  @smecontribs
smeserver-shared-folders.noarch    0.3-10.el6.sme                  @smecontribs
smeserver-shellinabox.noarch       0.0.7-2.el6.sme                 @stephdl
smeserver-sitemaker.noarch         2.0.1-3.el5.sme                 @sme8contribs
smeserver-smbstatus.noarch         1.2-1                           @smecontribs
smeserver-usbdisksmanager.noarch   1.2-5.el6.sme                   @smecontribs
smeserver-userpanel.noarch         1.2-3.el6.sme                   @smecontribs
smeserver-vacation.noarch          1.1-25.el6.sme                  @smecontribs

Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #36 on: December 26, 2018, 01:33:49 AM »
/sbin/e-smith/audittools/templates
/etc/e-smith/templates-custom/etc/httpd/conf/httpd.conf/20LoadModule80PHP: OWNED_BY_RPM, OVERRIDE
/etc/e-smith/templates-custom/etc/dhcpd.conf/25Routers: OWNED_BY_RPM, OVERRIDE
/etc/e-smith/templates-custom/etc/dhcpd.conf/25DomainNameServers: OWNED_BY_RPM, OVERRIDE
/etc/e-smith/templates-custom/etc/dhcpd.conf/25LeaseTimeDefault: OWNED_BY_RPM, OVERRIDE
/etc/e-smith/templates-custom/etc/dhcpd.conf/25LeaseTimeMax: OWNED_BY_RPM, OVERRIDE
/etc/e-smith/templates/var/service/qpsmtpd/config/peers/0/01smeoptimizer: MANUALLY_ADDED
/etc/e-smith/templates/etc/crontab/smeoptimizer.cron.template: MANUALLY_ADDED

Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #37 on: December 26, 2018, 01:34:22 AM »
/sbin/e-smith/audittools/repositories
base: enabled
centosplus: disabled
contrib: disabled
epel: disabled
extras: disabled
fasttrack: disabled
fws: disabled
fws-testing: disabled
reetp: disabled
remi-safe: enabled
sme8contribs: disabled
smeaddons: enabled
smecontribs: disabled
smedev: disabled
smeextras: enabled
smeos: enabled
smetest: disabled
smeupdates: enabled
smeupdates-testing: disabled
stephdl: disabled
updates: enabled

Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #38 on: December 26, 2018, 01:57:45 AM »
ReetP

i can download mail from another catchall without any problems

however that catchall has only a few mail messages

i keep getting the following error for the old catchall mailbox

why do i keep getting the " *** buffer overflow detected ***: /usr/bin/fetchmail terminated " error?

can i increase the buffer size?

is there a way that i can download all the mail manually from the catchall mailbox, empty the catchall mailbox and then just place the mail in the " /home/e-smith/Maildir/new " folder for distribution to all the other mailbox user accounts?

« Last Edit: December 26, 2018, 02:09:41 AM by Bud »

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Mail Issue
« Reply #39 on: December 26, 2018, 02:18:52 AM »
Ok, so first it isn't exactly a clean install because you added a load of extra packages. Why you need to be really specific about exactly what you have done when you are debugging.

As it is I don't think any of it makes a difference.

I'm pretty sure the buffer over error is the culprit, especially as you tested another account without issues.

Question. Of those 3,000 or so mails, how much is junk and can you clean it up before trying to download?

Next? I know that fetchmail has been vulnerable to buffer overrun attacks via specially crafted mail. You can search the interwebs for "fetchmail buffer overruns" to see. A mail with the right headers can trigger an issue such as yours.

I'm thinking that this may be the case here and we may need to look at a bug for this.

It's 2 am here and I need some kip.

I'll try and take more of a look in the morning. Please don't try and mess with fetchmail settings (eg messing with buffers etc) as you may do more harm than good.

Thanks.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #40 on: December 26, 2018, 02:20:07 AM »
ReetP

thanks again

will chat soon

Offline Jean-Philippe Pialasse

  • *
  • 2,746
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Mail Issue
« Reply #41 on: December 26, 2018, 02:58:24 AM »
Well, 3300 emails are too many emails.

fetchmail by default has no limit.


you should set limits to have it to only download a bit at a time. You can eat an elephant but only a bite at a time.

according to  : http://www.fetchmail.info/fetchmail-man.html#10
Code: [Select]
-b <count> | --batchlimit <count>
  (Keyword: batchlimit)
Specify the maximum number of messages that will be shipped to an SMTP listener before the connection is deliberately torn down and rebuilt (defaults to 0, meaning no limit). An explicit --batchlimit of 0 overrides any limits set in your run control file. While sendmail(8) normally initiates delivery of a message immediately after receiving the message terminator, some SMTP listeners are not so prompt. MTAs like smail(8) may wait till the delivery socket is shut down to deliver. This may produce annoying delays when fetchmail is processing very large batches. Setting the batch limit to some nonzero size will prevent these delays. This option does not work with ETRN or ODMR.

-B <number> | --fetchlimit <number>
  (Keyword: fetchlimit)
Limit the number of messages accepted from a given server in a single poll. By default there is no limit. An explicit --fetchlimit of 0 overrides any limits set in your run control file. This option does not work with ETRN or ODMR.

would be a first way to explore.


Offline Bud

  • *
  • 487
  • +0/-0
Re: Mail Issue
« Reply #42 on: December 26, 2018, 08:30:52 AM »
Jean-Philippe Pialasse thank you for your help

well all i can say - IT'S WORKING!!!

all the mail messages have been downloaded from the catchall mailbox

so what did i do?

all i did was to delete all the spam messages, useless marketing mail messages etc from the catchall mailbox until i got a total of about 2200 mail messages remaining in the catchall mailbox

bam, mail starts to download from the NEW SME 9.2 Server and is distributed to all the user mailboxes ( note: i have created all the new users etc. on the NEW SME 9.2 Server )

all mail has been downloaded from the catchall mailbox and the catchall mailbox has been emptied

thank you Jean-Philippe Pialasse and ReetP for your valuable input, much appreciated.  :)
« Last Edit: December 26, 2018, 09:00:00 AM by Bud »