Koozali.org: home of the SME Server

[Announce] smeserver-backup2 alpha release

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[Announce] smeserver-backup2 alpha release
« on: January 13, 2006, 04:28:47 AM »
HIGHLY experimental! For testing purposes only. :hammer:

http://mirror.contribs.org/smeserver/contribs/dmay/smeserver/7.x/smeserver-backup2-0.0.1-a2dmay.noarch.rpm

This is an initial merging of backup2ws/usb into one single contrib. I have also been extensively rewriting the code to ConfigDB format. This is completed for action scripts and initially started for the panel. At some point the panel needs to be rewritten into FormMagick.

Note this contrib obsoletes and removes backup2ws/usb rpms and files. It will leave the associated dbs which should be manually deleted at your discretion.

I have built and began initial testing on 7.x only. I believe this will not work on <7.x but have not tested. Released early for others to try. Feedback appreciated.

Darrell

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[Announce] smeserver-backup2 alpha release
« Reply #1 on: January 18, 2006, 10:42:06 PM »
alpha3 available:

http://mirror.contribs.org/smeserver/contribs/dmay/smeserver/7.x/smeserver-backup2-0.0.1-a3dmay.noarch.rpm

* Wed Jan 18 2006 Darrell May <dmay@myezserver.com>
- panel text updates outlining 911 restore procedure
- removed Advanced Disaster Recovery panel sub sections in favor of using default Reboot panel
- set requires for rar => 3.5.1-7 smeserver-release => 7.0
- added /var/cache/yum to DisasterRecoverySource
- [0.0.1-a3dmay]

Testing and feedback appreciated.

Darrell

rf131

alpha 4 Test
« Reply #2 on: January 21, 2006, 04:49:19 AM »
Hi Darrell,

Testing alpha 4 with backup2usb, regular backup & 911.  Have not run a test restore yet, but wanted to pass the following on to you.

1 - Running 911 Job - "Cannot open /etc/smbpasswd"
Here is the log:
Jan 20 21:31:29 server2006 esmith::event[4482]: Processing event: pre-backup2-custom 911
Jan 20 21:31:29 server2006 esmith::event[4483]: Processing event: pre-backup2  
Jan 20 21:31:29 server2006 esmith::event[4483]: Running event handler: /etc/e-smith/events/pre-backup2/S10mysql-delete-dumped-tables
Jan 20 21:31:29 server2006 esmith::event[4483]: S10mysql-delete-dumped-tables=action|Event|pre-backup2|Action|S10mysql-delete-dumped-tables|Start|1137814289 940680|End|1137814289 945176|Elapsed|0.004496
Jan 20 21:31:29 server2006 esmith::event[4483]: Running event handler: /etc/e-smith/events/pre-backup2/S20mysql-dump-tables
Jan 20 21:31:30 server2006 esmith::event[4483]: S20mysql-dump-tables=action|Event|pre-backup2|Action|S20mysql-dump-tables|Start|1137814289 945980|End|1137814290 23530|Elapsed|0.07755
Jan 20 21:31:30 server2006 esmith::event[4483]: Running event handler: /etc/e-smith/events/pre-backup2/S30gentle-ldap-dump
Jan 20 21:31:30 server2006 slapcat: bdb_initialize: Sleepycat Software: Berkeley DB 4.2.52: (December  3, 2003)
Jan 20 21:31:30 server2006 slapcat: bdb_initialize: Sleepycat Software: Berkeley DB 4.2.52: (December  3, 2003)
Jan 20 21:31:30 server2006 slapcat: /etc/openldap/slapd.conf: line 17: schema checking disabled! your mileage may vary!
Jan 20 21:31:30 server2006 esmith::event[4483]: S30gentle-ldap-dump=action|Event|pre-backup2|Action|S30gentle-ldap-dump|Start|1137814290 24318|End|1137814290 344181|Elapsed|0.319863
Jan 20 21:31:31 server2006 kernel: kjournald starting.  Commit interval 5 seconds
Jan 20 21:31:31 server2006 kernel: EXT3 FS on sda1, internal journal
Jan 20 21:31:31 server2006 kernel: EXT3-fs: mounted filesystem with ordered data mode.
Jan 20 21:31:31 server2006 e-smith-bg:
Jan 20 21:35:40 server2006 esmith::event[4547]: Processing event: post-backup  
Jan 20 21:35:40 server2006 esmith::event[4547]: Running event handler: /etc/e-smith/events/post-backup/S10mysql-delete-dumped-tables
Jan 20 21:35:40 server2006 esmith::event[4547]: S10mysql-delete-dumped-tables=action|Event|post-backup|Action|S10mysql-delete-dumped-tables|Start|1137814540 423783|End|1137814540 428634|Elapsed|0.004851
Jan 20 21:35:40 server2006 esmith::event[4547]: Running event handler: /etc/e-smith/events/post-backup/S50rewind-tape
Jan 20 21:35:40 server2006 esmith::event[4547]: S50rewind-tape=action|Event|post-backup|Action|S50rewind-tape|Start|1137814540 429408|End|1137814540 639491|Elapsed|0.210083
Jan 20 21:35:40 server2006 esmith::event[4550]: Processing event: post-backup2-custom 911
Jan 20 21:35:40 server2006 e-smith-bg: Cannot open /etc/smbpasswd
I wouldn't think /etc/smbpasswd would have anything to do with a locally-attached usb disk (but I could be clueless here).
2 - USB Disk time to umount after backup log has added all files (according to log).
I have noticed that it takes awhile for the usb disk to umount.  Could it be that backup2 is still compressing the files?  I am still using default compression 3.  I'll try a 0 to see if the disk umounts any quicker.
This is being run on a Dell PowerEdge 500SC, 1.15Ghz processor, two 7200 rpm disk raid 1 (separate ide channels), top reports 645.7MB of RAM.

Thanks for the great work.

Kevin

rf131

Compression 0 Results
« Reply #3 on: January 21, 2006, 05:00:44 AM »
Same results.  911 takes about 5 minutes to run.  The 911 post-processing runs very quickly.  I'm waiting on something here.

I'll test with a larger backup and see if the timing is any different.

Kevin

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
Re: alpha 4 Test
« Reply #4 on: January 21, 2006, 05:20:34 PM »
Quote from: "rf131"
"Cannot open /etc/smbpasswd"

/etc/smbpasswd does not exist in a fresh install of 7.0pre1 as samba conf files have moved to /etc/samba/smbpasswd. IIRC if you upgrade from previous SME releases you may have a linked file /etc/smbpasswd to /etc/samba/smbpasswd. I also note that the generic SME Server backup panel also attempts to backup both sources. See /usr/lib/perl5/site_perl/esmith/Backup.pm. I decided to also include both file locations in the DisasterRecoverySource. The result is a non-critical log error if the file/link does not exist. Easy for anyone to change by editing via the panel and dropping /etc/smbpasswd if it does not exist on your server. I will most likely drop this from the default source sometime in the future.

Quote from: "rf131"
USB Disk time to umount after backup log has added all files.

The script simply issues the standard umount command. How long it takes to unmount is up to your server to process the command. Good be a lot of things. Hardware, ext3 journalling completing, your mount point choice and fstab entries, any external command accessing the mount point during umount?

Thanks for the feedback.

Darrell