Koozali.org: home of the SME Server

[ANNOUNCE] smeserver-dar2

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« on: October 04, 2006, 07:19:37 PM »
Jump to here for release announcement Oct 19, 2006:

http://forums.contribs.org/index.php?topic=34041.0

Darrell

remstrus

[ANNOUNCE] smeserver-dar2
« Reply #1 on: October 05, 2006, 09:29:06 AM »
Hey Darrell

Looking forward to this contrib, will install on a test server.

Phil

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #2 on: October 05, 2006, 04:00:23 PM »
Quote from: "remstrus"
Hey Darrell

Looking forward to this contrib, will install on a test server.

Phil

So there is life out there :wink: I look forward to your test reports Phil.

Here are a few tips. Once you configure a backup job there are three ways to launch it. Automated via scheduled cron job, manual via the Backup panel or direct from the command line.

The output of automated jobs is e-mailed to admin. So the typical overnight backup will be e-mailed.

Manual jobs executed from the panel send output to /var/log/messages. Use the 'View log file' panel to monitor the job progress.

Command line you simply issue:

/etc/e-smith/events/actions/dar2-backup job

Replace job with your configured jobname. Output is direct to console.

For restores, best to use the panel only. It is possible to execute from the command line but you need to fully understand and populate restore.job db entries.

Darrell

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #3 on: October 05, 2006, 04:46:53 PM »
Code: [Select]
# rpm -qp --changelog smeserver-dar2-0.0.1-b1dmay.noarch.rpm

* Thu Oct 05 2006 Darrell May <dmay@myezserver.com>
- update actions dar2-backup/restore to support custom mount points
- [0.0.1-b1dmay]

Darrell

Offline idyll

  • ***
  • 113
  • +0/-0
testing new software
« Reply #4 on: October 05, 2006, 04:55:19 PM »
Hello.

SME 7.0, up to date.

I have been using the previous backup2USB for months, without issue.

I installed your new contrib, and the following error message is appearing. It is the same hardware, (USB connected 250GB Maxtor with the correct fstab for the earlier contrib, at least) as the older contrib was using. I have not de-installed your previous contrib. I kicked off a manual test job using the web GUI...

--------------
Oct  5 07:41:47 galadriel e-smith-bg: Creating /media/MobyDisk/911 dir
Oct  5 07:41:47 galadriel e-smith-bg: Connecting /media/MobyDisk/911 to /media/MobyDisk
Oct  5 07:41:47 galadriel e-smith-bg: mount: /media/MobyDisk is not a block device

-----------------

Any pointers to help me out? I'll post in the bug tracker.

thanks

regards,
patrick
...

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #5 on: October 05, 2006, 06:38:19 PM »
Why are you using a custom mount point /media/MobyDisk for a standard usb disk? SME 7.x automatically supports an attached usb disk via /media/usbdisk.

I also expect you are not using beta 1. Grab the latest rpm. It supports custom mount points.

Darrell

Offline idyll

  • ***
  • 113
  • +0/-0
works like advertised
« Reply #6 on: October 05, 2006, 08:05:08 PM »
The beta 1 recognized my custom mount point. Works fine. I need to test some restores, etc.

I did not receive email when the task completed. Is this feature in place yet?

regards,

patrick
...

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
Re: works like advertised
« Reply #7 on: October 05, 2006, 08:31:35 PM »
Quote from: "idyll"
The beta 1 recognized my custom mount point. Works fine. I need to test some restores, etc.

Excellent!

Quote from: "idyll"
I did not receive email when the task completed. Is this feature in place yet?

Yes. As stated only automatic scheduled jobs run by cron are e-mailed.

Quote
The output of automated jobs is e-mailed to admin. So the typical overnight backup will be e-mailed.

Manual jobs executed from the panel send output to /var/log/messages. Use the 'View log file' panel to monitor the job progress.

Command line you simply issue:

/etc/e-smith/events/actions/dar2-backup job

Replace job with your configured jobname. Output is direct to console.

Darrell

Offline idyll

  • ***
  • 113
  • +0/-0
new output
« Reply #8 on: October 05, 2006, 08:47:19 PM »
This little summary, included in the logfiles of the manually created job, is very cool and potentially very useful.

Awesome.

regards,

patrick

--------------------------------------------
Oct  5 10:59:38 galadriel e-smith-bg:  25728 inode(s) saved
Oct  5 10:59:38 galadriel e-smith-bg:  with 99 hard link(s) recorded
Oct  5 10:59:38 galadriel e-smith-bg:  0 inode(s) changed at the moment of the backup
Oct  5 10:59:38 galadriel e-smith-bg:  0 inode(s) not saved (no file change)
Oct  5 10:59:38 galadriel e-smith-bg:  0 inode(s) failed to save (filesystem error)
Oct  5 10:59:38 galadriel e-smith-bg:  244 files(s) ignored (excluded by filters)
Oct  5 10:59:38 galadriel e-smith-bg:  0 files(s) recorded as deleted from reference backup
Oct  5 10:59:38 galadriel e-smith-bg:  --------------------------------------------
Oct  5 10:59:38 galadriel e-smith-bg:  Total number of file considered: 25972
Oct  5 10:59:38 galadriel e-smith-bg:  --------------------------------------------
...

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #9 on: October 05, 2006, 09:38:35 PM »
beta 2 released:

Code: [Select]
# rpm -qp --changelog  smeserver-dar2-0.0.1-b2dmay.noarch.rpm

* Thu Oct 05 2006 Darrell May <dmay@myezserver.com>
- added db prop Verbose to control backup output detail
- [0.0.1-b2dmay]

Darrell

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #10 on: October 06, 2006, 07:12:32 PM »
Would appreciate receiving more test reports. Has anyone performed a full disaster recovery restore test?

Darrell

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #11 on: October 06, 2006, 11:45:45 PM »
beta 3 released

Code: [Select]
# rpm -qp --changelog smeserver-dar2-0.0.1-b3dmay.noarch.rpm
* Fri Oct 06 2006 Darrell May <dmay@myezserver.com>
- added dar2-dr-restore, a disaster recovery restore script.
- [0.0.1-b3dmay]

How to test a disaster recovery

Set up a test server. Add some users, ibays, files, emails. Install the following rpms:

dar-2.3.1-1.i386.rpm
perl-CGI-FormMagick-0.92-08.noarch.rpm
smeserver-dar2-0.0.1-b3dmay.noarch.rpm

Configure a dar job and perform a backup.

Blow your server away by performing a fresh reinstall reformating the drive. Perform a basic console config entering the exact same server parameters as used perviously. Install the following rpms:

dar-2.3.1-1.i386.rpm
perl-CGI-FormMagick-0.92-08.noarch.rpm
smeserver-dar2-0.0.1-b3dmay.noarch.rpm

Launch the disastery recovery restore script and answer all questions as prompted:

/etc/e-smith/events/actions/dar2-dr-restore

I have tested a usb restore and found it successfull. Please test and report your results.

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #12 on: October 07, 2006, 05:52:47 PM »
beta 4 released:
Code: [Select]
[root@sme ~]# rpm -qp --changelog smeserver-dar2-0.0.1-b4dmay.noarch.rpm
* Sat Oct 07 2006 Darrell May <dmay@myezserver.com>
- bugfix:1964 crontab
- [0.0.1-b4dmay]

http://bugs.contribs.org/show_bug.cgi?id=1964

Darrell

Offline piran

  • ****
  • 502
  • +0/-0
[ANNOUNCE] smeserver-dar2
« Reply #13 on: October 09, 2006, 09:33:06 AM »
Is the partial/differential/incremental functionality of DAR in operation yet?

Offline wjhobbs

  • ****
  • 171
  • +0/-0
    • http://www.chryxus.ca
[ANNOUNCE] smeserver-dar2
« Reply #14 on: October 09, 2006, 06:46:10 PM »
Hi Darrell,

Is there any difference on a 911 restore between running your script as noted above (/etc/e-smith/events/actions/dar2-dr-restore) and setting up an equivalent backup job using the panel and initiating a restore and subsequent reconfigure from there?

This is the process I followed and the restore has appeared to work successfully. I backed up my test server to a production machine ibay and performed the restore from the same location. Users, groups, ibay contents, mail all appeared to be there after the restore.

Also, could you consider adding a reminder in the panel that the standard list of items backed up for a Disaster Recovery job does not include other contribs/systems added after the SME Server install. I had fogotten that and one of my applications failed after the restore -- because the list did not include the directories where postgresql was installed. (My problem - not the fault of the backup system.)

Great contrib, Darrell.

John
...