Koozali.org: home of the SME Server

[ANNOUNCE] smeserver-dar2

Offline piran

  • ****
  • 502
  • +0/-0
[ANNOUNCE] smeserver-dar2
« Reply #45 on: October 15, 2006, 03:54:21 PM »
Quote from: "piran"
... and stress the system with
concurrent jobs to identify where I can increase or maximise data
throughput ...

I stressed it a little and it broke;~/ (server not contrib)
http://bugs.contribs.org/show_bug.cgi?id=1980
Appears 'samba' has a vulnerability when it comes to multiple mounts.
Though I grant that my box does not (yet) have an associated patch kindly
derived by Greg and Charlie http://bugs.contribs.org/show_bug.cgi?id=1969 .
AFAIC, for the sake of resiliency and reliability, smbfs mounts' concurrency
is now to be routinely avoided here. The irony being my attempts to extend
the boundary in the site's safety (copious backups) crashed my server, so
no more deliberate mount concurrency;~)

remstrus

[ANNOUNCE] smeserver-dar2
« Reply #46 on: October 15, 2006, 05:11:10 PM »
Hey Darell

Just got round to installing the contrib, the following were reported after the backup :

Quote
Creating /mnt/dar2/neobackup dir
Connecting /mnt/dar2/neobackup to //360server/serverbackup
Expanding /etc/dar2/neobackup template
Creating destination /myserver.co.uk/neobackup dir
Expiring old backups
Executing pre-backup event
Verbose logging is off
Performing neobackup backup
No terminal found for user interaction. All questions will be assumed a negative answer (less destructive choice), which most of the time will abort the program.


 --------------------------------------------
 14908 inode(s) saved
 with 0 hard link(s) recorded
 0 inode(s) changed at the moment of the backup
 0 inode(s) not saved (no file change)
 0 inode(s) failed to save (filesystem error)
 239 files(s) ignored (excluded by filters)
 0 files(s) recorded as deleted from reference backup
 --------------------------------------------
 Total number of file considered: 15147
 --------------------------------------------

Listing all neobackup archives on target
total 2203647
-rwxr-xr-x  1 root root 681574400 Oct 15 14:04 2006.10.15.1.dar
-rwxr-xr-x  1 root root 681574400 Oct 15 14:06 2006.10.15.2.dar
-rwxr-xr-x  1 root root 681574400 Oct 15 14:09 2006.10.15.3.dar
-rwxr-xr-x  1 root root 211810995 Oct 15 14:10 2006.10.15.4.dar

Executing post-backup event
Dismounting /mnt/dar2/neobackup

Sun Oct 15 14:00:01 BST 2006 - backup started
Sun Oct 15 14:10:26 BST 2006 - backup finished


The only thing that concearns me is the
Quote
No terminal found for user interaction. All questions will be assumed a negative answer (less destructive choice), which most of the time will abort the program.


It may be fine, I am new to the scene so can't really interpret the results!

Hope this helps.

Phil

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #47 on: October 15, 2006, 05:45:58 PM »
Quote
No terminal found for user interaction. All questions will be assumed a negative answer (less destructive choice), which most of the time will abort the program.

Normal output. This is simply stating that the job is being run automatically by cron, not a user able to answer and respond to errors if encountered. If any errors are encountered the dar program displays the error and awaits user response. With no one to respond dar automatically assumes a negative answer and as stated will most likely abort. Then our job is to review the error encountered and correct it.

As an example, if you run a dar job from the command line, this message does not occur as you are there to answer any queries.

Darrell

remstrus

[ANNOUNCE] smeserver-dar2
« Reply #48 on: October 15, 2006, 06:04:01 PM »
Hey Darrell

Great stuff, so I can assume everything has gone ok?

I have been looking for a network share contrib like this for ages, many thanks for your efforts.

Am I correct in saying this contrib backs up Ibays, MySQL Databases and Email?

What parts of SME does the contrib not backup?

Many Thanks

Phil

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #49 on: October 15, 2006, 07:42:23 PM »
Quote from: "remstrus"
Great stuff, so I can assume everything has gone ok?

Looks good to me.
Quote from: "remstrus"
I have been looking for a network share contrib like this for ages, many thanks for your efforts.

This has been available for over two years.  :wink: Started as backup2ws, then renamed backup2, now dar2.
Quote from: "remstrus"
Am I correct in saying this contrib backs up Ibays, MySQL Databases and Email?

Yes
Quote from: "remstrus"
What parts of SME does the contrib not backup?

Everything that _is_ backed up is visible in the View/Modify panel. The only exception is every backup runs the pre-backup event which adds the mysql dump automatically. Basically is capable of performing a default smeserver disaster recovery backup/restore. Note this does not include any contrib rpms which must be reloaded after restore.
Code: [Select]
[TIP] If you keep your contribs in /root/contribs this becomes easy to identify and restore all your contribs.
Darrell

Offline GMa

  • 6
  • +0/-0
[ANNOUNCE] smeserver-dar2
« Reply #50 on: October 16, 2006, 01:02:30 AM »
Hi Darell,

Thanks for this great contrib, worked like a charm here,
6.5 Gb saved in 8 min

I have had some troubles at the beginning, for example I was first mounting my USB drive -> no error message but not working.
I found this in /var/log/messages
"according to mtab, /dev/sda1 is already mounted on /media/usbdisk"

One minor cosmetic thing, when the save button is used, the view is not refreshed in the Disk ARchive panel, ie the new backup job doesn't appear

Thanks again

GMa

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #51 on: October 16, 2006, 07:11:37 PM »
Beta 8 released:
Code: [Select]
# rpm -qp --changelog smeserver-dar2-0.0.1-b8may.noarch.rpm
* Mon Oct 16 2006 Darrell May <dmay@myezserver.com>
- BT:1979 German language file added
- BT:1982 fix navigation-conf generated error
- [0.0.1-b8dmay]

Many thanks to Dietmar Berteld for providing the German language translation. If anyone else is interested in providing a translation please visit BT:1979

Darrell

Offline wjhobbs

  • ****
  • 171
  • +0/-0
    • http://www.chryxus.ca
[ANNOUNCE] smeserver-dar2
« Reply #52 on: October 17, 2006, 04:21:02 PM »
Darrell,

Can backup2 and dar2 co-exist on the same server?

Thanks.

John
...

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #53 on: October 17, 2006, 08:45:58 PM »
Quote from: "wjhobbs"
Can backup2 and dar2 co-exist on the same server?

There is nothing preventing the two co-existing. However you should switch to dar2 and remove backup2 as soon as convenient.

Darrell

Offline jameswilson

  • ****
  • 739
  • +0/-0
    • Security Warehouse, trade security equipment
[ANNOUNCE] smeserver-dar2
« Reply #54 on: October 19, 2006, 11:21:45 AM »
Just installed Dar 2 and have to say thankyou its superb, backed up my whole sme in about 6 minutes, very impressive.
Would it be possible though to state in the email what sbeen backed up without using verbose

ie 3700 files
mysql @ 25 Mb

Total backup size 1.55 Gb
Duration  0.3 Hours
at .4 Gb per hour

etc

But worked forst time for me using usb how to thanks

ps how do i know how much space is available on my backup drive? could that be added to the email too, as id like to backup everything and keep as many copies over time as possible

Offline piran

  • ****
  • 502
  • +0/-0
[ANNOUNCE] smeserver-dar2
« Reply #55 on: October 19, 2006, 11:26:23 AM »
Email sent after a scheduled run but not after a directly invoked run.
Look at /var/log/dar2/mydomain/mybackup
and /var/log/messages too.

Offline jameswilson

  • ****
  • 739
  • +0/-0
    • Security Warehouse, trade security equipment
[ANNOUNCE] smeserver-dar2
« Reply #56 on: October 19, 2006, 11:36:50 AM »
Piran, thanks i do get the email and everything worked as described with no issues at all, just wanted to add a bit of feedback of things i (maybe no-one else lol) finds useful

Offline piran

  • ****
  • 502
  • +0/-0
[ANNOUNCE] smeserver-dar2
« Reply #57 on: October 19, 2006, 11:46:42 AM »
Noted, OTOH it could add stuff that might go wrong or get misreported.
This one gets the core back up and going. The rest is... well, different.
Darrell appears to be working on a further contrib that might suit:
http://forums.contribs.org/index.php?topic=34226.0

Offline raem

  • *
  • 3,972
  • +4/-0
[ANNOUNCE] smeserver-dar2
« Reply #58 on: October 19, 2006, 02:19:19 PM »
dmay

> The only exception is every backup runs the pre-backup event which adds the mysql dump automatically

Good idea, I think a lot of people have been caught by mysql dumps not being included in the previous contribs' "non 911" backup jobs, me included !

Thanks Darrell for your good work & ongoing improvements to this contrib.
...

Offline dmay

  • *
  • 450
  • +0/-0
    • http://myezserver.com
[ANNOUNCE] smeserver-dar2
« Reply #59 on: October 19, 2006, 04:32:06 PM »
Quote from: "jameswilson"
Would it be possible though to state in the email ...

James. Some good ideas. However, please open a Bug Tracker ticket for all new feature requests. Prefix your summary title with 'NFR':

http://bugs.contribs.org/enter_bug.cgi?product=SME%20Contribs
smeserver-dar2

Darrell