Koozali.org formerly Contribs.org

Upgrade from 9.2 to 10 is very slow - how to do it smarter

Offline beast

  • *
  • 213
Upgrade from 9.2 to 10 is very slow - how to do it smarter
« on: July 20, 2021, 06:50:30 AM »
Hi All

I have a system where it takes something like 15 to 20 hours to make a USB backup from the admin console on a USB 3.0 port. I like to upgrade to new hardware with SSD disk in Raid 1. The problem is that the entire process takes something like 24 hours to complete. This is simply too long to take the system offline as I will get a lot of people complaining about missing email access etc.

In the past I used the Affa software to make a quick upgrade but this is still not working officially and I like to try out this official process.

Is it possible to keep the system online and as the last process transfer the emails somehow. The emails is the main problem as I can ensure that Ibays etc is not modified in the process.

Thank you
Benny
« Last Edit: July 20, 2021, 06:55:41 AM by beast »

Offline brianr

  • *
  • 956
Brian j Read
(retired, for a second time, still got 2 installations though)
The instrument I am playing is my favourite Melodeon.
.........

Offline beast

  • *
  • 213
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #2 on: July 20, 2021, 08:28:00 AM »
Here is one option:

https://wiki.koozali.org/Lazy_Admin_Tools#Server_Migration

It is not possible just to copy the /home/e-smith/files/users/ files and then

cd /home/e-smith/files/users
for f in *; do chown -R $f:$f $f; done

As the last process?

Offline brianr

  • *
  • 956
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #3 on: July 20, 2021, 10:08:04 AM »
It is not possible just to copy the /home/e-smith/files/users/ files and then

cd /home/e-smith/files/users
for f in *; do chown -R $f:$f $f; done

As the last process?

If you ONLY did this then you would not have the background data structure which supports SMEServer. I moved my 2Tb server over using the Lazy Admin tools, it worked very well.  It does rely on having a second server to migrate to.
Brian j Read
(retired, for a second time, still got 2 installations though)
The instrument I am playing is my favourite Melodeon.
.........

Offline beast

  • *
  • 213
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #4 on: July 20, 2021, 12:20:29 PM »
If you ONLY did this then you would not have the background data structure which supports SMEServer. I moved my 2Tb server over using the Lazy Admin tools, it worked very well.  It does rely on having a second server to migrate to.

First I will do a complete USB backup/restore to the new server while the old server is online. Then I will take the old server offline and copy the /home/e-smith/files/users/ files with the -a option to preserve all meta data about ownership etc. Then bring the new server online.

Will that not work?

Offline brianr

  • *
  • 956
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #5 on: July 20, 2021, 12:34:14 PM »
First I will do a complete USB backup/restore to the new server while the old server is online. Then I will take the old server offline and copy the /home/e-smith/files/users/ files with the -a option to preserve all meta data about ownership etc. Then bring the new server online.

Will that not work?

As long as in between the usb backup and the final copy you do not install or update anything (including using Server-Manager to adjust anything), then I think it will work.

PS Your copy/update will not touch any of the ibay data though.  That is held in /home/e-smith/files/ibays
Brian j Read
(retired, for a second time, still got 2 installations though)
The instrument I am playing is my favourite Melodeon.
.........

Offline beast

  • *
  • 213
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #6 on: July 20, 2021, 12:35:36 PM »
PS Your copy will not copy any of the ibay data though.  That is held in /home/e-smith/files/ibays

That is handled during the USB backup/restore and actually also include the user folder

Offline brianr

  • *
  • 956
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #7 on: July 20, 2021, 12:44:50 PM »
That is handled during the USB backup/restore and actually also include the user folder

yes, but I am assuming that the purpose of the final copy is to update the data to the latest changes made by your users while the USB backup is being installed?
Brian j Read
(retired, for a second time, still got 2 installations though)
The instrument I am playing is my favourite Melodeon.
.........

Offline beast

  • *
  • 213
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #8 on: July 20, 2021, 12:45:57 PM »
yes, but I am assuming that the purpose of the final copy is to update the data to the latest changes made by your users while the USB backup is being installed?

Yes - but I am able to ensure that nobody modify ibays in the process

Offline brianr

  • *
  • 956
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #9 on: July 20, 2021, 12:46:41 PM »
Yes - but I am able to ensure that nobody modify ibays in the process

Ok, that is fine.
Brian j Read
(retired, for a second time, still got 2 installations though)
The instrument I am playing is my favourite Melodeon.
.........

Offline Jean-Philippe Pialasse

  • *
  • 1,768
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Upgrade from 9.2 to 10 is very slow - how to do it smarter
« Reply #10 on: July 20, 2021, 01:09:44 PM »
migrate helper script /contrib allow you to backup only what is needed. you can exclude the huge folder of user data first.

install using this backup to get a running new sme then rsync data from one server to another starting with highly needed data.

you can also mount using sshfs all other non yet synced data.

of course you need two servers to do so and to change ip on old one.