Koozali.org: home of the SME Server

Workstation Selective Restore issues with large backup sets

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
See discussion in german forum, mostly English re initial issue, now solved and ongoing issue displaying files and directories for restore when large backup sets are involved.

Bug 8271 has had other reports of same issue duplicated to it, if you can help go there

I have been able to use dar-manager from the cli to display the list of files/dirs that the selective restore produces to be displayed in server-manager. This included a 400+gb backup, this list in most cases is quite small, also dumped the output to a small file.  So the actual cli action seems to not produce an error even with the very large backup.

Small backup sets upto at least 100gb (limit of my testing) all display a list of files/dirs in the selective restore window of server-manager.

Backup set of 400+gb (all I have to test with) times out in displaying files/dirs in the server-manager window, a smarter person than I will find the why and we can fix it. 

The "pipe/process/whatever" that sits between the perl script and server-manager (apache or whatever) breaks with the bigger backup

See Bug 8271 there were a couple of other bugs that were dupes these have been closed and consolidated in this bug
--
qui scribit bis legit

Offline janet

  • ****
  • 4,812
  • +0/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #1 on: June 26, 2019, 07:01:58 AM »
TerryF

Did you try different browsers ?
Please search before asking, an answer may already exist.
The Search & other links to useful information are at top of Forum.

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #2 on: June 26, 2019, 07:53:47 AM »
Not yet, will go and do it now,

With a backup of 78gb, there is no issue using Edge, its just the larger backup that have a problem, I have one of 400+gb that suffers
--
qui scribit bis legit

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #3 on: June 26, 2019, 08:00:52 AM »
Just tried to bring up the most recent inc file of the 400+gb backup

Ok, using Chrome, same problem, select the backup, perform, server-manager window "Workstation selective file restore" does not show files or dirs., and never shows that the process is even finished,

httpd admin error log
[Wed Jun 26 15:54:51 2019] [error] [client 127.0.0.1] No terminal found for user interaction. All questions will be assumed a negative answer (less destructive choice), which most of the time will abort the program., referer: https://192.168.11.19/server-manager/cgi-bin/backup
[Wed Jun 26 15:55:08 2019] [error] [client 127.0.0.1] No terminal found for user interaction. All questions will be assumed a negative answer (less destructive choice), which most of the time will abort the program., referer: https://192.168.11.19/server-manager/cgi-bin/backup
--
qui scribit bis legit

Offline janet

  • ****
  • 4,812
  • +0/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #4 on: June 26, 2019, 09:44:18 AM »
TerryF

Apologies for suggesting more work, try latest Firefox, & try after a fresh restart of Windows.
Please search before asking, an answer may already exist.
The Search & other links to useful information are at top of Forum.

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #5 on: June 26, 2019, 11:02:35 AM »
Apologies for suggesting more work, try latest Firefox, & try after a fresh restart of Windows.

I'll give it a whirl just to eliminate it..
--
qui scribit bis legit

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #6 on: June 26, 2019, 03:23:19 PM »
Firefox same behaviour as Chrome and Edge
--
qui scribit bis legit

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #7 on: June 26, 2019, 04:40:10 PM »
As I have discussed with Terry, this may not have reared its head years back because backups were that much smaller. I doubt it was ever tested on 400gb !!

We may need a bit of a guru to look at this.
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #8 on: June 27, 2019, 12:51:25 AM »
Janet this from the admin-error log is the key, all in the Bug

[Wed Jun 26 23:21:44 2019] [warn] [client 127.0.0.1] Timeout waiting for output from CGI script /etc/e-smith/web/panels/manager/cgi-bin/backup, referer: https://192.168.11.19/server-manager/cgi-bin/backup

[Wed Jun 26 23:21:44 2019] [error] [client 127.0.0.1] (70007)The timeout specified has expired: ap_content_length_filter: apr_bucket_read() failed, referer
--
qui scribit bis legit

Offline janet

  • ****
  • 4,812
  • +0/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #9 on: June 27, 2019, 05:42:53 PM »
Terry

Did you try changing the timeout setting as mentioned in the bug report ?
I would also suggest to change it to a much longer (10x more) value than suggested, just to see if that affects/resolves the issue.
Please search before asking, an answer may already exist.
The Search & other links to useful information are at top of Forum.

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Workstation Selective Restore issues with large backup sets
« Reply #10 on: June 28, 2019, 01:29:57 AM »
Terry

Did you try changing the timeout setting as mentioned in the bug report ?
I would also suggest to change it to a much longer (10x more) value than suggested, just to see if that affects/resolves the issue.

All that, multiple settings, 600, 900, 3000, have watched the process run in htop, takes just on 8 minutes and that PID closes, no updates appear in server-manager window during or end..

There was a known issue back in early 2003, Apache bug https://bz.apache.org/bugzilla/show_bug.cgi?id=23528 patched in later versions, have tried the suggestions from there, nada

This  https://www.perlmonks.org/?node_id=809078 gives a hint but do not know who to do the code (perl) to add to the selective restore script to make it keep the pipe active while the script runs, and no it is not stderr that is the issue have dumped stdout and stderr to files from the cli stderr was empty

--
qui scribit bis legit

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
--
qui scribit bis legit