Koozali.org: home of the SME Server

Not an April fool : smeserver-nextcloud available for you on SME9!!

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
You can refer to https://wiki.contribs.org/Nextcloud

This is an important contribution to fulfill your needs. Now you can enjoy the 21st century on your SME Server with a real cloud access from all your devices to both a personal cloud share, but also to your regular home folder and available ibays.

This is a beta version, so please try this, and report before installing on a production server.

Your ibays, user home are already there configured. Your users have already access to nextcloud using their SME credentials.

Waiting to read from you.
« Last Edit: April 02, 2018, 05:45:45 AM by Jean-Philippe Pialasse »

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #1 on: April 02, 2018, 04:12:31 PM »
Sounds interesting. What I'm struggling with at the moment is the pricing for the nextcloud s/w. I see mention of open source and a comparison page but the basic package looks to be a subscription starting at 1900 euro/year for 50 users.
Am I missing something with this?

[edit] think i'm answering my own question, looks like there is a community edition, just no support.
« Last Edit: April 02, 2018, 04:17:39 PM by sages »
...

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #2 on: April 02, 2018, 05:17:45 PM »
Basically, while owncloud clearly sell enterprise edition, nextcloud sells you support based on your needs.
Also they propose third party hosted solution, and hardware preinstalled.

The version here is the base community edition, with only file function enabled. You can then set additional apps according to your needs. 
« Last Edit: April 02, 2018, 05:38:53 PM by Jean-Philippe Pialasse »

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #3 on: April 06, 2018, 11:57:50 AM »
Bug raised https://bugs.contribs.org/show_bug.cgi?id=10554 for contrib. mentioning it here as there doesn't appear to be a component in the bug tracker for smeserver-nextcloud and the install package for it.
...

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #4 on: April 06, 2018, 09:33:52 PM »
Bug raised https://bugs.contribs.org/show_bug.cgi?id=10554 for contrib. mentioning it here as there doesn't appear to be a component in the bug tracker for smeserver-nextcloud and the install package for it.
Sages,
thanks.
I have updated the wiki, and created the component in bugtracker.

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #5 on: April 08, 2018, 06:00:52 AM »
I'm just chasing confirmation from anyone else using this contrib about the following observation. I have searched for anything nextcloud/android related and am still looking. I don't think this is related to the contrib. How ever if someone else is using this I would appreciate their observations.
Home folder of user is visible in nextcloud web interface as expected and 'auto configured' by the contrib. However on an attached android with the nextcloud app the only folders visible are the nextcloud created ones, ie the sme 'home' folder isn't visible on the android client.
I've tried adding another ibay via the nextcloud gui and it is visible on the web interface but not on the android app.
So on the off chance that it is something to do with the sme integration (a bit doubtful that it is) can anyone confirm/deny this issue so I can persue it in the correct forum?
Rod
...

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #6 on: April 08, 2018, 07:40:35 AM »
Good catch.
from  what I see, 2 reasons

first : you need to create a folder ibays/ to get them to appear in it .... I will need to fix this to create it without user intervention.

second : on my server the home folder is set to  password::logincredentials while ibays are set to  password::sessioncredentials. it seems that it makes a difference on the iphone / android apps... Can you confirm you have the same behaviour ?

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #7 on: April 08, 2018, 08:27:38 AM »
Good catch.
from  what I see, 2 reasons

first : you need to create a folder ibays/ to get them to appear in it .... I will need to fix this to create it without user intervention.

second : on my server the home folder is set to  password::logincredentials while ibays are set to  password::sessioncredentials. it seems that it makes a difference on the iphone / android apps... Can you confirm you have the same behaviour ?

I'm a bit confused with your reply.
first: Where are you creating the folder 'ibays/'? I can see the ibays configured in nextcloud external storages when I view them via the nextcloud web gui. They aren't visible from the android nextcloud app. I'm logged in the android app with the same user name as I use on the web gi.
second: I think I see what you are getting at here. If I configure (in nextcloud webgui) an external folder to use 'log-in credentials, save in session' I can only see the attached folder on the web gui. If I change the config to use a specific username/password then I can see the folder on the web gui and on the android app. So this suggests that there is an issue passing the login credentials from the android app through to the nextcloud server to use to access the ibay.
I don't know how nextcloud authorises the connection from the android app and what subsequent credentials are available to access the ibay.
...

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #8 on: April 08, 2018, 08:50:02 AM »
I'm a bit confused with your reply.
first: Where are you creating the folder 'ibays/'? I can see the ibays configured in nextcloud external storages when I view them via the nextcloud web gui. They aren't visible from the android nextcloud app. I'm logged in the android app with the same user name as I use on the web gi.
you need to create a "ibays" folder at the root of your user nextcloud space. Then all your ibays will show in this folder. I will update the contrib to create this folder for every user. It is about the same principle as mounting a folder to another folder on linux.



second: I think I see what you are getting at here. If I configure (in nextcloud webgui) an external folder to use 'log-in credentials, save in session' I can only see the attached folder on the web gui. If I change the config to use a specific username/password then I can see the folder on the web gui and on the android app. So this suggests that there is an issue passing the login credentials from the android app through to the nextcloud server to use to access the ibay.
I don't know how nextcloud authorises the connection from the android app and what subsequent credentials are available to access the ibay.

in fact this is by design since nextcloud 12 , see : https://github.com/nextcloud/android/issues/1267
so i will have to update the contrib accordingly 

it uses the users credential when it log using ldap to store them in db. The thing is that the app on iso and android is plan to not use anymore the credential but only an app auth key. This is a preferred way to do if you lose your phone you can just revoke the key.


Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #9 on: April 08, 2018, 09:02:26 AM »
ok understand what you're saying wrt /ibays. Don't forget to include any shares from the 'shared folders' contrib.

Read the user credentials info. Makes sense now.
cheers
...

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #10 on: April 08, 2018, 09:09:37 AM »
ok understand what you're saying wrt /ibays. Don't forget to include any shares from the 'shared folders' contrib.
that will be a NFR, will check with Daniel if he can help or give some hints, but it might be pretty similar to what I did for ibays.

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #11 on: April 08, 2018, 09:13:48 AM »
FWIW I can manually add them ok, from an SMB point of view they look the same when viewed from an smb client except they no longer have /cgi-bin, /files and /htmp sub folders
...

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #12 on: June 21, 2018, 12:13:44 AM »
I just installed this contrib on a test server running SMEserver 9.2 as a VM and this contrib was very easy to install and use.
I'm super impressed that I didn't run into any complications and that it just worked out of the box.
I excluded all of my iBays so that the only external storage at the moment is the user folder only.
It is nice to have a secure Dropbox type of application running on your own server instead of hosted elsewhere.

Thanks to Jean-Philippe for putting this contrib together and working the bugs out because it appears to be and very good cloud solution. All the best and keep up the fabulous work!

-edb
......

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #13 on: June 21, 2018, 06:03:49 AM »
edb,
thanks for the feedback. It is a pleasure to read that this work is usefull for others !

and thanks to Sages for helping to debug.

You might have seen there is a few bugs pending for the update of nextcloud, I need to hit this in the next days.

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #14 on: June 21, 2018, 06:58:09 AM »
That's good to hear Jean .... would you think it production ready once you have addressed the few bugs?
Man I can tell you I sure appreciate all your hard work!
Is there a Calendar sharing component too or is that best addressed through Horde?
Thanks again ...

-edb
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #15 on: June 21, 2018, 05:10:58 PM »
One problem I have experienced is that though Nextcloud seems to be working fine on the local IP, I cannot access Nextcloud using my external link https://www.mydomain.com/nextcloud and since I have a redirect in our Primary html folder it simply goes to that site instead of opening the Nextcloud login page. Why would that be?

Another thing I noticed (after playing with it in the test environment for a while) is that I have another online store website in a different iBay (store) and as soon as Nextcloud was installed I can no longer access that site either internally or externally which is very weird. It doesn't change anything with the stock php version or any of those files does it because the website is php 5.3 version specific and also uses php-mcrypt and Zend optimizer.
Guess I will have to get this figured out before I could go live with it but I assume it may be something simple.
Maybe a pear path if that somehow gets changed I don't know and hard to find any log file clues.
Just don't know what yet so any input would be appreciated.

-edb
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #16 on: June 21, 2018, 05:34:28 PM »
Well I think I answered my first question by looking at the config show and seeing that nextcloud was set as
|access|private|status|enabled which would indicate only private access not from the web.
So I would assume that if I set this to public instead of private that then I would be able to access via the external web interface at www.mydomain.com/nextcloud and come to the login prompt right?

Still don't know about the second issue though.
......

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #17 on: June 21, 2018, 05:48:04 PM »
Well I think I answered my first question by looking at the config show and seeing that nextcloud was set as
|access|private|status|enabled which would indicate only private access not from the web.
So I would assume that if I set this to public instead of private that then I would be able to access via the external web interface at www.mydomain.com/nextcloud and come to the login prompt right?

Still don't know about the second issue though.
by default restricted to local, but you can use the primary domain name from the LAN.
Indeed you need to authorize external access.

If you want to allow the use of another domain pointing to the server, you need to manually authorize it first by login it as admin.

I was not able to reproduce your second issue. Is your other online store has "nextcloud" in its path or ibay name ?


Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #18 on: June 21, 2018, 05:52:12 PM »
That's good to hear Jean .... would you think it production ready once you have addressed the few bugs?
Man I can tell you I sure appreciate all your hard work!
Is there a Calendar sharing component too or is that best addressed through Horde?
Thanks again ...

-edb

I use it in production. Just do not try to update it using the GUI for the moment.
There is a calendar app in it, you can use this one or horde or roundcube and others alternatives are good too.

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #19 on: June 21, 2018, 06:24:24 PM »
by default restricted to local, but you can use the primary domain name from the LAN.
Indeed you need to authorize external access.

If you want to allow the use of another domain pointing to the server, you need to manually authorize it first by login it as admin.

I was not able to reproduce your second issue. Is your other online store has "nextcloud" in its path or ibay name ?

Ok that is what I thought so I will likely have to make it public to be able to access from outside our network or on the Internet.

The second issue is a bit weird for sure and the only other possible hint for that issue may be a result of this error when installing nextcloud as per the contrib steps:
Code: [Select]
[ OK ]
[root@defconl ~]# service php-fpm start Starting php-fpm:
[root@defconl ~]# service php71—php—fpm s Starting- php-fpm: [21 —Jun —2018 00:04:03] ERROR: unable to
for address '127.0.0.1:9000': Address already in use (98)
[ 21 — Jun —2 018 00:04:03] ERROR: FPM initialization
hind listening socket
[ FAILED]
I'm not sure if this error would have anything to do with it or if it was harmless but I did capture it just in case.
But something must have changed because if I revert back on a snapshot before the nextcloud contrib is installed then everything for the store website works and if I go to the snapshot with nextcloud installed then the store site no longer works I just get nothing at all.
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #20 on: June 21, 2018, 07:49:28 PM »
Ok here is something I noticed that may have something to do with why my (store) iBay stopped working after the Nextcloud install.

Here is my php version info before the nextcloud install:
Code: [Select]
[root@defcon1 ~]# php -v
PHP 5.3.3 (cli) (built: Mar 22 2017 12:27:09)
Copyright (c) 1997-2010 The PHP Group
Zend Engine v2.3.0, Copyright (c) 1998-2010 Zend Technologies
    with Zend Guard Loader v3.3, Copyright (c) 1998-2010, by Zend Technologies

And here is the way it looks after the install of nextcloud:
Code: [Select]
root@defcon1 ~]# php -v
PHP 5.3.3 (cli) (built: Mar 22 2017 12:27:09)
Copyright (c) 1997-2010 The PHP Group
Zend Engine v2.3.0, Copyright (c) 1998-2010 Zend Technologies
    with Zend Guard Loader v3.3, Copyright (c) 1998-2010, by Zend Technologies
    with Zend OPcache v7.0.5, Copyright (c) 1999-2015, by Zend Technologies

Could the addition of ZEND OPcache be causing the issue?

So when I look at the values for the phpinfo for the store ibay it shows OPcache loaded so for a test how would I be able to stop it from loading for that specific ibay?
« Last Edit: June 21, 2018, 08:12:03 PM by edb »
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #21 on: June 21, 2018, 09:30:32 PM »
Okay, I figured it out finally and yes it was due to the opcache.enable=1 being enabled that was causing my other Zend website to stop functioning.

So what I had to do is disable it in /etc/php.d/opcache.ini and change the entry to :
opcache.enable=0 instead of 1 and that got the website to start working again.

It appears that Nextcloud is also still working fine without it enabled so not sure what role it plays other than to speed things up?

Not sure if this was a global setting that could somehow be disabled on a per ibay basis for example but likely not.

Anyway it appears that the issues are all solved now unless someone know a reason why I would have to have it enabled.

Maybe this will help other who run into this challenge as well.


« Last Edit: June 22, 2018, 12:23:28 AM by edb »
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #22 on: June 22, 2018, 02:42:35 AM »
Can someone tell me what the correct db command would be to allow WAN (public) access to nextcloud?
I tried just changing from private to public but that didn't seem to work so I must be missing something.
config show nextcloud displays access=public but not sure why this doesn't work when I go to www.mydomain.com/nextcloud.
......

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #23 on: June 22, 2018, 03:23:22 AM »
Did you follow the example under inthe NextCloud wiki entry for settings?

ie did you also  run

signal-event nextcloud-update



after changing the db setting?
...

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #24 on: June 22, 2018, 03:35:25 AM »
Did you follow the example under inthe NextCloud wiki entry for settings?

ie did you also  run

signal-event nextcloud-update



after changing the db setting?

Thank you for pointing that out .... the signal-event nextcloud-update was what I needed to do and it appears working now.
Thank you very much.
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #25 on: June 28, 2018, 11:20:57 PM »
One thing I noticed since installing nextcloud contrib is that now when I create a new user or make changes in server manager it takes for ever for them to complete and I get a message like this:
Quote
Proxy Error

The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request POST /server-manager/cgi-bin/useraccounts.

Reason: Error reading from remote server

When I click on Users in server manger I can see that the user was indeed created just don't know why that is happening now. Seem a bit buggy.
......

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #26 on: June 29, 2018, 02:15:11 AM »
Pretty sure Nextcloud is re-scanning file folders after each update. This can take a long time if any folders contain large numbers of files.
...

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #27 on: June 29, 2018, 09:40:37 PM »
the events are running to scan file and to update ldap db. Both are time consuming, and run for longer than the server manager was designed to wait for. The more user and group, the longer time it takes.
The task is running as background so it will end on itself cleanly, but indeed this could create a timeout on your side so you do not see the actual result...
this is a known issue, and could also happen if you have hundreds of users, groups and domains

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #28 on: June 29, 2018, 10:22:06 PM »
the events are running to scan file and to update ldap db. Both are time consuming, and run for longer than the server manager was designed to wait for. The more user and group, the longer time it takes.
The task is running as background so it will end on itself cleanly, but indeed this could create a timeout on your side so you do not see the actual result...
this is a known issue, and could also happen if you have hundreds of users, groups and domains

Ok, that explains it then and other than the time out error it appears to be harmless.
Would be good if there was a way to increase the server-manager time-out setting though.
I can live with it knowing that it is all actually working as it should with the error exception.
I used to be able to save changes within 10-30 seconds and now it is a couple minutes.
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #29 on: July 11, 2018, 07:52:27 PM »
I am currently running
Code: [Select]
smeserver-nextcloud-1.1.0-8.el6.sme.noarch and I beleive it is the latest but is it safe to update from Nextcloud to the newer version 13.0.4?
I seem to remember you saying that the update had some issues but not sure if they were fixed yet or not and don't want to break anything.
Thanks

-edb
......

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #30 on: July 17, 2018, 08:32:09 AM »
I am currently running
Code: [Select]
smeserver-nextcloud-1.1.0-8.el6.sme.noarch and I beleive it is the latest but is it safe to update from Nextcloud to the newer version 13.0.4?
I seem to remember you saying that the update had some issues but not sure if they were fixed yet or not and don't want to break anything.
Thanks

-edb

Not yet fixed, need to put some time on it in the next week

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #31 on: July 17, 2018, 02:29:41 PM »
Okay thank you Jean.
No hurry of course just thought I would ask and really appreciate your work on this.
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #32 on: September 27, 2018, 08:40:25 PM »
Not yet fixed, need to put some time on it in the next week


Sorry to bug but just curious if this has been updated at all yet? I have not seen any update yet.
I there anything I need to know prior to removing this contrib if I decide to do so?
Just don't want to damage anything on my production server.
Best regards
......

Offline codework

  • 5
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #33 on: January 06, 2019, 09:49:57 AM »
Many thanks for integrating Nextcloud into the SME server. From my point of view this is a real milestone!
How can I change the setting "memory_limit"?
I tried the following without success:
"config setprop php71 MemoryLimit 512M"

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #34 on: January 06, 2019, 11:47:40 AM »
Did you run a signal-event and expand the template?
--
qui scribit bis legit

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #35 on: January 06, 2019, 12:14:59 PM »
To be specific

# config show php71
php71=configuration
    AllowUrlFopen=Off
    MaxExecutionTime=30
    MaxFileUpload=20
    MaxInputTime=60
    MemoryLimit=128M
    PhpModule=disabled
    PostMaxSize=20M
    UploadMaxFilesize=10M


# config setprop php71 MemoryLimit 512M
# expand-template /opt/remi/php71/root/etc/php.ini
# config show php71

# config show php71
php71=configuration
    AllowUrlFopen=Off
    MaxExecutionTime=30
    MaxFileUpload=20
    MaxInputTime=60
    MemoryLimit=512M
    PhpModule=disabled
    PostMaxSize=20M
    UploadMaxFilesize=10M
--
qui scribit bis legit

Offline codework

  • 5
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #36 on: January 06, 2019, 05:44:39 PM »
I made it that way.
But my Nextcloud15 instance only gets 128MB memory.

Offline codework

  • 5
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #37 on: January 06, 2019, 05:52:50 PM »
I tried:
Code: [Select]
config setprop php71 MemoryLimit 512M
expand-template /opt/remi/php71/root/etc/php.ini
signal-event php-update
signal-event nextcloud-update

Test .php in Nextcloud root:
Code: [Select]
echo phpversion()."<br>";
echo 'memory_limit = ' . ini_get('memory_limit') ."<br>";

Result:
7.1.20
memory_limit = 128M

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #38 on: January 06, 2019, 11:04:57 PM »
I don't have nextcloud installed so am unable to follow it all the way..

I would suspect Nextcloud has further configs somewhere that are part of memory settings.

--
qui scribit bis legit

Offline janet

  • ****
  • 4,812
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #39 on: January 07, 2019, 01:55:10 AM »
codework

I suggest  you do

signal-event post-upgrade
signal-event reboot

to see if a reconfigure & restart gets things working correctly.
Please search before asking, an answer may already exist.
The Search & other links to useful information are at top of Forum.

Offline gavan_white

  • *
  • 29
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #40 on: January 07, 2019, 07:03:27 AM »
Hi, everyone. I am by no means very good at working out problems. I have followed this thread looking to see if the issue with php71 memory limit would help my issue an it has partly only.

I performed the NextCloud upgrade as presented. The main problem is that I found that NextCloud was not accessable, with the message that Maintenance mode was on. I have changed the maintenance mode to off, but the web browser still has the same message and I cannot get to sign in.

I used the code:
su www -s /bin/bash
cd /usr/share/nextcloud/
scl enable php71 'php occ maintenance:mode --off'
scl enable php71 'php occ maintenance:repair'
exit

Despite maintenance mode being off, there were errors with the repair part which I did understand.

I would be guided by you to see what I should present concerning logs, etc, or whether this is just something I overlooked with the upgrade. I have increased the memory to 512M.

I am happy to submit as a potential bug, but want to be sure that I have not just done something stupid

Gavan

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #41 on: January 07, 2019, 07:13:53 AM »
I've done the upgrade however I did have problems with the versions of nextcloud. Nextcloud will only upgrade one major version at a time.
See my comments in this bug report https://bugs.contribs.org/show_bug.cgi?id=10670

My nextcloud install is still reporting php memory <512M but appears to be running ok.
Note I have only update to V14.04 Nextcloud. I'm now waiting till 15.1 or greater before updating nextcloud as per their inbuilt update suggestions.
Rod
...

Offline gavan_white

  • *
  • 29
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #42 on: January 07, 2019, 09:29:00 AM »
Thanks for the comment. I will review my version and see if that is what I did wrong.

On the bright side, I have found NextCloud and the smeserver-nextcloud to be excellent. I have used OwnCloud for ages and this installation works better anddefinitely don't want to stop using it.

Congratulations to everyone who got this set up and going.

Gavan

Offline codework

  • 5
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #43 on: January 07, 2019, 11:59:36 AM »
I suggest  you do

signal-event post-upgrade
signal-event reboot

to see if a reconfigure & restart gets things working correctly.
I did. But no change.
"var_dump( get_cfg_var('cfg_file_path') );"
shows that the following php.ini is used:
"/etc/opt/remi/php71/php.ini"
and in this the memory_limit is set correctly.
The setting is obviously ignored or overwritten.
no idea where to look...

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #44 on: January 07, 2019, 09:49:59 PM »
Have got the contrib installed, rather than look to /php71 as the be all and end all.

These areas and templates

/usr/share/nextcloud
.htaccess
.user.ini

etc/php-fpm.d/www.conf

/etc/e-smith/templates/etc/php-fpm.d/
/etc/e-smith/templates/etc/php-fpm.d/www.conf
/etc/e-smith/templates/etc/php-fpm.d/custom.conf

/etc/e-smith/templates/etc/php-fpm.conf


and no still see the message in nexcloud of: The PHP memory limit is below the recommended value of 512MB." is still coming up with 1024M set in those above..

There is more to this story than my limited knowledge is up to just yet :-)

On the hunt :-)
--
qui scribit bis legit

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #45 on: January 07, 2019, 11:38:43 PM »
OK, settings Overview no more message -  The PHP memory limit is below the recommended value of 512MB

Deals done..combination of things..
--
qui scribit bis legit

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #46 on: January 08, 2019, 12:19:29 AM »
the culprite file is /etc/e-smith/templates/etc/php-fpm.d/www.conf/15Nextcloud

it says
php_admin_value[memory_limit] = 128M

will update it tonigh after opening a bug

ideally i would add some configuration variables

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #47 on: January 08, 2019, 12:24:30 AM »
JP I was keeping it as a surprise :-(, was just resetting everything to default to document.. :-) and think there may be more, time will tell, I am but a pleb :-)
« Last Edit: January 08, 2019, 12:32:06 AM by TerryF »
--
qui scribit bis legit

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #48 on: January 08, 2019, 01:12:46 AM »
JP I was keeping it as a surprise :-(, was just resetting everything to default to document.. :-) and think there may be more, time will tell, I am but a pleb :-)

oups

sorry I am slow sometime to react but was fast on this one ;)

https://bugs.contribs.org/show_bug.cgi?id=10695

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #49 on: January 08, 2019, 02:03:18 AM »
na alls good mate, I was probably all day to put together a proper answer and how to temp fix, I am like a small child who is given a treat, bugger everyone else I am going to eat this all first LOL :-)
--
qui scribit bis legit

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #50 on: January 08, 2019, 04:31:55 AM »
See Bug 10695 for updated package

Nextcloud configs now honour memory_Limit settinsg in config db

# config setprop php71 MemoryLimit 1024M
# expand-template /opt/remi/php71/root/etc/php.ini
# config show php71

# config show php71
php71=configuration
    AllowUrlFopen=Off
    MaxExecutionTime=30
    MaxFileUpload=20
    MaxInputTime=60
    MemoryLimit=1024M
    PhpModule=disabled
    PostMaxSize=20M
    UploadMaxFilesize=10M
--
qui scribit bis legit

Offline codework

  • 5
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #51 on: January 08, 2019, 11:15:38 AM »
Thank you very much. It works now.
Code: [Select]
config setprop nextcloud MemoryLimit 1024
signal event nextcloud-update

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #52 on: January 09, 2019, 05:41:07 PM »

I have updated manually as per Wiki from version is 13.0.1 to Nextcloud 14.0.4.  Now I have corrected most of the errors except these:

There are some errors regarding your setup.

   
Code: [Select]
Some files have not passed the integrity check. Further information on how to resolve this issue can be found in the documentation. (List of invalid files… / Rescan…)

    Your web server is not properly set up to resolve "/.well-known/caldav". Further information can be found in the documentation.
    Your web server is not properly set up to resolve "/.well-known/carddav". Further information can be found in the documentation.
    The database is missing some indexes. Due to the fact that adding indexes on big tables could take some time they were not added automatically. By running "occ db:add-missing-indices" those missing indexes could be added manually while the instance keeps running. Once the indexes are added queries to those tables are usually much faster.
        Missing index "parent_index" in table "oc_share".
        Missing index "fs_mtime" in table "oc_filecache".
    The "Referrer-Policy" HTTP header is not set to "no-referrer", "no-referrer-when-downgrade", "strict-origin", "strict-origin-when-cross-origin" or "same-origin". This can leak referer information. See the W3C Recommendation ↗.

Has anyone else seen this and how to fix?


Thanks

edb
« Last Edit: January 09, 2019, 10:45:37 PM by edb »
......

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #53 on: January 09, 2019, 10:43:43 PM »
Is it possible to update Nextcloud directly from the GUI yet?

Current version is 13.0.1.
Update to Nextcloud 14.0.4 available. (channel: "stable")
Following file will be downloaded automatically: https://download.nextcloud.com/server/releases/nextcloud-14.0.4.zip
Start Update

If I click the Start Update will this work without issue or what is required?
Thanks

edb

what returns
Code: [Select]
rpm -qa |grep nextcloud
There are 2 known blockers depending on your current rpms : assets folder needing to be deleted, PHP 128Mo of memory or more and max execution time higher than default.

you will probably get an error as assets folder is existing during the update.
This could be fixed by

Code: [Select]
rm -rf  /usr/share/nextcloud/assets

then I suggest you to update smeserver-nextcloud to version 1.1.0-10 at least or better 1.1.0-11. This would solve the PHP needs.

Code: [Select]
yum update smeserver-nextcloud --enablerepo=smecontribs
signal-event nextcloud-update
config set UnsavedChanges no

then you should be able to upgrade at least up to 14.0.4 using webupdate.

It seems sometimes that there is a blocker from 14.0.4 to 15.0.0. Tell us when you are there.

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #54 on: January 09, 2019, 11:21:42 PM »
Hi Jean

I have already attempted to manually update as in the post above but here is the results of the commands:

Code: [Select]
[root@defcon1 nextcloud]# rpm -qa |grep nextcloud
smeserver-nextcloud-1.1.0-10.el6.sme.noarch
nextcloud-13.0.1-4.el6.sme.noarch
[root@defcon1 nextcloud]# yum update smeserver-nextcloud --enablerepo=smecontrib
s
Loaded plugins: fastestmirror, post-transaction-actions, smeserver
Setting up Update Process
Loading mirror speeds from cached hostfile
 * base: mirror.csclub.uwaterloo.ca
 * smeaddons: mirror.canada.pialasse.com
 * smecontribs: mirror.canada.pialasse.com
 * smeextras: mirror.canada.pialasse.com
 * smeos: mirror.canada.pialasse.com
 * smeupdates: mirror.canada.pialasse.com
 * updates: mirror.csclub.uwaterloo.ca
No Packages marked for Update
[root@defcon1 nextcloud]#

It doesn't see any update so nothing happens.

And with the new version 14 that I updated it has some setup errors that I don't know how to resolve easily.

......

Offline TerryF

  • grumpy old man
  • *
  • 1,821
  • +6/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #55 on: January 09, 2019, 11:40:12 PM »
Update is in /smetest at least is is just now, JP may have started the move to /smecontribs may take a while for all mirrors to sync that up

« Last Edit: January 09, 2019, 11:42:59 PM by TerryF »
--
qui scribit bis legit

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #56 on: January 09, 2019, 11:47:27 PM »
Update is in /smetest at least is is just now, JP may have started the move to /smecontribs may take a while for all mirrors to sync that up

Thanks Terry that did the trick for the updated contrib.
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #57 on: January 10, 2019, 12:12:48 AM »
I have updated manually as per Wiki from version is 13.0.1 to Nextcloud 14.0.4.  Now I have corrected most of the errors except these:

There are some errors regarding your setup.

   
Code: [Select]
Some files have not passed the integrity check. Further information on how to resolve this issue can be found in the documentation. (List of invalid files… / Rescan…)

    Your web server is not properly set up to resolve "/.well-known/caldav". Further information can be found in the documentation.
    Your web server is not properly set up to resolve "/.well-known/carddav". Further information can be found in the documentation.
    The database is missing some indexes. Due to the fact that adding indexes on big tables could take some time they were not added automatically. By running "occ db:add-missing-indices" those missing indexes could be added manually while the instance keeps running. Once the indexes are added queries to those tables are usually much faster.
        Missing index "parent_index" in table "oc_share".
        Missing index "fs_mtime" in table "oc_filecache".
    The "Referrer-Policy" HTTP header is not set to "no-referrer", "no-referrer-when-downgrade", "strict-origin", "strict-origin-when-cross-origin" or "same-origin". This can leak referer information. See the W3C Recommendation ↗.

Has anyone else seen this and how to fix?


Thanks

edb

I have attached an image of the Security & setup warnings I am getting after upgrading to version 14.
The list of invalid files is huge?
What to do?
......

Offline Jean-Philippe Pialasse

  • *
  • 2,747
  • +11/-0
  • aka Unnilennium
    • http://smeserver.pialasse.com
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #58 on: January 10, 2019, 06:16:06 AM »
edb,
please open a bug and attach the list of files in it.
also paste the main list of error.

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #59 on: January 11, 2019, 04:39:50 AM »
Okay, I upgraded via the Web GUI from 14.0.4 to 14.0.5 and that seems to have cleared up the errors with the invalid files now. But there remains a few errors regarding caldav and carddav and "The database is missing some indexes."

It works fine but just don't know how to resolve those scan issues.
This is under Settings - Overview then it initiates a setup and security scan.
Maybe the error can just be ignored?

Not sure a bug report is necessary yet.
......

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #60 on: January 11, 2019, 05:18:25 AM »
I've ignored the caldav and carddav warnings. You can use the url's in the relevant page within nextcloud user pages. In the panel on the left hand side of each relevant page, ie calendar url is on the calendar  page, etc.

The database errors can be resolved from the command line. In the wiki entry for nextcloud on contribs.org there is instructions for setting maintenance mode, using those as a guide, substitute the commands for the database index rebuild. Info is on the link on the warning page to the nextcloud website with the commands or it's on the warning page (I frget which) but it's pretty easy to find.
...

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #61 on: January 11, 2019, 05:31:03 AM »
I've ignored the caldav and carddav warnings. You can use the url's in the relevant page within nextcloud user pages. In the panel on the left hand side of each relevant page, ie calendar url is on the calendar  page, etc.

The database errors can be resolved from the command line. In the wiki entry for nextcloud on contribs.org there is instructions for setting maintenance mode, using those as a guide, substitute the commands for the database index rebuild. Info is on the link on the warning page to the nextcloud website with the commands or it's on the warning page (I frget which) but it's pretty easy to find.

Excellent ... thank you and I will give that a try!
......

Offline edb

  • *
  • 546
  • +0/-0
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #62 on: January 11, 2019, 05:50:41 AM »
Thanks to your info I was able to resolve the database error.
Code: [Select]
[root@defcon1 ~]# su www -s /bin/bash
bash-4.1$ cd /usr/share/nextcloud/
bash-4.1$ scl enable php71 'php occ db:add-missing-indices'
The current PHP memory limit is below the recommended value of 512MB.
Check indices of the share table.
Adding additional parent index to the share table, this can take some time...
Share table updated successfully.
Adding additional mtime index to the filecache table, this can take some time..
Filecache table updated successfully.
Code: [Select]
bash-4.1$exit
All good now. Thanks again!
......

Offline sages

  • *
  • 182
  • +0/-0
    • http://www.sages.com.au
Re: Not an April fool : smeserver-nextcloud available for you on SME9!!
« Reply #63 on: January 11, 2019, 05:59:19 AM »
No problem.
I usually find that 'google', searching the forum, the contribs wiki and the error/warning messages lead me to a solution.
...