Koozali.org: home of the SME Server

affa makes no hardlinks

Offline adlaw

  • 13
  • +0/-0
Re: affa makes no hardlinks
« Reply #15 on: July 30, 2013, 09:20:24 AM »
Hi,

freenas is NOT linux and so you may likely have different versions/implementation of NFS with different startup parameters..
Sure ! But probably, there is a way to do the same things on two POSIX systems... More especially hard links certainly work on NFS/Linux, as well as on LINUX and NFS/BSD...

in any case I would say that the issue is not with SME.. it works with FreeNAS..

you should search on mint/ubuntu side
It's true. I was just asking here because I know that some people are backuping their SME on a linux station, and was hoping they could help me, even if the issue is certainly not affa or SME.

Thanks for your help anyway  :-)

Offline Gary Douglas

  • *
  • 68
  • +1/-0
Re: affa makes no hardlinks
« Reply #16 on: January 13, 2016, 04:21:20 PM »
Using the same NFS storage server, when moving from AFFA ver2 on SME8 to AFFA ver3 on SME9, the archives began using the full GB per archive.
Backup jobs would complete in the usual time, but storage was diminishing quickly.
When mounting the NFS share, SME9 server defaulted to nfsvers=4, whereas SME8 was using NFSVER 3.
I mounted the NFS server from SME9 using nfsvers=3, which has solved the issue.

# vim /etc/fstab
192.168.100.2:/affa  /affa  nfs   rsize=32768,wsize=32768,nfsvers=3,timeo=600,intr,soft,bg  0 0

I have now migrated from SME8 / AFFAv2  to SME9 / AFFAv3, and retained all previous archives.
Using du -sh * from the SME9 (or SME8) shows the correct byte count per archive, confirming hardlinks are working.

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: affa makes no hardlinks
« Reply #17 on: January 13, 2016, 04:35:43 PM »
Using the same NFS storage server, when moving from AFFA ver2 on SME8 to AFFA ver3 on SME9, the archives began using the full GB per archive.
Backup jobs would complete in the usual time, but storage was diminishing quickly.
When mounting the NFS share, SME9 server defaulted to nfsvers=4, whereas SME8 was using NFSVER 3.
I mounted the NFS server from SME9 using nfsvers=3, which has solved the issue.

# vim /etc/fstab
192.168.100.2:/affa  /affa  nfs   rsize=32768,wsize=32768,nfsvers=3,timeo=600,intr,soft,bg  0 0

I have now migrated from SME8 / AFFAv2  to SME9 / AFFAv3, and retained all previous archives.
Using du -sh * from the SME9 (or SME8) shows the correct byte count per archive, confirming hardlinks are working.

Can that go in the Wiki, or possibly a a bug against the affa contrib ?
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

Offline Stefano

  • *
  • 10,836
  • +2/-0
Re: affa makes no hardlinks
« Reply #18 on: January 13, 2016, 05:31:45 PM »
Can that go in the Wiki, or possibly a a bug against the affa contrib ?

in bugzilla, definitely.. it's a bug (unexpected behaviour) IMO

@gary: could you please open it? thank you

Offline CharlieBrady

  • *
  • 6,918
  • +3/-0
Re: affa makes no hardlinks
« Reply #19 on: January 14, 2016, 01:32:14 AM »
When mounting the NFS share, SME9 server defaulted to nfsvers=4, whereas SME8 was using NFSVER 3.
I mounted the NFS server from SME9 using nfsvers=3, which has solved the issue.

So it seems that you have found an NFS4 implementation issue in Linux Mint.

Offline Stefano

  • *
  • 10,836
  • +2/-0
Re: affa makes no hardlinks
« Reply #20 on: January 14, 2016, 10:30:36 AM »
Charlie, there's no evidence that Gary Douglas is storing his data on a mint nfs storage, AFAICT

in any case, he said:

Quote
Using the same NFS storage server, when moving from AFFA ver2 on SME8 to AFFA ver3 on SME9, the archives began using the full GB per archive.

that means, IIUC, that affa3 changed its behaviour, giving unexpected results

Offline janet

  • ****
  • 4,812
  • +0/-0
Re: affa makes no hardlinks
« Reply #21 on: January 14, 2016, 12:26:42 PM »
Stefano

Quote
Charlie, there's no evidence that Gary Douglas is storing his data on a mint nfs storage....

I would say that Charlie got confused with the OP adlaw, who was using Linux Mint
Please search before asking, an answer may already exist.
The Search & other links to useful information are at top of Forum.

Offline Gary Douglas

  • *
  • 68
  • +1/-0
Re: affa makes no hardlinks
« Reply #22 on: January 14, 2016, 12:34:07 PM »
Stefano, I filed a bug with the following detail, per your request, but it is not a bug.
This thread seemed to have gone unanswered, thought this may help others using AFFA to NFS storage.
I have completed my cutover today, final gotcha was excluding directories with spaces. Seems it requires a *  instead of a space.

i.e;  Exclude=/home/e-smith/files/users/rob/home/My*Documents/My*Music

-------------------------------------------------------------------------------------------
Bug 9186

Changing from SME8 AFFAv2 to SME9 AFFAv3 using the same NFS storage and taking over the AFFAv2 archives, caused all new archives to become the full archive size. i.e. hardlinks were not working.

I have run AFFAv2 on SME7/8 to NFS shared storage for many years without issues, originally from a SME7/8 server to FreeNAS. Since a few years ago my NFS Server is now a Proxmox/Debian with additional HP410/RAID5 storage shared using debian nfs-kernel-server. SME8/AFFAv2 and SME9/AFFAv3 are virtual on another proxmox box.

By default SME8 attaches to the NFS share using nfsvers=3 and hardlinks have never been a problem. SME9 by default connects to the same NFS share using nfsvers=4. The issue of hardlinks failing appears to be when using nfsvers=4. By setting SME9 to use nfsvers=3, hardlinks are maintained on the AFFA archives.

There is no bug with SME or AFFA (nor using NFS if configured correctly), bug only raised on request of Stefano.

Offline janet

  • ****
  • 4,812
  • +0/-0
Re: affa makes no hardlinks
« Reply #23 on: January 14, 2016, 01:19:26 PM »
Gary Douglas

I think this would have worked

Exclude="/home/e-smith/files/users/rob/home/My Documents/My Music"

(or with single inverted commas)

Exclude='/home/e-smith/files/users/rob/home/My Documents/My Music'
Please search before asking, an answer may already exist.
The Search & other links to useful information are at top of Forum.

Offline Stefano

  • *
  • 10,836
  • +2/-0
Re: affa makes no hardlinks
« Reply #24 on: January 14, 2016, 03:29:22 PM »
Stefano, I filed a bug with the following detail, per your request, but it is not a bug.
-------------------------------------------------------------------------------------------
Bug 9186

Changing from SME8 AFFAv2 to SME9 AFFAv3 using the same NFS storage and taking over the AFFAv2 archives, caused all new archives to become the full archive size. i.e. hardlinks were not working.

I have run AFFAv2 on SME7/8 to NFS shared storage for many years without issues, originally from a SME7/8 server to FreeNAS. Since a few years ago my NFS Server is now a Proxmox/Debian with additional HP410/RAID5 storage shared using debian nfs-kernel-server. SME8/AFFAv2 and SME9/AFFAv3 are virtual on another proxmox box.

By default SME8 attaches to the NFS share using nfsvers=3 and hardlinks have never been a problem. SME9 by default connects to the same NFS share using nfsvers=4. The issue of hardlinks failing appears to be when using nfsvers=4. By setting SME9 to use nfsvers=3, hardlinks are maintained on the AFFA archives.

There is no bug with SME or AFFA (nor using NFS if configured correctly), bug only raised on request of Stefano.

one of the main feature of Affa is the use of hardlinks.. maybe is not a "real" bug but just a documentation one
anyway,  since the main rule here is "if something doesn't work as expected out of the box is likely a bug", a bug in bugzilla is needed

than you for your time

Offline Gary Douglas

  • *
  • 68
  • +1/-0
Re: affa makes no hardlinks
« Reply #25 on: January 14, 2016, 04:05:58 PM »
Janet, I have tried

Exclude="/home/e-smith/files/users/rob/home/My Documents/My Music"
  and
Exclude='/home/e-smith/files/users/rob/home/My Documents/My Music'

  but both started fetching files + folders from /My Music

AFFAv2 worked with DB command, and stored Exclusions correctly if you said;  db affa setprop htsvr Exclude[0] /home/e-smith/files/users/rob/home/"My Documents"/"My Music"
 
  but that fails also on my AFFAv3.

I can confirm Exclude=/home/e-smith/files/users/rob/home/My*Documents/My*Music  works for Excluding folders with spaces


guest22

Re: affa makes no hardlinks
« Reply #26 on: January 14, 2016, 06:02:54 PM »
spaces in paths are never a good thing....

Offline ReetP

  • *
  • 3,722
  • +5/-0
Re: affa makes no hardlinks
« Reply #27 on: January 14, 2016, 06:46:21 PM »
spaces in paths are never a good thing....

So sayeth The Oracle  :lol: :lol:

Beers are on you mate.... FOSDEM here we come !
...
1. Read the Manual
2. Read the Wiki
3. Don't ask for support on Unsupported versions of software
4. I have a job, wife, and kids and do this in my spare time. If you want something fixed, please help.

Bugs are easier than you think: http://wiki.contribs.org/Bugzilla_Help

If you love SME and don't want to lose it, join in: http://wiki.contribs.org/Koozali_Foundation

guest22

Re: affa makes no hardlinks
« Reply #28 on: January 14, 2016, 11:04:40 PM »
AFFAv2 worked with DB command, and stored Exclusions correctly if you said;  db affa setprop htsvr Exclude[0] /home/e-smith/files/users/rob/home/"My Documents"/"My Music"
 
  but that fails also on my AFFAv3.

I can confirm Exclude=/home/e-smith/files/users/rob/home/My*Documents/My*Music  works for Excluding folders with spaces


Have you filed a bug so the AFFA developers can take a look?