Re: NFSV4 readlink_stat

Dan The Man wrote:
> Just want to include some errors from rsync trying to copy files using
> NFSV4. These files copy fine using NFSV3....
> 
> 
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/A-E/A/Ace of
> Base/The Bridge/Ace of Base-My D\#351j\#340 Vu-09-The Bridge.wma")
> failed:
> Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/A-E/B/Bj\#366rn
> Skifs") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass
> Tunes/A-E/B/Bjork/Bj\#366rk - Dancer in the Dark - My Favorite
> Things.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass
> Tunes/A-E/B/Bjork/Bj\#366rk - Amphibian.mp3") failed: Invalid argument
> (22)
> IO error encountered -- skipping file deletion
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/A-E/C/Celine
> Dion/C\#351line Dion - I Drove All Night (Album Version).mp3") failed:
> Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/A-E/E/The
> Eagles/The
> Eagles Greatest Hits, Vol. 2/05 The Sad Caf\#351.wma") failed: Invalid
> argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/G/Georges
> Delerue/Georges Delerue - Le M\#351pris, Camille - Jean-Luc
> Godard.mp3")
> failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/O\#264 Riada Sa Gaiety") failed: Invalid
> argument
> (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Athen Rye/Athenrye - Amhr\#341n Na
> Bhfiann.mp3")
> failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Chieftans/Chieftains & Sin\#351ad O'Connor -
> Factory girl.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Chieftans/The Chieftains & Sin\#351ad O'Connor
> -
> The Foggy Dew.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Christy Moore/Christy Moore - Compa\#361eros -
> 06.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Clancy Brothers/Clancy Brothers & Tommy Makem
> - 12
> - Cru\#354sc\#354n L\#340n.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Loreena McKennitt/Loreena McKennitt - The Mask
> and
> Mirror - 07. C\#351 H\#351 Mise Le Ulaingt - The Two Trees.mp3")
> failed:
> Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Planxty/Planxty - Raggletaggle Gypsy; Tabhair
> Dom
> Do L\#343mh - 01.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Planxty/Planxty - The Rambling Si\#372ler -
> 05.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Quilty/Quilty - Mist Covered Mountain
> Siobh\#341n
> O\#264donnels - Jig Reel.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Quilty/Quilty - I\#264m Here Because I\#264m
> Here.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Seamus Kennedy/Seamus Kennedy - Or\#363!
> S\#351 Do
> Bheatha 'Bhaile & The Rights Of Man (Instrumental).mp3") failed:
> Invalid
> argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Seamus Kennedy/Seamus Kennedy - The
> Bodhr\#341n
> (Comedy).mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Sinead O'Connor/Sinead O'Connor - The Black
> Album
> ( 8 CD Set )/Cd 2/06_Mna Na H\#351ireann.mp3") failed: Invalid
> argument
> (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Sinead O'Connor/Sinead O'Connor - The Black
> Album
> ( 8 CD Set )/Cd 3/07_Rois\#355n Dubh.mp3") failed: Invalid argument
> (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/Wolfe Tones/2006 As Gaeilge/Wolfe Tones -
> T\#341
> Na L\#341.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/aaa - Too Few, but Identified/Irish C\#351ili
> Band
> - The Black Velvet Band.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/aaa - Too Few, but Identified/Young Dubliners
> -
> The Bodhr\#341n.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/aaa - Too Few, but Identified/Jeff Johnson &
> Brian
> Dunning - C\#371Chulainn's Last Battle.mp3") failed: Invalid argument
> (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/aaa - Too Few, but Identified/Phil Coulter &
> Sin\#351ad O'Connor - The Shores Of The Swilly.mp3") failed: Invalid
> argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/aaa - Too Few, but Identified/M\#341ire
> Brennan -
> Eirigh Suas A Stoirin.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/aaa - Too Few, but Identified/Sin\#351ad
> O-connor
> - Factory Girl.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/history of ireland in song/53.Amhr\#341n na
> Bhfiann.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/history of ireland in song/46.Se\#341n South
> from
> Garryowen.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/history of ireland in song/32.Se\#341n
> Treacy.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/history of ireland in song/02.Rois\#355n
> Dubh.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/history of ireland in song/03.Se\#341n \#323
> Duibhir A'Ghleanna.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/F-J/I/Irish
> Scottish
> Celtic Music Collection/history of ireland in song/03.Se\#341n \#323
> Duibhir A'Ghleanna (O'Dwyer of the Glen).mp3") failed: Invalid
> argument
> (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/K-O/M/M\#366tley
> Cr\#374e") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Sort Me
> Music/New
> Folder(20)/Ivan Rebroff - Moskauer n\#344chte (rus).mp3") failed:
> Invalid
> argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Bj\#366rn Skifs - H\#344rligt,
> h\#344rligt
> men farligt, farligt.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Bj\#366rk - Visur Vatnsenda Rosu.mp3")
> failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/All Crap Tunes/F-L/La Mafia/Un Millon
> de
> Rosas/La Mafia-Yo Te Amar\#351-01-Un Millon de Rosas.wma") failed:
> Invalid
> argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/All Crap Tunes/F-L/La Mafia/Un Millon
> de
> Rosas/La Mafia-Qui\#351n-04-Un Millon de Rosas.wma") failed: Invalid
> argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/All Crap Tunes/F-L/La Mafia/Un Millon
> de
> Rosas/La Mafia-C\#363mo Pude Estar Tan Ciego-10-Un Millon de
> Rosas.wma")
> failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/All Crap Tunes/M-P/Moxy Fruvous/Moxy
> Fr\#374vous - Spiderman.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/All Crap Tunes/Old
> School/Santana/Supernatural/Corazon Espinado Man\#341; Santana
> Supernatural 09.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Dance/Bran Van 3000/Discosis/16 Love
> Clich\#351.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Dance/Bran Van 3000/Discosis/03
> Montr\#351al.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Generation Swine.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Driftaway.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Uncle Jack.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Get It For Free.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - I Wanna Be Sedated.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Live Wire [Kick Ass '91 Remix].wma") failed: Invalid
> argument
> (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Black Widow.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Rock 'N' Roll Junkie.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely
> Crue/Motley\#240Crue -
> Loveshine.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Dragstrip Superstar.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Hammered - 07.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Poison Apples.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Afraid.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Kiss the Sky.wma") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Heavy Metal/Motely Crue/M\#366tley
> Cr\#374e - Glitter - Generation Swine - 07.wma") failed: Invalid
> argument
> (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Original Soundtrack/Various
> Artists/Various Artists/Pure Dance 1998/U2 Discoth\#350que [DM Radio
> Mix]
> 07 Pure Dance 1998 Rock.mp3") failed: Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Original Soundtrack/Various
> Artists/Various Artists/Pure Dance 1998/Tony! Toni! Ton\#351! Let's
> Get
> Down [Fitch Bros. Club Radio Edit] 06 Pure Dance 1998 Rock.mp3")
> failed:
> Invalid argument (22)
> rsync: readlink_stat("/asterisk/public/mp3/Kass Tunes/Z Too Small to
> Seperate/Z Favorite WMA - Songs/Rock n
> Roll/Q-S/Q/Queensryche/Queensr\#377che - Best I Can - 01.wma") failed:
> Invalid argument (22)
> 
Well, the most obvious reason for EINVAL being returned for a Readlink
reply is that the server doesn't think the vnode type is VLNK.

Two things you could do:
1 - Try the attached patch for the client. It doesn't really fix the
    problem, but it takes out the Getattr that preceeds the Readlink
    for the NFSv4 RPC. If it is this Getattr that is failing, it could
    make the problem "disappear".

2 - Look at a packet trace in wireshark and see if the reply to Readlink
    is returning EINVAL. (That will isolate the problem to the server vs client.)
    I don't mind looking at a packet trace, but it would be nice if you
    could get a fairly small one. (Can you reproduce it with a small rsync?)

If you do either of the above, please let me know how it goes, rick

> 
> 
> Dan.
> 
> 
> 
> --
> Dan The Man
> CTO/ Senior System Administrator
> Websites, Domains and Everything else
> http://www.SunSaturn.com
> Email: Dan_at_SunSaturn.com
>