NFS Buffering

Samuel Kidman samkidman at gmail.com
Wed Sep 29 01:26:17 UTC 2010


On Tue, Sep 28, 2010 at 10:07 PM, Simon Andrews
<simon.andrews at bbsrc.ac.uk>wrote:

> I have a fedora 13 box on which I have a remote mounted nfs share over a
> fairly slow (10Mb/s) link.  I'm then transferring data onto this share
> from a different machine using scp.
>
> The problem is that after scp reports that it's 100% complete the
> program will hang for ~20 mins before it will move on to another file.
> At this point it can't be killed.
>
> It looks like the nfs daemon is caching write data (around 2GB of it)
> which lets scp think its finished when actually there's loads of data
> sitting in a write buffer.  The hanging is presumably the time it takes
> to flush the buffer (there is a process called nfsiod which is active
> during this time and df shows data is still being written).
>
> Does anyone know how to either make this buffer smaller, or get rid of
> it all together so the scp can accruately report on its progress?
>
> Thanks
>
> Simon.
>
> --
> users mailing list
> users at lists.fedoraproject.org
> To unsubscribe or change subscription options:
> https://admin.fedoraproject.org/mailman/listinfo/users
> Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
>

This Article <http://nfs.sourceforge.net/nfs-howto/ar01s05.html> contains
information on how to adjust the buffer size of NFS and optimise file
transfers. Also scp has a -C option to enable compression.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.fedoraproject.org/pipermail/users/attachments/20100929/2f9baf99/attachment.html 


More information about the users mailing list