Copy with SCP - low performance

Rick Stevens rstevens at vitalstream.com
Mon Mar 29 23:19:11 UTC 2004


Brian Chase wrote:
> Try google search on "rsync over ssh".  I think that will be more 
> efficient for what you're trying to do.

Amen, brother.  rsync is the way to go if that sort of thing will be
done fairly frequently.  rsync over ssh if you want it secure.

> Horacio Reyes wrote:
> 
>> Hi,
>>
>> I am using scp to copy large amount of small files between 2 servers
>> with a firewall in the middle, but the copy takes all CPU, this is the
>> situation:
>>
>> - The files are copied in batch of 100 tif images, in a directory with
>> more than 5 million files.
>> - the server that initiate the scp is a 1.2Ghz P3 with 2G in ram, the
>> receiver is a double Xeon 2.6ghz with 2G in ram. The first server takes
>> no time to send the file, but the receiver takes more than 200segs to
>> copy. They are in a 100mb lan.
>> - the top comand shows 98% free cpu before the scp, when scp start it
>> takes 100% of the 2 xeon cpu. The problem is not the ram, both servers
>> have more than 1G free when scp starts.
>>
>> I tried with all the SCP flags (-q, -c blowfish, etc), and nothing
>> works....
>>
>> Regards,
>> Horacio Reyes Rios
>> Eng. Director.
>>
>>
>>
>>
>> ************************************************************************** 
>>
>> Nota: La informacion transmitida a traves de este correo electronico 
>> es confidencial y esta dirigida unicamente a su destinatario. Su 
>> reproduccion, lectura o uso esta prohibido a cualquier persona o 
>> entidad diferente. Aunque Computec S.A. ha realizado su mejor esfuerzo 
>> para asegurar que el presente mensaje y sus archivos anexos se 
>> encuentran libre de virus y defectos que puedan llegar a afectar los 
>> computadores o sistemas que lo reciban, no se hace responsable por la 
>> eventual transmision de virus o programas daninos por este conducto, y 
>> por lo tanto es responsabilidad del destinatario confirmar la 
>> existencia de este tipo de elementos al momento de recibirlo y 
>> abrirlo. Ni Computec S.A. ni ninguna de sus divisiones o dependencias 
>> aceptan responsabilidad alguna por eventuales danos o alteraciones 
>> derivados de la recepcion o uso del presente mensaje.
>> ************************************************************************** 
>>
>> Note: The information transmitted through this E-mail is confidential 
>> and is intended to reach only its addressee. Reproduction and usage of 
>> this message or its contents, in whole or in part, are strictly 
>> forbidden without the prior written consent of Computec S.A. Computec 
>> S.A. has made its best efforts to ensure that this message and any 
>> attached files are free of any virus or other potentially harmful 
>> content, but makes no representations to this effect.  Addressee shall 
>> assume full responsibility for ensuring that opening or reading this 
>> message and any attachments will not result in harm to their system.  
>> Neither Computec nor any of its divisions accepts any responsibility 
>> for damages arising from opening or reading this message or any 
>> attachments thereto.
>> ************************************************************************** 
>>
>>
> 
> 
> 


-- 
----------------------------------------------------------------------
- Rick Stevens, Senior Systems Engineer     rstevens at vitalstream.com -
- VitalStream, Inc.                       http://www.vitalstream.com -
-                                                                    -
-              Careful!  Ugly strikes 9 out of 10 people!            -
----------------------------------------------------------------------





More information about the users mailing list