Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Thu 02 Oct 2014, 05:05
All times are UTC - 4
 Forum index » House Training » Users ( For the regulars )
Thumb drive slow if multiple file transfer?
Moderators: Flash, Ian, JohnMurga
Post_new_topic   Reply_to_topic View_previous_topic :: View_next_topic
Page 1 of 1 Posts_count  
Author Message
firak

Joined: 14 Apr 2008
Posts: 174

PostPosted: Sat 17 Nov 2012, 03:45    Post_subject:  Thumb drive slow if multiple file transfer?
Sub_title: Transferring simultaneously doe slow down?
 

About writing speed of usb sped drives.

I notice that the time increase exponentially when I run moare than one file transfer instance (rox) .
I did not measure exactly, but this is my impression.
I have a slow pen drive 4 MB/sec writing.

Writing on it 1G - it takes approx 5 min.
Transferring simultaneously 3 instance of 1G, it takes aprox 30 minutes.

It is better to transfer files one by one?
How can i do it, in one command, if files are form different folders?
There is any trick suggested for rox or tux commander?


(I run a atom based netbook with macpup528 )
Back to top
View user's profile Send_private_message 
8-bit


Joined: 03 Apr 2007
Posts: 3368
Location: Oregon

PostPosted: Sat 17 Nov 2012, 03:52    Post_subject:  

The file transfers are buffered.
When you do a copy, buffering of one file using available memory as you say takes a certain amount of time.
The buffering is done once at the beginning of the copy.
With more than one file, the buffering is not done again for additional files on a multiple file copy.
At least that is the way I understand it.
Also, when I copy a file, I also open a terminal and type "sync".
When the prompt "#" appears again, I know the file has been copied completely.
Back to top
View user's profile Send_private_message 
amigo

Joined: 02 Apr 2007
Posts: 2252

PostPosted: Sat 17 Nov 2012, 04:10    Post_subject:  

First of all, using ROX to copy/move files is *way* slower than the plain CLI commands -mostly because of having to update the progress bar and display the file and folder names. You can set ROX to ignore the file names and only print the dir names, which will speed things up a bit.

But, even from the CLI, multiple operations at once will slow things down a lot. The USB bus is really slow compared to IDE/SATA interfaces. And since each segment of the copy/move has to be confirmed which involves two-way communictaion over the USB bus. Doing multiple ops at once means these to/from signals have to be scheduled. Copying is faster than moving. So, even when I really want to move the items, I simply copy them and then remove the originals when done.
Back to top
View user's profile Send_private_message 
npierce

Joined: 28 Dec 2009
Posts: 858

PostPosted: Sat 17 Nov 2012, 09:31    Post_subject:  

firak wrote:
How can i do it, in one command, if files are form different folders?

Just use semicolons.
Code:
cp /tmp/alpha/file1 /tmp/xray/ ; cp /tmp/bravo/file2 /tmp/yankee/ ; cp /tmp/charlie/file3 /tmp/zulu/

(Note: if your browser window is narrow, that may look like multiple lines, but it is only one.)
Back to top
View user's profile Send_private_message 
firak

Joined: 14 Apr 2008
Posts: 174

PostPosted: Sat 17 Nov 2012, 15:24    Post_subject:  

Yes!
My problem is confirmed by you ( amigo, 8bit , nepierce).
I test by manual command and is faster. I test it!
Im not used to the command console,
but is ok.
I open console in a source folder
cp sourecefile(tabcanhelp) space /mnt/sdc1 ; sourecefile2(tabcanhelp) space /mnt/sdc1 ; sourecefile3(tabcanhelp) space /mnt/sdc1

for copying entere folders:
Code:
cp -r sourecefolder(tabcanhelp) space /mnt/sdc1


So is better to use console for big transferring.Thaks
Back to top
View user's profile Send_private_message 
Flash
Official Dog Handler


Joined: 04 May 2005
Posts: 11083
Location: Arizona USA

PostPosted: Sat 17 Nov 2012, 23:34    Post_subject:  

I used
Code:
cp -r -v

to copy a directory containing about 180 files totaling over 250 MB to a mp3 player (from a USB flash drive.) The transfer went very fast compared to ROX, and all the files seemed to get copied, but not in their numerical order. Using the cp command, the files were copied beginning with file number 3. The rest of the files were copied in numerical order, then files number 1 and 2 were added at the end.

The reason this is bad for me is that every mp3 player I've used plays the files in a directory in the order they were copied to the mp3 player, not in the numerical order of the filenames.

I developed a workaround to force ROX to copy the files in a directory in the numerical order of the files, but it requires several steps and ROX is slow compared to cp. I've been looking for a better solution for years. Sad
Back to top
View user's profile Send_private_message 
Monsie


Joined: 01 Dec 2011
Posts: 633
Location: Kamloops BC Canada

PostPosted: Sun 18 Nov 2012, 16:35    Post_subject: Thumb drive slow if multiple file transfer?  

Flash wrote:
I used
Code:
cp -r -v

to copy a directory containing about 180 files totaling over 250 MB to a mp3 player (from a USB flash drive.) The transfer went very fast compared to ROX, and all the files seemed to get copied, but not in their numerical order. Using the cp command, the files were copied beginning with file number 3. The rest of the files were copied in numerical order, then files number 1 and 2 were added at the end.

The reason this is bad for me is that every mp3 player I've used plays the files in a directory in the order they were copied to the mp3 player, not in the numerical order of the filenames.

I developed a workaround to force ROX to copy the files in a directory in the numerical order of the files, but it requires several steps and ROX is slow compared to cp. I've been looking for a better solution for years. Sad


Flash, have a look at this post here at LinuxQuestions because I think it relates to your problem specifically and offers more than one possible solution.

Monsie

_________________
My username is pronounced: "mun-see". Derived from my surname, it was my nickname throughout high school.
Back to top
View user's profile Send_private_message 
Flash
Official Dog Handler


Joined: 04 May 2005
Posts: 11083
Location: Arizona USA

PostPosted: Sun 18 Nov 2012, 23:47    Post_subject:  

Thanks, it does look like this post could have the solution I'm looking for.
Ditto for this post about rsync, which Puppy also has.
So I tried
Code:
rsync -av Path/to/source/directory Path/to/destination/directory

If the -v result can be believed, it did exactly what I want, and very fast compared to ROX. The proof will be when I listen to the book.

I never knew you could string the options together (-av); I thought you had to keep them separate (-a -v). So I learned two new things tonight. Very Happy
Back to top
View user's profile Send_private_message 
Display_posts:   Sort by:   
Page 1 of 1 Posts_count  
Post_new_topic   Reply_to_topic View_previous_topic :: View_next_topic
 Forum index » House Training » Users ( For the regulars )
Jump to:  

Rules_post_cannot
Rules_reply_cannot
Rules_edit_cannot
Rules_delete_cannot
Rules_vote_cannot
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.0764s ][ Queries: 12 (0.0145s) ][ GZIP on ]