Results 1 to 3 of 3
After googling around for hours I believe the problem with some of my tar files showing a 403 FORBIDDEN message while attempting to use WGET is because of the large ...
- 06-07-2009 #1Just Joined!
- Join Date
- Jun 2009
- Posts
- 3
[SOLVED] wget large tar files says 403 forbidden
After googling around for hours I believe the problem with some of my tar files showing a 403 FORBIDDEN message while attempting to use WGET is because of the large file size.
I have 100GB of data to transfer as someone purchased my 3 year old social network site.
I've decided to tar each directory individually and am left with about 4 directories that are approximately between 9GB and 40GB each.
Is there a way to span tar files so that I can create a tar file but have them split into multiple files <2GB in case the size is the problem?
OR is there a different method to use to get these large archives moved over quickly?
I read I can usebut I haven't tried because I also read that it is ridiculously slow to use FTP.Code:wget ftp://domain.com/file.tar
One last question. Since I only have about 40GB free on the drive my site uses, I was going to put the TAR files into a different drive on the server and pull them off using WGET but I can't seem to get it to work trying to get any files other than those that are in my website's root directory. There seems to be no way to do like this wget 123.123.123.123/disk1/migration/file.tar... If I can't figure it out I'll just do one at a time and delete the previous one prior to making a new TAR file to avoid running out of space. So the question remains, is there a relatively quick way to transfer large TAR files from server to server? WGET seems to produce a 403 forbidden but only on larger TAR files.
I'm a newb, can someone shine some light please?
Thanks,
Chris
- 06-07-2009 #2Linux User
- Join Date
- May 2009
- Location
- Big River, Sask, Canada
- Posts
- 342
I do know that you can break up a large file with tar, but it was so long ago that I read it, that I don't remember how it's done, Linux Command Directory - O'Reilly Media may have some information if you check the tar command.
The Linux Cookbook: Tips and Techniques for Everyday Use - Table of Contents is another possibility.Registered Linux User #420832
- 06-07-2009 #3Just Joined!
- Join Date
- Jun 2009
- Posts
- 3
It looks like it's not possible to WGET a file >2GB
I used SCP and it seems to be working faster than I thought it would. Not as fast as WGET but what am I to do.


