Find the answer to your Linux question:
Results 1 to 3 of 3
After googling around for hours I believe the problem with some of my tar files showing a 403 FORBIDDEN message while attempting to use WGET is because of the large ...
  1. #1
    Just Joined!
    Join Date
    Jun 2009
    Posts
    3

    [SOLVED] wget large tar files says 403 forbidden

    After googling around for hours I believe the problem with some of my tar files showing a 403 FORBIDDEN message while attempting to use WGET is because of the large file size.

    I have 100GB of data to transfer as someone purchased my 3 year old social network site.

    I've decided to tar each directory individually and am left with about 4 directories that are approximately between 9GB and 40GB each.

    Is there a way to span tar files so that I can create a tar file but have them split into multiple files <2GB in case the size is the problem?

    OR is there a different method to use to get these large archives moved over quickly?

    I read I can use
    Code:
    wget ftp://domain.com/file.tar
    but I haven't tried because I also read that it is ridiculously slow to use FTP.

    One last question. Since I only have about 40GB free on the drive my site uses, I was going to put the TAR files into a different drive on the server and pull them off using WGET but I can't seem to get it to work trying to get any files other than those that are in my website's root directory. There seems to be no way to do like this wget 123.123.123.123/disk1/migration/file.tar... If I can't figure it out I'll just do one at a time and delete the previous one prior to making a new TAR file to avoid running out of space. So the question remains, is there a relatively quick way to transfer large TAR files from server to server? WGET seems to produce a 403 forbidden but only on larger TAR files.

    I'm a newb, can someone shine some light please?

    Thanks,

    Chris

  2. #2
    Linux User
    Join Date
    May 2009
    Location
    Big River, Sask, Canada
    Posts
    342
    I do know that you can break up a large file with tar, but it was so long ago that I read it, that I don't remember how it's done, Linux Command Directory - O'Reilly Media may have some information if you check the tar command.
    The Linux Cookbook: Tips and Techniques for Everyday Use - Table of Contents is another possibility.
    Registered Linux User #420832

  3. #3
    Just Joined!
    Join Date
    Jun 2009
    Posts
    3
    It looks like it's not possible to WGET a file >2GB

    I used SCP and it seems to be working faster than I thought it would. Not as fast as WGET but what am I to do.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
...