wget - ..."since it should be rejected"

[imranka]

Hi,

Today I'm trying wget for the first time. So as a test I was trying to download the mpgs from nationalgeographic site like this:

$ wget -r -nc -P ~/Download/wgetted/ -A.jpg http :// photography.nationalgeographic.com/photography/photo-of-the-day --progress=dot --wait=10

Now its coming like this-

19:41:34 (54.50 KB/s) - `/home/imran/Download/wgetted/photography.nationalgeographic.com/photography/photo-of-the-day' saved [39788/39788]

Removing /home/imran/Download/wgetted/photography.nationalgeographic.com/photography/photo-of-the-day since it should be rejected.

And so on and on and on.....

Question: Why it seems its downloading the jpgs and then removing? Why it "should be rejected"?

[smolloy]

Try

wget -A.jpg -r -nc -P ~/Download/wgetted/ -A.jpg http://photography.nationalgeographic.com/photography/photo-of-the-day --progress=dot --wait=10

(I just added -A.jpg to the options list.)

[smolloy]

Update: I think the reason this is being rejected is that it's not actually a jpeg. You're trying to wget the whole page -- html, jpegs, everything!

When I use the command I gave in my last post, I get a couple of jpegs in Downloads/wgetted, for example

photography.nationalgeographic.com/staticfiles/NGS/Shared/StaticFiles/Photography/Images/POD/f/french-quarter-sacha-657502-ga.jpg

Notice that it doesn't keep the files in Downloads/wgetted, but rather in directories much lower down.

[imranka]

Nope. Its the same thing. Like this-

21:17:13 (68.39 KB/s) - `/home/imran/Download/wgetted/photography.nationalgeographic.com/photography/pod-email/french-quarter-sacha.html' saved [37821/37821]

Removing /home/imran/Download/wgetted/photography.nationalgeographic.com/photography/pod-email/french-quarter-sacha.html since it should be rejected.

And anyway, there is the option "-A.jpg" already in what I've tried. So, why give it twice?

[imranka]

Oh yes, I got that image also, and only that image.

Well, my original intention was to get the full size image of the current date, but the url will be changing every day, like

http://photography.nationalgeographi...raphy/enlarge/french-quarter-sacha_pod_image.html

and giving till

http://photography.nationalgeographi...raphy/enlarge/

will give 404 error. So how to do that?

[imranka]

Oh yes, I got that image also, and only that image. Sorry, I forgot to mention that.

Well, my original intention was to get the full size image of the current date, but the url will be changing every day, like

http://photography.nationalgeographi...raphy/enlarge/french-quarter-sacha_pod_image.html

and giving till

http://photography.nationalgeographi...raphy/enlarge/

will give 404 error. So how to do that?

And also, can I escape those many subdirectories? I want the jpgs straight in wgetted directory. Is that possible?

[smolloy]

And anyway, there is the option "-A.jpg" already in what I've tried. So, why give it twice?

Sorry about that!! I didn't notice.

Anyway, notice that it's rejecting an html file, not a jpg. The jpg's are being kept.

cd Download/wgetted
find ./ | grep jpg

That will provide you a list of any jpg files in the wgetted folder.