LoserDude27, you do have to enter either the ip addresses of your isp into the DNS server fields e.g. XXX.XXX.XXX.XXX. If you have setup your dns servers on your router already, just enter the ip address of your router into the 1st DNS entry and the router should forward the dns request from your computer to the isp's dns servers.
Thanks, Alex! Great info. I'll go try that to see if it helps.