I'm using urllib2 to pull pages for a custom version of a web proxy
and am having issues with 404 errors. Urllib2 does a great job of
letting me know that a 404 happened with the following code.
import urllib2
url = 'http://cnn.com/asfsdafsadfasdf/'
try:
page = urllib2.urlopen ( url )
except urllib2.URLErro r, e:
print e
returns: HTTP Error 404: Not Found
However, upon finding the error I would like to load the domain's
custom 404 message instead of returning my own. I've checked the
error information and searched for some sort of web standard but
cannot find anything.
Does anyone know if it is possible to retrieve a url or the page
information for the custom 404 page like this?
and am having issues with 404 errors. Urllib2 does a great job of
letting me know that a 404 happened with the following code.
import urllib2
url = 'http://cnn.com/asfsdafsadfasdf/'
try:
page = urllib2.urlopen ( url )
except urllib2.URLErro r, e:
print e
returns: HTTP Error 404: Not Found
However, upon finding the error I would like to load the domain's
custom 404 message instead of returning my own. I've checked the
error information and searched for some sort of web standard but
cannot find anything.
Does anyone know if it is possible to retrieve a url or the page
information for the custom 404 page like this?
