I am trying to download some web pages and parse out the data. I use WebRequest in C#.
WebRequest wrGETURL;
wrGETURL = WebRequest.Crea te(url);
WebResponse response = null;
Stream readStream = null;
try
{
response = wrGETURL.GetRes ponse();
readStream = response.GetRes ponseStream();
StreamReader objReader = new StreamReader(re adStream, Encoding.UTF8);
WebResponse wr = wrGETURL.GetRes ponse();
Stream receiveStream = wr.GetResponseS tream();
StreamReader reader = new StreamReader(re ceiveStream, Encoding.UTF8);
string content = reader.ReadToEn d();
}
The problem is that the content variable does not have all the data that a ViewSource does from a browser. The is a large set of missing data that shows up as ... in the C# code.
So why am I missing some of the content.
WebRequest wrGETURL;
wrGETURL = WebRequest.Crea te(url);
WebResponse response = null;
Stream readStream = null;
try
{
response = wrGETURL.GetRes ponse();
readStream = response.GetRes ponseStream();
StreamReader objReader = new StreamReader(re adStream, Encoding.UTF8);
WebResponse wr = wrGETURL.GetRes ponse();
Stream receiveStream = wr.GetResponseS tream();
StreamReader reader = new StreamReader(re ceiveStream, Encoding.UTF8);
string content = reader.ReadToEn d();
}
The problem is that the content variable does not have all the data that a ViewSource does from a browser. The is a large set of missing data that shows up as ... in the C# code.
So why am I missing some of the content.