HTML links

[Aristotelis Pitaridis]

I am trying to extract all the links and the image URLs from an HTML file. I
tried to read byte - byte the information in order to detect the URLs but it
did not work because some JavaScript or other information in the HTML file
caused problems. Is there any class which works ok with this kind of data
extraction?



Aristotelis

[Jared Parsons [MSFT]]

Re: HTML links

Hello Aristotelis,

I am trying to extract all the links and the image URLs from an HTML
file. I tried to read byte - byte the information in order to detect
the URLs but it did not work because some JavaScript or other
information in the HTML file caused problems. Is there any class which
works ok with this kind of data extraction?

You could load the page into System.Windows. Forms.HtmlDocum ent. It has a
GetElementsByTa gName method that you can use to get all of the links.

--
Jared Parsons [MSFT]
jaredpar@online .microsoft.com
All opinions are my own. All content is provided "AS IS" with no warranties,
and confers no rights.

[Aristotelis Pitaridis]

Re: HTML links

I tried it but the System.Windows. Forms.HtmlDocum ent object does not have a
constructor. How can I set the URL of the page in order to collect the
various information?



Aristotelis



? "Jared Parsons [MSFT]" <jaredpar@onlin e.microsoft.com ?????? ??? ??????
news:61f143b3fc 88c86c94c088c47 e@msnews.micros oft.com...

>
Hello Aristotelis,
>

>I am trying to extract all the links and the image URLs from an HTML
>file. I tried to read byte - byte the information in order to detect
>the URLs but it did not work because some JavaScript or other
>information in the HTML file caused problems. Is there any class which
>works ok with this kind of data extraction?

>
You could load the page into System.Windows. Forms.HtmlDocum ent. It has a
GetElementsByTa gName method that you can use to get all of the links.
>
--
Jared Parsons [MSFT]
jaredpar@online .microsoft.com
All opinions are my own. All content is provided "AS IS" with no
warranties, and confers no rights.
>
>

[Jared Parsons [MSFT]]

Re: HTML links

Hello Aristotelis,

I tried it but the System.Windows. Forms.HtmlDocum ent object does not
have a constructor. How can I set the URL of the page in order to
collect the various information?

It looks like you'll have to create an instance of the WebBrowser control.
That will give you access to the underlying HtmlDocument which you can then
query.

--
Jared Parsons [MSFT]
jaredpar@online .microsoft.com
All opinions are my own. All content is provided "AS IS" with no warranties,
and confers no rights.

[Cor Ligthert [MVP]]

Re: HTML links

Aristotolis,

They (we and others) use those JavaScript to prevent things as spamming,
including me. You want that we give you a method to overcome that and put
that on this board. Even if I did know it than was the answer. No way.

:-)

Cor

"Aristoteli s Pitaridis" <pitaridis@hotm ail.comschreef in bericht
news:1151923589 .806196@athnrd0 2...

>I am trying to extract all the links and the image URLs from an HTML file.
>I tried to read byte - byte the information in order to detect the URLs but
>it did not work because some JavaScript or other information in the HTML
>file caused problems. Is there any class which works ok with this kind of
>data extraction?
>
>
>
Aristotelis
>
>

[Aristotelis Pitaridis]

Re: HTML links

I think that there will be a problem with the javascripts. If I load a page
which contains a Javascript Alert message box, this will have as a result to
stop the whole prosess, and the user will see this window on the screen. Is
there a way to disable the javascript execution for a WebBrowser control?

Aristotelis

? "Jared Parsons [MSFT]" <jaredpar@onlin e.microsoft.com ?????? ??? ??????
news:61f143b414 48c86cb9fc878fa e@msnews.micros oft.com...

>
Hello Aristotelis,
>

>I tried it but the System.Windows. Forms.HtmlDocum ent object does not
>have a constructor. How can I set the URL of the page in order to
>collect the various information?

>
It looks like you'll have to create an instance of the WebBrowser control.
That will give you access to the underlying HtmlDocument which you can
then query.
--
Jared Parsons [MSFT]
jaredpar@online .microsoft.com
All opinions are my own. All content is provided "AS IS" with no
warranties, and confers no rights.
>
>

[intolerance@gmail.com]

Re: HTML links

http://www.regular-expressions.net/examples.html

This has a great tutorial about grabbing html tags.

-Allen

[Herfried K. Wagner [MVP]]

Re: HTML links

"Aristoteli s Pitaridis" <pitaridis@hotm ail.comschrieb:

>I am trying to extract all the links and the image URLs from an HTML file.
>I tried to read byte - byte the information in order to detect the URLs but
>it did not work because some JavaScript or other information in the HTML
>file caused problems. Is there any class which works ok with this kind of
>data extraction?

I suggest to use an HTML parser instead of regular expressions for this
purpose:

Parsing an HTML file:

MSHTML Reference
<URL:http://msdn.microsoft. com/library/default.asp?url =/workshop/browser/mshtml/reference/reference.asp>

- or -

..NET Html Agility Pack: How to use malformed HTML just like it was
well-formed XML...
<URL:http://blogs.msdn.com/smourier/archive/2003/06/04/8265.aspx>

Download:

<URL:http://www.codefluent. com/smourier/download/htmlagilitypack .zip>

- or -

SgmlReader 1.4
<URL:http://www.gotdotnet.c om/Community/UserSamples/Details.aspx?Sa mpleGuid=B90FDD CE-E60D-43F8-A5C4-C3BD760564BC>

If the file read is in XHTML format, you can use the classes contained in
the 'System.Xml' namespace for reading information from the file.

--
M S Herfried K. Wagner
M V P <URL:http://dotnet.mvps.org/>
V B <URL:http://classicvb.org/petition/>