WebScraping

[Graham Feeley]

Can someone steer me to scripts / modules etc on webscraping please???
Ultimately I would like someone to write a script for me.
However i am still searching for documentation on this subject
Thanks Graham

[Steven D'Aprano]

Re: WebScraping

On Sun, 05 Nov 2006 08:09:52 +1000, Graham Feeley wrote:

Can someone steer me to scripts / modules etc on webscraping please???

The definitive documentation on the built-in Python modules can be found
here: http://docs.python.org/modindex.html

The ActiveState Python cookbook should be useful, e.g.

http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/391929

Also see Beautiful Soup:

http://www.crummy.com/software/BeautifulSoup/

And of course, GIYF ("Google Is Your Friend") http://www.google.com which
leads me to:

http://sig.levillage.org/?p=588

http://sig.levillage.org/2005/03/11/web-scraping-with-python-part-ii/

http://wiki.tcl.tk/2915 (not focused on Python, but may still be useful).

Ultimately I would like someone to write a script for me.

Are you offering to hire a developer?


--
Steven.

[Michael Torrie]

Re: WebScraping

On Sun, 2006-11-05 at 13:40 +1100, Steven D'Aprano wrote:

On Sun, 05 Nov 2006 08:09:52 +1000, Graham Feeley wrote:
>

Can someone steer me to scripts / modules etc on webscraping please???

>
The definitive documentation on the built-in Python modules can be found
here: http://docs.python.org/modindex.html
>
The ActiveState Python cookbook should be useful, e.g.

http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/391929

>
Also see Beautiful Soup:
http://www.crummy.com/software/BeautifulSoup/

Beautiful soup is not always speedy, but it sure is the most flexible
scraper I've ever came across. I hacked together a web forum-to-nntp
gateway using Beautiful Soup. Worked very well.

Michael

>
And of course, GIYF ("Google Is Your Friend") http://www.google.com which
leads me to:
>

http://sig.levillage.org/?p=588

http://sig.levillage.org/2005/03/11/web-scraping-with-python-part-ii/

http://wiki.tcl.tk/2915 (not focused on Python, but may still be useful).
>
>

Ultimately I would like someone to write a script for me.

>
Are you offering to hire a developer?
>
>
--
Steven.
>

[ina]

Re: WebScraping

This might be of help to you.

http://phlik.ishpeck.net/index.php?P=a1141076600phlik

http://phlik.ishpeck.net/index.php?P=b1134168973phlik

Graham Feeley wrote:

Can someone steer me to scripts / modules etc on webscraping please???
Ultimately I would like someone to write a script for me.
However i am still searching for documentation on this subject
Thanks Graham

[Bernard]

Re: WebScraping

yup yup BeautifulSoup is the way to go.

what would you like to scrape by the way?

Graham Feeley wrote:

Can someone steer me to scripts / modules etc on webscraping please???
Ultimately I would like someone to write a script for me.
However i am still searching for documentation on this subject
Thanks Graham

[Graham Feeley]

Re: WebScraping

Well I would like to publicly thank Bernard Chhun for actually writing this
script and "pretting " it up for me.
He is truly a talented guy.
He used Beautifull Soup and Regex which i am still coming to terms trying to
understand them any way Thanks again Bernard.
Regards
graham

"Graham Feeley" <grahamjfeeley@ optusnet.com.au wrote in message
news:454d0fb1$0 $11970$afc38c87 @news.optusnet. com.au...

Can someone steer me to scripts / modules etc on webscraping please???
Ultimately I would like someone to write a script for me.
However i am still searching for documentation on this subject
Thanks Graham
>
>
>