Extract URLs from search engine results

[Nikkhah]

I want to write a program in java that it can parse search engine results and save URLs and titles in a file, but I don't know how can I do this?

[jkmyoung]

You probably want to look up HTTPRequest and Regular Expressions.

eg something like:
<a href=".*{url}"> .*{title}</a>

[Nikkhah]

You probably want to look up HTTPRequest and Regular Expressions.

eg something like:
<a href=".*{url}"> .*{title}</a>

Do you know what instructions do I use?

[jkmyoung]

? What task are you specifically referring to?

If you haven't already, break your problem into steps. It's easier to help with one step at a time then all of them at once.

[Nikkhah]

? What task are you specifically referring to?

If you haven't already, break your problem into steps. It's easier to help with one step at a time then all of them at once.

I want to connect to google and save URLs. what do I do?

[Nikkhah]

I find a sample code that extract links from an html page. now how can I save html source of search results?

[jkmyoung]

Here's a quick example from Sun's website:

http://74.125.113.132/search?q=cache:yAqqV3r1oFEJ:java.sun.com/docs/books/tutorial/networking/urls/readingWriting.html+urlconnection+example&cd=1&hl=en&ct=clnk&gl=ca

	public static void main(String[] args) throws Exception {
		URL url = new URL("http://www.google.com/");
		URLConnection urlc = url .openConnection();
		BufferedReader in = new BufferedReader(
				new InputStreamReader(
						urlc.getInputStream()));
		String inputLine;

		while ((inputLine = in.readLine()) != null) 
			System.out.println(inputLine);
		in.close();
	}

It's pretty easy to find with google.

Try modifying it to meet your needs, and come back if you have a problem.