How do I get search engine results programmatically?

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • xarzu
    New Member
    • Apr 2007
    • 90

    How do I get search engine results programmatically?

    How do I get search engine results programatically ? Some search engines use AJAX to display content and so the URL does not change. This makes it difficult to get result content from a search engine programatically .

    Most search engines do not use AJAX. But two popular ones that I am interested in is YANDEX and DUCKDUCKGO. Both of these search engines use AJAX to advance beyond the first page of results. How do I find a way to programatically access these pages?
  • Rabbit
    Recognized Expert MVP
    • Jan 2007
    • 12517

    #2
    Browsers usually block cross domain AJAX requests but there are a few work around you can try if you want to use Javascript. But aside from that, you can use a server side script to make the same request that the AJAX would make.

    Comment

    • xarzu
      New Member
      • Apr 2007
      • 90

      #3
      Do Not Bump

      Originally posted by Rabbit
      Browsers usually block cross domain AJAX requests but there are a few work around you can try if you want to use Javascript. But aside from that, you can use a server side script to make the same request that the AJAX would make.
      What sorts of AJAX tags would I look for in the HTML source and how would I make use of them?

      Originally posted by Rabbit
      Browsers usually block cross domain AJAX requests but there are a few work around you can try if you want to use Javascript. But aside from that, you can use a server side script to make the same request that the AJAX would make.
      How would I do this?
      Last edited by zmbd; Nov 25 '12, 02:55 AM. Reason: [Z {{Xarzu, Please do not bump your threads. Also, be very aware of the fact the Mods and Experts are unpaid volunteers. We often work our help in-between our real job and family obligations}}]

      Comment

      • Rabbit
        Recognized Expert MVP
        • Jan 2007
        • 12517

        #4
        AJAX doesn't use HTML tags. It uses javascript. You can identify those requests if it uses one or both of the following javascript functions: XMLHttpRequest( ) or ActiveXObject(" Microsoft.XMLHT TP").

        Comment

        Working...