webcrawler (bot) in javascript?

Collapse
This topic is closed.
X
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • bdy120602@gmail.com
    #1

    webcrawler (bot) in javascript?

    I have a few programs that search an entire site for a keyword, and I
    run
    them from my machine: "Light Web Searcher" and "Teleport Pro" are
    just
    a few. My objective is to create a bare-bones software application
    identical to the functions available in the aforementioned pieces of
    software.

    What language would I be able to accomplish that with?


    Thanks,


    Danny
    Tags: None
    • Evertjan.
      #2
      Re: webcrawler (bot) in javascript?

      wrote on 20 feb 2008 in comp.lang.javas cript:
      I have a few programs that search an entire site for a keyword, and I
      run
      them from my machine: "Light Web Searcher" and "Teleport Pro" are
      just
      a few. My objective is to create a bare-bones software application
      identical to the functions available in the aforementioned pieces of
      software.
      >
      What language would I be able to accomplish that with?
      The Q is mainly off topic,
      you can only ask if it can be done using Javascript.

      Answer: Yes.

      --
      Evertjan.
      The Netherlands.
      (Please change the x'es to dots in my emailaddress)

        Comment

        • bdy120602@gmail.com
          #3
          Re: webcrawler (bot) in javascript?

          On Feb 20, 2:18 pm, "Evertjan." <exjxw.hannivo. ..@interxnl.net wrote:
           wrote on 20 feb 2008 in comp.lang.javas cript:
          >
          I have a few programs that search an entire site for a keyword, and I
          run
          them from my machine: "Light Web Searcher" and "Teleport Pro" are
          just
          a few. My objective is to create a bare-bones software application
          identical to the functions available in the aforementioned pieces of
          software.
          >
          What language would I be able to accomplish that with?
          >
          The Q is mainly off topic,
          you can only ask if it can be done using Javascript.
          >
          Answer: Yes.
          >
          --
          Evertjan.
          The Netherlands.
          (Please change the x'es to dots in my emailaddress)
          Great. Can you get me started on writing a web crawler (bot) in
          Javascript. What tools do I need?

            Comment

            • Nick Fletcher
              #4
              Re: webcrawler (bot) in javascript?

              On Feb 28, 10:57 am, bdy120...@gmail .com wrote:
              On Feb 20, 2:18 pm, "Evertjan." <exjxw.hannivo. ..@interxnl.net wrote:
              >
              >
              >
              wrote on 20 feb 2008 in comp.lang.javas cript:
              >
              I have a few programs that search an entire site for a keyword, and I
              run
              them from my machine: "Light Web Searcher" and "Teleport Pro" are
              just
              a few. My objective is to create a bare-bones software application
              identical to the functions available in the aforementioned pieces of
              software.
              >
              What language would I be able to accomplish that with?
              >
              The Q is mainly off topic,
              you can only ask if it can be done using Javascript.
              >
              Answer: Yes.
              >
              --
              Evertjan.
              The Netherlands.
              (Please change the x'es to dots in my emailaddress)
              >
              Great.
              The answer may be yes, but JavaScript would still be a poor choice. A
              web crawler requires a lot of bandwidth and lots of text parsing. A
              server running Java or C++ would do far better than your web browser
              running JavaScript.
              Can you get me started on writing a web crawler (bot) in
              Javascript. What tools do I need?
              Your brain and a text editor. :)

                Comment

                Previous template Next
                Working...