open source .NET search engine?

Collapse
This topic is closed.
X
X
 
  • Time
  • Show
Clear All
new posts
  • susiedba@hotmail.com

    open source .NET search engine?

    does anyone know of a framework; or tools; or something-- that
    describes an open source VB.net search engine / spider?

    anyone want to trade notes?

    I want to build something a lot more focused than google; for example;
    I want to spider Home Depot websites and sell it to Lowes.

    Does anyone want to help?

    -Susie

  • Spam Catcher

    #2
    Re: open source .NET search engine?

    "susiedba@hotma il.com" <susiedba@hotma il.comwrote in
    news:1161110236 .872569.205930@ i3g2000cwc.goog legroups.com:
    does anyone know of a framework; or tools; or something-- that
    describes an open source VB.net search engine / spider?
    >
    anyone want to trade notes?
    >
    I want to build something a lot more focused than google; for example;
    I want to spider Home Depot websites and sell it to Lowes.

    Lucene.NET or Microsoft Index Server or SQL Server Full Text Search Engine.

    Comment

    • Chris

      #3
      Re: open source .NET search engine?

      Susie,

      As for your subject: open source .NET search engine try


      As for spidering, there are many website copiers out there, try HTTrack
      http://www.httrack.com/.

      I am not condoning unethical copyright infringement. However, I'm so sure
      that you will be unable to sell a competitor's website to a large company
      like Lowes that I give this information. Besides, I'm sure they have many
      talented people in their IT department that could get them this info in no
      time at all.

      As far as building something more focused than google--good luck. Google,
      just like Microsoft, has top computer scientist working on some crazy stuff
      i.e. natural language processing, query analysis, best bets, controlled
      vocabularies and a little artificial intelligence. Most of which involves a
      fair amount of some pretty advanced mathematics. I'm not trying to
      discourage you to not build something better; there are lots of brilliant
      people in this world. Just use your brilliance for something good!

      As far as making money, why not use the Amazon E-commerce Web Service. It
      gives you access to all of Amazon's products, images, reviews, pricing, and
      a remote shopping cart system. You can just mark up the prices a bit to make
      money for not doing much of anything besides coding a website.
      Amazon Web Services offers reliable, scalable, and inexpensive cloud computing services. Free to join, pay only for what you use.



      Chris


      <susiedba@hotma il.comwrote in message
      news:1161110236 .872569.205930@ i3g2000cwc.goog legroups.com...
      does anyone know of a framework; or tools; or something-- that
      describes an open source VB.net search engine / spider?
      >
      anyone want to trade notes?
      >
      I want to build something a lot more focused than google; for example;
      I want to spider Home Depot websites and sell it to Lowes.
      >
      Does anyone want to help?
      >
      -Susie
      >

      Comment

      • susiedba@hotmail.com

        #4
        Re: open source .NET search engine?

        thanks guys; does anyone else have any ideas??


        Chris wrote:
        Susie,
        >
        As for your subject: open source .NET search engine try

        >
        As for spidering, there are many website copiers out there, try HTTrack
        http://www.httrack.com/.
        >
        I am not condoning unethical copyright infringement. However, I'm so sure
        that you will be unable to sell a competitor's website to a large company
        like Lowes that I give this information. Besides, I'm sure they have many
        talented people in their IT department that could get them this info in no
        time at all.
        >
        As far as building something more focused than google--good luck. Google,
        just like Microsoft, has top computer scientist working on some crazy stuff
        i.e. natural language processing, query analysis, best bets, controlled
        vocabularies and a little artificial intelligence. Most of which involves a
        fair amount of some pretty advanced mathematics. I'm not trying to
        discourage you to not build something better; there are lots of brilliant
        people in this world. Just use your brilliance for something good!
        >
        As far as making money, why not use the Amazon E-commerce Web Service. It
        gives you access to all of Amazon's products, images, reviews, pricing, and
        a remote shopping cart system. You can just mark up the prices a bit to make
        money for not doing much of anything besides coding a website.
        Amazon Web Services offers reliable, scalable, and inexpensive cloud computing services. Free to join, pay only for what you use.


        >
        Chris
        >
        >
        <susiedba@hotma il.comwrote in message
        news:1161110236 .872569.205930@ i3g2000cwc.goog legroups.com...
        does anyone know of a framework; or tools; or something-- that
        describes an open source VB.net search engine / spider?

        anyone want to trade notes?

        I want to build something a lot more focused than google; for example;
        I want to spider Home Depot websites and sell it to Lowes.

        Does anyone want to help?

        -Susie

        Comment

        • susiedba@hotmail.com

          #5
          Re: open source .NET search engine?

          I really do think that there is room for a new service.
          I just am going to have some sort of scope to my project-- instead of
          pulling a napoleon- like google does-- and try to enter EVERY MARKET at
          the same time.

          moving from search engines to spreadsheets; IM; Email; Usenet; Books;
          eCommerce-- I just dont think that google is 'big enough' to be
          successful in any of these new markets.

          which means that there is room for innovation.

          I've had many customers ask me to pull XYZ off of site ABC

          I personally think that a simple search engine should consist of a
          couple of Olap Servers and a couple of relational boxes.. and a couple
          of crawlers... not too complex at all.

          -Susie




          Chris wrote:
          Susie,
          >
          As for your subject: open source .NET search engine try

          >
          As for spidering, there are many website copiers out there, try HTTrack
          http://www.httrack.com/.
          >
          I am not condoning unethical copyright infringement. However, I'm so sure
          that you will be unable to sell a competitor's website to a large company
          like Lowes that I give this information. Besides, I'm sure they have many
          talented people in their IT department that could get them this info in no
          time at all.
          >
          As far as building something more focused than google--good luck. Google,
          just like Microsoft, has top computer scientist working on some crazy stuff
          i.e. natural language processing, query analysis, best bets, controlled
          vocabularies and a little artificial intelligence. Most of which involves a
          fair amount of some pretty advanced mathematics. I'm not trying to
          discourage you to not build something better; there are lots of brilliant
          people in this world. Just use your brilliance for something good!
          >
          As far as making money, why not use the Amazon E-commerce Web Service. It
          gives you access to all of Amazon's products, images, reviews, pricing, and
          a remote shopping cart system. You can just mark up the prices a bit to make
          money for not doing much of anything besides coding a website.
          Amazon Web Services offers reliable, scalable, and inexpensive cloud computing services. Free to join, pay only for what you use.


          >
          Chris
          >
          >
          <susiedba@hotma il.comwrote in message
          news:1161110236 .872569.205930@ i3g2000cwc.goog legroups.com...
          does anyone know of a framework; or tools; or something-- that
          describes an open source VB.net search engine / spider?

          anyone want to trade notes?

          I want to build something a lot more focused than google; for example;
          I want to spider Home Depot websites and sell it to Lowes.

          Does anyone want to help?

          -Susie

          Comment

          • susiedba@hotmail.com

            #6
            Re: open source .NET search engine?

            and it goes without saying that I think that Microsoft is completely
            and utterly incompetent.

            they're pulling a napoleon also.. they need to sell their Xbox and MSN
            division and fold it back into their core competencies.

            supposedly they have 5,000 developers and testers working on vista AND
            office 2007.

            what the hell are the other 60,000 employees doing?




            susiedba@hotmai l.com wrote:
            thanks guys; does anyone else have any ideas??
            >
            >
            Chris wrote:
            Susie,

            As for your subject: open source .NET search engine try


            As for spidering, there are many website copiers out there, try HTTrack
            http://www.httrack.com/.

            I am not condoning unethical copyright infringement. However, I'm so sure
            that you will be unable to sell a competitor's website to a large company
            like Lowes that I give this information. Besides, I'm sure they have many
            talented people in their IT department that could get them this info in no
            time at all.

            As far as building something more focused than google--good luck. Google,
            just like Microsoft, has top computer scientist working on some crazy stuff
            i.e. natural language processing, query analysis, best bets, controlled
            vocabularies and a little artificial intelligence. Most of which involves a
            fair amount of some pretty advanced mathematics. I'm not trying to
            discourage you to not build something better; there are lots of brilliant
            people in this world. Just use your brilliance for something good!

            As far as making money, why not use the Amazon E-commerce Web Service. It
            gives you access to all of Amazon's products, images, reviews, pricing, and
            a remote shopping cart system. You can just mark up the prices a bit to make
            money for not doing much of anything besides coding a website.
            Amazon Web Services offers reliable, scalable, and inexpensive cloud computing services. Free to join, pay only for what you use.



            Chris


            <susiedba@hotma il.comwrote in message
            news:1161110236 .872569.205930@ i3g2000cwc.goog legroups.com...
            does anyone know of a framework; or tools; or something-- that
            describes an open source VB.net search engine / spider?
            >
            anyone want to trade notes?
            >
            I want to build something a lot more focused than google; for example;
            I want to spider Home Depot websites and sell it to Lowes.
            >
            Does anyone want to help?
            >
            -Susie
            >

            Comment

            • Spam Catcher

              #7
              Re: open source .NET search engine?

              "susiedba@hotma il.com" <susiedba@hotma il.comwrote in
              news:1161123151 .901347.83510@e 3g2000cwe.googl egroups.com:
              supposedly they have 5,000 developers and testers working on vista AND
              office 2007.
              >
              what the hell are the other 60,000 employees doing?
              Microsoft does have more than 2 products. .NET, VS.NET, SQL Server :-)

              Comment

              • Spam Catcher

                #8
                Re: open source .NET search engine?

                "susiedba@hotma il.com" <susiedba@hotma il.comwrote in
                news:1161123049 .727124.78350@e 3g2000cwe.googl egroups.com:
                I personally think that a simple search engine should consist of a
                couple of Olap Servers and a couple of relational boxes.. and a couple
                of crawlers... not too complex at all.
                Good luck if you don't think it's complex - there's a reason why Google
                hires a lot of PhDs!

                Comment

                • aaron.kempf@gmail.com

                  #9
                  Re: open source .NET search engine?

                  not really; .NET VS.NET and SQL Server sure dont take more people than
                  Office and Windows.

                  what about revenue.

                  80% of their revenue comes from Office and Windows???





                  Spam Catcher wrote:
                  "susiedba@hotma il.com" <susiedba@hotma il.comwrote in
                  news:1161123151 .901347.83510@e 3g2000cwe.googl egroups.com:
                  >
                  supposedly they have 5,000 developers and testers working on vista AND
                  office 2007.

                  what the hell are the other 60,000 employees doing?
                  >
                  Microsoft does have more than 2 products. .NET, VS.NET, SQL Server :-)

                  Comment

                  • aaron.kempf@gmail.com

                    #10
                    Re: open source .NET search engine?

                    the reason that they hire a lot of PhD is because they reinvent the
                    wheel.

                    I dont see a need to write your own Operating System, Web Browser;
                    Database Engine.
                    I dont see a need to write everything in crazy-ass-complex AJAX.

                    I just think that they're too trendy and not functional enough.

                    I've also had a half dozen clients ask me if I can crawl website X and
                    give them data XYZ.

                    And I dont think that there is an enterprise level search engine.. I
                    mean-- store it in a database and allow simple queries against a
                    database.

                    I just think that if i had a good datamart and a couple of olap servers
                    I could run circles around google.




                    Spam Catcher wrote:
                    "susiedba@hotma il.com" <susiedba@hotma il.comwrote in
                    news:1161123049 .727124.78350@e 3g2000cwe.googl egroups.com:
                    >
                    I personally think that a simple search engine should consist of a
                    couple of Olap Servers and a couple of relational boxes.. and a couple
                    of crawlers... not too complex at all.
                    >
                    Good luck if you don't think it's complex - there's a reason why Google
                    hires a lot of PhDs!

                    Comment

                    • aaron.kempf@gmail.com

                      #11
                      Re: open source .NET search engine?

                      I mean seriously

                      if you can use Olap to look for similiar words; etc
                      I just dont think that it would be that complex.

                      and you people that sit around and think that google is worth more than
                      IBM?

                      LAUGHABLE.

                      I just think that it's a shame.. I would love to help you susie--
                      because I think that there IS a better solution.

                      Instead of using 100 different languges from Perl to PHP to BigTable to
                      GoogleOS- I just call hogwash on their ass.

                      maybe we should build a project on sourceforge.. does anyone have an
                      idea?

                      literally-- database driven search engine; most everything lives in
                      mySql with a couple of SQL Server boxes at the top of the equation.

                      Comment

                      • susiedba@hotmail.com

                        #12
                        Re: open source .NET search engine?

                        wow; aaron.. I agree.

                        why dont you drop me an email at susiedba

                        AT


                        hotmale.com


                        aaron.kempf@gma il.com wrote:
                        the reason that they hire a lot of PhD is because they reinvent the
                        wheel.
                        >
                        I dont see a need to write your own Operating System, Web Browser;
                        Database Engine.
                        I dont see a need to write everything in crazy-ass-complex AJAX.
                        >
                        I just think that they're too trendy and not functional enough.
                        >
                        I've also had a half dozen clients ask me if I can crawl website X and
                        give them data XYZ.
                        >
                        And I dont think that there is an enterprise level search engine.. I
                        mean-- store it in a database and allow simple queries against a
                        database.
                        >
                        I just think that if i had a good datamart and a couple of olap servers
                        I could run circles around google.
                        >
                        >
                        >
                        >
                        Spam Catcher wrote:
                        "susiedba@hotma il.com" <susiedba@hotma il.comwrote in
                        news:1161123049 .727124.78350@e 3g2000cwe.googl egroups.com:
                        I personally think that a simple search engine should consist of a
                        couple of Olap Servers and a couple of relational boxes.. and a couple
                        of crawlers... not too complex at all.
                        Good luck if you don't think it's complex - there's a reason why Google
                        hires a lot of PhDs!

                        Comment

                        Working...