User tracking - abuse?

Collapse
This topic is closed.
X
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • Nel
    #1

    User tracking - abuse?

    I have a web site that seems to be getting hammered by lots of bots.

    Some genuine, some questionable. Some just users that seem to be
    downloading the site en-masse. I have started using php & mysql to track
    the IP, host, browser, proxy of all visitors and am trying to gauge how many
    pages to serve within one hour before restricting access.

    What do you consider to be a reasonable number of visits per hour? Do many
    bots rush through a site?

    I know this is a vague question, but at least you guys may have some
    experience in this area. Before you say it I have tried to Google for
    this - no luck at all.

    Is there a better way to block abuse of a site???

    Nel.


    Tags: None
    • Erwin Moller
      #2
      Re: User tracking - abuse?

      Nel wrote:
      [color=blue]
      > I have a web site that seems to be getting hammered by lots of bots.
      >
      > Some genuine, some questionable. Some just users that seem to be
      > downloading the site en-masse. I have started using php & mysql to track
      > the IP, host, browser, proxy of all visitors and am trying to gauge how
      > many pages to serve within one hour before restricting access.
      >
      > What do you consider to be a reasonable number of visits per hour? Do
      > many bots rush through a site?
      >
      > I know this is a vague question, but at least you guys may have some
      > experience in this area. Before you say it I have tried to Google for
      > this - no luck at all.
      >
      > Is there a better way to block abuse of a site???
      >
      > Nel.[/color]

      Hi Nel,

      Why do you want to restrict access to your site?
      If your site is popular, I expect that the extra bandwidthbill of your ISP
      is a luxuryproblem.

      I also used bots to download a site on my local HD for offline browsing
      (this was before ADSL was cheap).

      So why do you want to restrict your visitors?

      just my 2 cent.

      Regards,
      Erwin Moller

        Comment

        • Nel
          #3
          Re: User tracking - abuse?


          "Erwin Moller"
          <since_humans_r ead_this_I_am_s pammed_too_much @spamyourself.c om> wrote in
          message news:44a26152$0 $31654$e4fe514c @news.xs4all.nl ...[color=blue]
          > Nel wrote:
          >[color=green]
          >> I have a web site that seems to be getting hammered by lots of bots.
          >>
          >> Some genuine, some questionable. Some just users that seem to be
          >> downloading the site en-masse. I have started using php & mysql to track
          >> the IP, host, browser, proxy of all visitors and am trying to gauge how
          >> many pages to serve within one hour before restricting access.
          >>
          >> What do you consider to be a reasonable number of visits per hour? Do
          >> many bots rush through a site?
          >>
          >> I know this is a vague question, but at least you guys may have some
          >> experience in this area. Before you say it I have tried to Google for
          >> this - no luck at all.
          >>
          >> Is there a better way to block abuse of a site???
          >>
          >> Nel.[/color]
          >
          > Hi Nel,
          >
          > Why do you want to restrict access to your site?
          > If your site is popular, I expect that the extra bandwidthbill of your ISP
          > is a luxuryproblem.
          >
          > I also used bots to download a site on my local HD for offline browsing
          > (this was before ADSL was cheap).
          >
          > So why do you want to restrict your visitors?
          >
          > just my 2 cent.
          >
          > Regards,
          > Erwin Moller[/color]

          It was mainly for bots that seem to refuse to abide by the robots.txt file.
          LinkWalker was one that springs to mind - just keeps on taking.

          Nel


            Comment

            Previous template Next
            Working...