How to limit access to web site to prevent harvesting
We need the help of a Linux expert. We have a very large web site, with millions of pages, and we need to be able to limit access to the public by restricting access to 50 pages within 24 hours per IP address. In other words if you surf the web and go to our web site, we will let you surf through 50 html pages before we block you. We need this to prevent data harvesting by end users and also by our competition. We are running the latest version of Linux Slackware. We know it can be done, but we can not find how. We need someone to explain to us how to set this up by sending us the instructions.
We need to limit access to a specific domain abc.com for example. So regardless of the html files, images etc, anything that is under abc.com must be limited. So let’s say that we want to limit access to 500 “items” per IP per day. This means that the total transfer of material from the domain abc.com, be it, html files, images, etc. would max to 500. If the user hits the 500 maximum, the system should display an error html page which will be under another domain like abc-error.com. The setup must be simple and you must provide the step by step documentation on how to do this.
(Budget: $30-250, Jobs: Linux, System Admin.)