The use of crawlers (automated index tools) to mine data from web sites to create market comparison shopping services for subscribers is the focus of this Wall Street Journal article, Are Bots Legal?. An example of such a service is Bargain.com , whose home page proclaims, “Never Pay Retail Again!.” Users may search through categories …

Read more