Our Crawler

Meet Kaapi, our crawler. Kaapi is the South Indian version of filter coffee. It crawls the new sites for us. If you see a pattern like this in the access logs

127.0.0.1 - - [16/Aug/2010:11:00:49 +0530] "GET / HTTP/1.1" 200 1273 "-" "kaapi

then it is our crawler that is indexing your site. Please read our FAQ to learn more about what we are doing. If you wish to restrict our crawler you may do so by adding the following in your robots.txt

User-agent: kaapi
Disallow: /

We recommend that you reach out to us at crawler@taazza.com before you take this step.