What is the TwengaBot and why should I let it crawl my site?

TwengaBot is a robot similar to GoogleBot and other automated web-crawlers.
TwengaBot searches the web to identify online shops, and then collects all product information in order to display it, free of charge, on Twenga ( is the largest online product database, present in many European countries; this database fuels Twenga's next generation shopping search engine which promises extensive choice and unbiased opinions to our customers. This helps our users to find the products they are looking for, and gives high visibility to relevant products from all web retailers.
With all of this being free of charge and completely oriented around the consumer, there is everything to be gained from being crawled by TwengaBot!

Why do I see the TwengaBot everyday?

In order to best represent your shop, TwengaBot will pass by almost every day to update your product, price or inventory changes. But not to worry, our Bot has been specifically designed not to overload your bandwidth when it is crawling the site. Once on your site, TwengaBot will crawl no more than one page every few seconds.

The TwengaBot also fully supports the robots.txt protocol, particularly the crawl-delay instruction.
You might want to add the following lines to your robots.txt file:
User-agent: TwengaBot-2.0
Crawl-delay: 5

I am still not sure I understand.

If you have any suggestions or questions, or don't see the interest in TwengaBot visiting your site, please let us know by contacting Twenga in your country.