How do you obtain information from my website?
We use crawlers to visit pages in your website and extract information for them. A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (From Wikipedia). Our crawler is identified by (pricemandubot) and obeys robots.txt file.
How often do you crawl?
It depends on how large your website is and an exact answer cannot be provided. Most of the crawling happens during night time @ Nepal and very few crawls are made during day time.
You are crawling my site too fast
Our crawlers, identified by (pricemandubot), has advanced mechanisms in place to prevent overloading your server with requests. In general, this works without putting too much pressure in your server but if you observe that it is slowing your site down please contact us and we will limit the crawl speed.
Are you selling my products?
No we are not selling your products. We show product name, description, price and other relevant information to users and if they are interested, they can click the link which will redirect them to our own website or e-commerce platform you are using.
What if I don’t want my website listed here?
Our aim is to foster a competitive e-commerce industry and would be great if you join us in this movement. However, if you do not want your products to be listed here, please add (pricemandubot) in your robots.txt exclusion list. For more details please check here or contact your web administrator to modify robots.txt. Once you deny (pricemandubot) in the robots.txt, our crawlers will not visit your website. Please note that this might not immediately prevent our crawlers from crawling your website since the robots.txt file is only checked once before starting to crawl your website. If there are urls already in the queue then they will be crawled regardless. Please allow upto a week for your catalog to be fully unlisted from our website.