Our catalogue indexer
If you found this page from a line in your server log, that line was us. Here is what we do, when, and how to let us through or shut us out.
How to recognise it
- User-Agent
OneSiteAgency-AiShop/0.1 (catalog indexer; +https://onesite.agency/bot)- Requests come from
167.235.57.100- Schedule
- Once a day, 04:17 UTC
- Rate
- At most 4 requests in parallel, 30s timeout, exponential backoff on errors
Why it visits
It only reads shops whose owners asked us to. A shop becomes ours to read when its owner installs our tag and we are given the address of a product feed or sitemap. We do not crawl uninvited, we do not follow links off the shop, and we do not collect anything about your visitors.
What we read is the public catalogue: titles, authors or brands, descriptions, prices, availability, images. It is the same data your shop already publishes to Google Shopping. We keep a copy so the shop owner's customers can search it in plain language.
What it does not do
It does not submit forms, log in, add to cart, or touch anything behind an account. It reads robots.txt to discover your sitemaps — but it does not enforce Disallow rules, because it only ever walks the addresses the shop owner gave us. If you need us off a path, the block below is the reliable way to say so.
Letting it through
Behind Cloudflare, a datacentre address is challenged by default and every request comes back 403. If you run the shop and want our indexing to work, allow the address above:
Cloudflare → Security → WAF → Tools → IP Access Rules — add 167.235.57.100, action Allow, scope: this website.
The same applies to any other WAF, rate limiter, or firewall: the address is stable, and we will tell the shop owner in writing before it ever changes.
Blocking it
Block 167.235.57.100, or return 403 to the User-Agent above. Nothing breaks on your side — the shop that hired us simply stops receiving fresh catalogue data, and its owner sees the failure and the reason in their dashboard.
If our reading is a problem and you would rather talk than block, write to [email protected]. A person answers.