Proxies for Price Monitoring: Setup, Sizing and What It Costs Per Product

Why price monitoring needs proxies

• Rate limits. Checking thousands of products from one IP triggers 429s and blocks within minutes on large retailers.
• Geo-pricing. Prices, currency, stock and shipping vary by country and often by region. You need to see what a local shopper sees.
• Bot defences. Big marketplaces serve CAPTCHAs, stripped pages or plausible-looking wrong prices to traffic they distrust.

Which proxy type for which retailer

Getting the right price, not just a price

1. 1Target the country in the proxy username so the exit is local.
2. 2Set the location the site uses. Many retailers price by delivery postcode stored in a cookie, not by IP. Set it once per session and keep that session sticky.
3. 3Match language and currency with Accept-Language and any currency cookie the site uses.
4. 4Use one sticky session per location batch, so the location cookie and the IP stay together.
5. 5Record the context — exit country, postcode, timestamp — alongside every price.

Sizing and cost

Price monitoring is billed by bandwidth, so the only numbers that matter are products, frequency and page weight. HTML-only fetches are cheap; full browser renders with images are not.

The last row is the same job as the second, rendered in a browser with images. Where the price is in the HTML or a JSON endpoint, fetch that instead. Where you must render, block images, media and fonts. Volume pricing brings Lite below €1 per GB from 500 GB — see residential proxy pricing explained.

Validating what you collect

The expensive failure in price monitoring is not a block you can see — it is a wrong price you do not notice. Validate each page before storing its price:

• Check for the product identifier (ASIN, SKU, GTIN) in the page. A CAPTCHA or error page will not have it.
• Reject outliers against the last known price; a 90% drop is more often a parsing error than a sale.
• Watch the currency and country in the page, not just in your request.
• Track success rate per retailer. A slow decline is the first sign the target changed its defences.

Frequency and politeness

Check as often as prices actually change, not as often as you can. Most catalogue prices move daily at most; flash-sale items and airline or hotel rates justify more. Spread checks across the day, respect crawl delays and avoid hammering a single category page. Public prices are generally fair to collect, but the site's terms and your local law still apply — see are proxies legal.