Shopify & WooCommerce Store Products Scraper
The Shopify and WooCommerce Store Products Scraper reads a store's public catalogue JSON and returns one row per product with title, vendor, product type, tags, URL, lowest variant price, compare-at price, currency, availability, variant count, the variants themselves, image URLs and a plain-text description, plus a platform field for Shopify or woo. It auto-detects the platform, uses no browser or login, and costs $0.50 per 1,000 products. Run it from Apify Console or the API.
from $0.0005 per product scraped, $0.5 per 1,000, down to $0.00035 on higher Apify plans · Updated Nov 2026, version 0.1.4
Key facts
- Price
- from $0.0005 per product scraped, $0.5 per 1,000, down to $0.00035 on higher Apify plans
- Pricing model
- Pay per event
- Output
- JSON, CSV, Excel, XML, RSS via Apify datasets
- Access
- Apify Console, REST API, Python and JS clients
- Version
- Updated Nov 2026, version 0.1.4
- Actor
subimpact/shopify-store-products
Who it is for
- Retail analysts building a price comparison across competing stores
- Dropshippers screening a supplier catalogue by stock and variants
- Brands checking how their own catalogue renders on price and compare-at price
- Data teams loading Shopify and WooCommerce feeds into one table
Use cases
Export a whole catalogue
Paste a store URL such as https://www.allbirds.com into storeUrls and set maxProductsPerStore and maxItems. The platform is detected automatically and the actor pages the catalogue at 250 products per Shopify request or 100 per WooCommerce request. Each row returns productId, handle, title, url, price and images, so a store's range is analysable without a browser.
Compare prices on sale items
price is the cheapest variant price and compareAtPrice is the struck-through price of that same variant, so a row with both shows a real discount rather than a mix of variants. Filter rows where compareAtPrice is not null, then rank by the gap between the two to see how deep a store discounts across categories.
Scrape one collection only
For Shopify stores, list collectionHandles such as mens or womens-shoes, or paste the collection URL. A collection title like Men's Shoes is converted to its handle, and a product that sits in two collections is delivered once. That keeps a run small when you only care about one category, and the field is ignored for WooCommerce, which is scraped whole.
Inspect variants and stock
With includeVariants on, each row carries a variants array of id, title, sku, price, compareAtPrice and available, while variantCount stays available even when you turn it off. That shows which sizes or colours are sold out without a second request, and available on the product tells you whether any variant can be bought at all.
Watch a catalogue change
Run the same store list on a schedule and compare rows by productId. Shopify rows carry createdAt and updatedAt, so a new product or a reprice is visible between runs, and a product that disappears from the export has been unpublished. WooCommerce rows leave those dates null, so compare prices and handles there instead.
Output fields
| Field | Type | Description |
|---|---|---|
storeUrl | string/null | Store root the row came from, e.g. https://www.allbirds.com |
platform | string/null | shopify or woo (WooCommerce); null on a row whose store could not be identified |
productId | string/null | The store's own product id, as a string |
handle | string/null | Shopify handle or WooCommerce product slug |
title | string/null | Product title exactly as the store publishes it |
vendor | string/null | Shopify vendor, or the WooCommerce brand when the store publishes one; null otherwise |
productType | string/null | Shopify product_type, or the first WooCommerce category name |
tags | array/null | Product tags as published by the store |
url | string/null | Canonical product page URL |
price | number/null | Lowest variant price in the store's currency (Shopify), or the WooCommerce Store API price (the minimum of a variable product's range). null when the store publishes no price (e.g. quote-only products) |
compareAtPrice | number/null | The struck-through price of the same variant the price came from; null when the product is not on sale |
currency | string/null | ISO currency code: Shopify from /meta.json (fallback /cart.js), WooCommerce from prices.currency_code. null when the store does not expose it |
Show all 22 fields
| Field | Type | Description |
|---|---|---|
available | boolean/null | True when any variant is buyable |
variantCount | integer/null | Number of variants the store publishes for this product |
variants | array/null | Variant objects (id, title, sku, price, compareAtPrice, available). Present when includeVariants is on; null when it is off |
images | array/null | Absolute product image URLs, in the store's order, de-duplicated |
description | string/null | Product description with HTML stripped and entities decoded, capped at 20,000 characters |
createdAt | string/null | Shopify created_at (ISO 8601). null on WooCommerce rows: the public Store API does not expose creation dates |
updatedAt | string/null | Shopify updated_at (ISO 8601). null on WooCommerce rows: the public Store API does not expose modification dates |
scrapedAt | string/null | ISO 8601 timestamp of collection |
status | string | ok = product row. empty = the store answered with no products. error = the store or its catalogue endpoint could not be read. Empty and error rows carry no product data and are NOT charged |
error | string/null | Why the row is empty/error (HTTP status, disabled endpoint, invalid URL). null on ok rows |
Sample output
From one of our own test runs on 20 Nov 2026, trimmed. Personal data is redacted.
2 rows, first 3 shown
[
{
"storeUrl": "https://kith.com",
"platform": "shopify",
"productId": "8286948360320",
"handle": "vanvn000v8fbla",
"title": "VANS x Needles OTW Mountain Edition Vibram - Black",
"vendor": "VANS",
"productType": "High Top Sneakers",
"tags": [
"110226inlinefw",
"111926",
"111926fw",
"..."
],
"url": "https://kith.com/products/vanvn000v8fbla",
"price": 249600,
"compareAtPrice": null,
"currency": "USD",
"available": true,
"variantCount": 9,
"variants": [
{
"id": "45146336166016",
"title": "8",
"sku": "98301302",
"price": 249600,
"compareAtPrice": null,
"available": true
},
{
"id": "45146336198784",
"title": "8.5",
"sku": "98301303",
"price": 249600,
"compareAtPrice": null,
"available": true
},
{
"id": "45146336231552",
"title": "9",
"sku": "98301304",
"price": 249600,
"compareAtPrice": null,
"available": true
},
"..."
],
"images": [
"https://cdn.shopify.com/s/files/1/0094/2252/files/needles-x-vans-mountain-edition-vibram-black-vn000v8fbla-1_ae8cd7c4-611f-49be-a45c-8a472285a77b.jpg?v=1795036883",
"https://cdn.shopify.com/s/files/1/0094/2252/files/OTW-by-Vans-x-Needles-Mountain-Edition-Vibram-Shoes-VANS-Black-ALT2_1072b952-1ab7-4612-876d-bacec00f922d.jpg?v=1795036883",
"https://cdn.shopify.com/s/files/1/0094/2252/files/OTW-by-Vans-x-Needles-Mountain-Edition-Vibram-Shoes-VANS-Black-ALT4_0de8bf3c-4c34-44af-a58e-5d2927210f2f.jpg?v=1795036883",
"..."
],
"description": "VANS x Needles OTW Mountain Edition Vibram silhouette\n\nCracked leather and Cordura® upper\n\nDuratherm insulation\n\nVANS branding on the tongue\n\nHook-and-loop strap on the front with Needles Butterfly artwork\n\nFlat laces\n\nOff The Wall brand...",
"createdAt": "2026-11-02T15:39:47-05:00",
"updatedAt": "2026-11-19T21:52:23-05:00",
"scrapedAt": "2026-11-20T02:52:17.200Z",
"status": "ok",
"error": null
},
{
"storeUrl": "https://kith.com",
"platform": "shopify",
"productId": "8286948327552",
"handle": "vanvn000v8f3n1",
"title": "VANS x Needles OTW Mountain Edition Vibram - Brown",
"vendor": "VANS",
"productType": "High Top Sneakers",
"tags": [
"110226inlinefw",
"111926",
"111926fw",
"..."
],
"url": "https://kith.com/products/vanvn000v8f3n1",
"price": 249600,
"compareAtPrice": null,
"currency": "USD",
"available": true,
"variantCount": 9,
"variants": [
{
"id": "45146335871104",
"title": "8",
"sku": "98301293",
"price": 249600,
"compareAtPrice": null,
"available": true
},
{
"id": "45146335903872",
"title": "8.5",
"sku": "98301294",
"price": 249600,
"compareAtPrice": null,
"available": true
},
{
"id": "45146335936640",
"title": "9",
"sku": "98301295",
"price": 249600,
"compareAtPrice": null,
"available": true
},
"..."
],
"images": [
"https://cdn.shopify.com/s/files/1/0094/2252/files/needles-x-vans-mountain-edition-vibram-brown-vn000v8f3n1-1_69091ca3-843a-431e-ba37-2d5a44b4683c.jpg?v=1795036883",
"https://cdn.shopify.com/s/files/1/0094/2252/files/OTW-by-Vans-x-Needles-Mountain-Edition-Vibram-Shoes-VANS-Brown-ALT2_8e2119be-a091-446f-b26b-85ac9ea4e776.jpg?v=1795036883",
"https://cdn.shopify.com/s/files/1/0094/2252/files/OTW-by-Vans-x-Needles-Mountain-Edition-Vibram-Shoes-VANS-Brown-ALT4_a5ffe357-b673-4bef-8b52-af3e124671ef.jpg?v=1795036884",
"..."
],
"description": "VANS x Needles OTW Mountain Edition Vibram silhouette\n\nCracked leather and Cordura® upper\n\nDuratherm insulation\n\nVANS branding on the tongue\n\nHook-and-loop strap on the front with Needles Butterfly artwork\n\nFlat laces\n\nOff The Wall brand...",
"createdAt": "2026-11-02T15:39:46-05:00",
"updatedAt": "2026-11-19T21:52:23-05:00",
"scrapedAt": "2026-11-20T02:52:17.200Z",
"status": "ok",
"error": null
}
]Input
| Field | Type | Required | Description | Default |
|---|---|---|---|---|
storeUrls | array | Yes | One or more Shopify or WooCommerce stores. Paste the shop URL (https://store.com) — a pasted /products.json, /collections/... or /wp-json/... URL is reduced to the store root automatically. The platform (Shopify or WooCommerce) is detect... | - |
collectionHandles | array | No | Optional. Scrape only these Shopify collections, e.g. shoes or mens-jackets, in the order given. A collection title is accepted and converted to its handle (e.g. Men's Shoes -> mens-shoes); the exact handle is the part after /collections... | - |
maxProductsPerStore | integer | No | Stop paging a store once this many products have been delivered from it. Shopify serves 250 products per request and WooCommerce 100, so the default 250 is one request per store. | 250 |
maxItems | integer | No | Hard cap on product rows for the whole run, across all stores. The run stops cleanly when it is reached (already-delivered rows are kept and charged). Also bounded by the account's max paid dataset items. | 1000 |
includeVariants | boolean | No | Add a variants array to every product row (id, title, sku, price, compareAtPrice, available). Turn it off for smaller rows — variantCount is still delivered. WooCommerce's public Store API exposes variation ids and option values but not ... | true |
proxyConfiguration | object | No | Apify Proxy is on by default because Shopify rate-limits its public products.json per IP address (HTTP 429 with Retry-After). Rotating proxy IPs keep large multi-store runs clean. Choose 'No proxy' to use the actor's own connection. | {"useApifyProxy":true,"apifyProxyGroups":["RESIDENTIAL"]} |
Example input
{
"storeUrls": [
"https://www.allbirds.com"
]
}Pricing
| Event | What it means | Price | Lowest tier |
|---|---|---|---|
product-scraped | One product row delivered to the dataset with its variants, prices, stock and images. Platform and proxy usage included. Store error rows are free. | $0.0005 | $0.00035 |
$0.5 at the listed price, or $0.35 on higher Apify plans, for 1,000 product scraped units.
Prices from the Apify Store on 20 November 2026. Apify shows the final price before each run.
How it compares with other Apify actors
Price per 1,000 products at Apify Store list prices. Every row is a live listing on the Store, read on 20 Nov 2026, so a buyer can check each number at the source.
| Actor | Price per 1,000 products (Free plan) | Higher plans (Gold) | Start fee per run | Platform usage | Users | Rating | Last build |
|---|---|---|---|---|---|---|---|
| Shopify & WooCommerce Store Products Scraper This API | $0.5 | $0.35 | None | Included | 1 | No reviews yet | 19 Nov 2026 |
| Shopify Scraper - Products, Prices, Stock & Inventory | $1.00 | $0.7 | $0.00005 | Included | 2,557 | 4.2 (7 reviews) | 16 Nov 2026 |
| Shopify Products Scraper | $1.00 | $0.85 | $0.001 | Included | 913 | 5.0 (8 reviews) | 17 Nov 2026 |
| Shopify Product Scraper | $10.00 | $7.00 | $0.00005 | Included | 422 | 5.0 (2 reviews) | 8 Sep 2026 |
Where Shopify Scraper - Products, Prices, Stock & Inventory is stronger
Where Shopify Scraper - Products, Prices, Stock & Inventory is stronger
- Largest user base and most monthly runs among the Shopify actors listed here
- Real inventory counts and barcodes on variants where these are public
- Also returns selling plans, storefront videos and product information panels
Where this API is stronger
- One product event covers variants, images and compare-at prices with no add-ons
- Store URLs and collection handles can be combined in a single run
- WooCommerce stores are covered as well as Shopify
Where Shopify Products Scraper is stronger
Where Shopify Products Scraper is stronger
- Output includes SKUs, barcodes, GTINs, weights and metafields
- SEO title and description fields for every product
- Can write results into an existing dataset or parent run
Where this API is stronger
- WooCommerce stores are covered alongside Shopify
- One event per product, with no inventory add-on to switch on
- Collection handles and store URLs work in the same run
Where Shopify Product Scraper is stronger
Where Shopify Product Scraper is stronger
- Returns a clear reason for non Shopify or protected URLs
- Discount percentage and price range fields on each product
- Reads the same public products feed, so runs are quick to start
Where this API is stronger
- Covers WooCommerce stores as well as Shopify
- Variant detail with options is included when it is switched on
- A residential proxy is part of the default setup
Shopify catalogue scraping is well served and the leading actors all bill per product. autofacts has the largest audience and adds real inventory counts, trovevault goes deep on SKUs, barcodes and metafields, and webdatalabs keeps a lean products feed export with clear failure reasons. Ours adds WooCommerce alongside Shopify.
Prices are Apify Store list prices, checked 20 Nov 2026. Platform usage 'Paid separately' means Apify bills compute on top of the event price. Check each listing before you buy.
How to run it
- List stores in storeUrls, for example https://www.allbirds.com. A pasted products.json or collection URL is reduced to the store root.
- Set maxProductsPerStore, for example 250, and maxItems as a run cap, for example 1000.
- Add collectionHandles for Shopify if you only want certain collections, and keep includeVariants on unless you need smaller rows.
- Leave the residential proxy configuration as it is, since Shopify rate-limits its catalogue endpoint per IP.
- Run the actor, then export the product rows as JSON, CSV or Excel, or read them through the Apify API.
cURL
curl -X POST "https://api.apify.com/v2/acts/subimpact~shopify-store-products/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{"storeUrls":["https://www.allbirds.com"]}'Python
from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("subimpact/shopify-store-products").call(run_input={"storeUrls":["https://www.allbirds.com"]})
for item in client.dataset(run["default_dataset_id"]).iterate_items():
print(item)JavaScript
import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: '<YOUR_APIFY_TOKEN>' });
const run = await client.actor('subimpact/shopify-store-products').call({"storeUrls":["https://www.allbirds.com"]});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);n8n
Use the Apify node (Run an Actor).
Actor ID: subimpact/shopify-store-products
Input JSON: paste the example input above.Limits
- Public catalogue data only, so password-protected and unpublished products are out of reach.
- WooCommerce rows have no createdAt or updatedAt because the Store API does not publish them.
- Requests are paced at one per second per store, so very large catalogues take a while.
- Some large brands block storefront JSON and return an error row.
Questions people ask
What does a product cost?
Each delivered product row costs $0.0005, which is $0.50 per 1,000 products, and the lowest tier is $0.35 per 1,000. Platform and residential proxy usage are included in that price. Store error rows and empty catalogues are free, so a store with a disabled endpoint costs nothing.
Do I need a login or API key?
No. The actor reads the public catalogue endpoints: products.json and collection JSON on Shopify, and the public WordPress Store API on WooCommerce. No cookies, session or key are used, and nothing is invented when a store leaves a value out.
Why is a residential proxy used by default?
Shopify rate-limits its public products.json per client IP, and datacenter ranges are limited almost immediately. Measured from Apify on one day, five of six stores answered 429 or 403 without a proxy, and five of six answered 200 through residential. The actor uses rotating residential IPs by default and the cost is included.
Are there rows per variant or per product?
One row per product, with a variants array carrying variant-level data. To get one row per variant, expand the array downstream. For WooCommerce, variations expose option values in their titles but not per-variation prices or stock, so those stay unavailable.
What currency are the prices in?
The store's own currency, reported in the currency field. A Shopify store selling in EUR gives EUR prices, and WooCommerce returns prices.currency_code per product. Unknown currencies come back null rather than guessed, and no exchange rate conversion is applied.
Which stores cannot be scraped?
Password-protected stores, stores that disabled products.json or the Store API, and stores that block storefront JSON with a 403. Each of those produces a free error row naming the HTTP status of each endpoint tried, and the other stores in the run still complete.
How long does a large catalogue take?
Requests run at most one per second per store, so time scales with catalogue size divided by page size: 250 products per Shopify request and 100 per WooCommerce request. maxItems caps the run, and a run that hits the account's paid event limit keeps and charges only the rows already delivered.
Need a data source that is not here?
We build and run scrapers for sites that have no public API. Tell us the site, the fields and how often you need them.