Woolworths Scraper for Product, Price and Label Data

Woolworths Product Scraper: Fields in Every Row

Our Woolworths product scraper reads two layers of the shop: the product tile on aisle, search and specials pages, and the product page behind it. Each product lives at /shop/productdetails/ followed by a numeric product id and a slug, and that id holds a row together from one run to the next.

• Identity - product id, product URL, the name as listed with its pack size (1L, 2L, 150g, 20 pack), brand, and the aisle and category of the listing where it was found.
• Price - the shelf price, the unit price exactly as the tile prints it per 1L, per 100G or per 1EA, and the was price together with the date attached to it.
• Price labels - Everyday Low Price, Lower Shelf Price, Seasonal Price, the SAVE amount, the Range was wording on reductions across a range, and bonus offers such as Container Bonus Credits.
• Placement - the Promoted label on sponsored tiles and the position of each product in the listing it was found in.
• Labels and nutrition - product details text, ingredients, allergens (Contains: Milk), the nutrition information panel per serving and per 100g or 100mL with servings per pack and serving size, storage directions, health and product warnings, the Health Star Rating and the country of origin label, for example Grown in Australia or the Australian Grown roundel.
• Reviews - star rating, review count, the rating snapshot from five stars down to one, and review text with its age; reviewer names are left out.
• Everyday Market - the Sold and shipped by partner name and the Specification block (brand, colour, material, dimensions) where the partner provides one.

Search and aisle pages return the same tile fields, so a run can start from a keyword list, a set of aisles or a list of product ids, and the label fields double as a food database for every product that carries them.

Woolworths Price Tracker and Price History

One pass shows today's shelf. A Woolworths price tracker comes from running the same product ids on a schedule: each run stores the shelf price, unit price, label and the dated was price, so the dataset builds a price history per product and shows when a Half Price special starts, when a Lower Shelf Price follows it and when the product returns to its regular price. Comparing Woolworths prices this week with last week becomes a filter, not a project.

Coverage reaches past single products. The Specials area is split into Half Price, Lower Shelf Price, Everyday Low Price, Seasonal Price, Buy More Save More, Bundles, Online Only Specials and Everyday Market Specials and Offers, each a listing of its own, so the Weekly Specials can be captured as a set. Aisle listings sort by price, unit price, name or New and filter by brand, allergens, Dietary and Lifestyle claims (Gluten Free, Halal, High Protein, Low Salt) and Health Star Rating; the In stock, Specials and Hide Everyday Market toggles separate the supermarket range from the marketplace.

Prices are the ones shown before a delivery address or store is chosen. Everyday Rewards member prices and Everyday Market shipping fees appear only after sign-in, so they are not in the default dataset; they can be added when a project runs on an account registered through the site's sign-up form or on yours.