The Entire Iherb Supplements Catalog, Captured End-to-End in 3 Days
Scraping supplement products from iHerb.com with full details, including descriptions and packaging variations.
Learn MoreOne B&H Photo listing can carry eighty spec rows, three separate identifiers and a used copy graded by wear. We pull the whole record, not the headline price.
A B&H Photo scraping project starts with three decisions. Which departments or leaf shelves set the scope, since one shelf such as mirrorless cameras holds roughly 4,100 items at twenty-eight to a page. Whether used and open box copies are wanted beside new stock, since those are separate records with their own ids and grading. And how MAP lines should be reported when no selling figure is published.
Two things shape the schedule. Only clean category and product paths are open to crawlers; sorted, filtered and paged views sit behind query strings the site closes, so depth comes from the sitemap files and from narrowing the category tree rather than paging a shelf. The storefront is closed to automated clients at the edge, so anti-bot handling, proxy rotation and CAPTCHA solving are part of the service rather than an add-on. Delivery is CSV, JSON, XLSX, a database drop or an endpoint we host, with a run timestamp per row.
Three numbers sit in the header of a listing and they do different jobs. The BH # is the internal item code, alphanumeric rather than a digit run: CAERPB on a Canon body, SO100400568 on a Sony lens. MFR # is the manufacturer catalogue number, 3380C002 and SEL100400 on those two, and the UPC repeats as gtin12 in the markup. Underneath, the record is keyed by a numeric skuNo plus an itemSource of REG for new stock or USE for used, and that pair is what a B&H Photo data extract joins on.
The Used department is a shop inside the shop. It has its own tree of shelves whose names begin with used, its own landing split into Buy Used, Sell Used, FAQs and a Museum, and its own grading scale. Condition comes through as a code and a phrase: 10 Good as new, 9+ Little to no signs of wear, 9 Minor surface marks, 8+ Moderate wear, 8 Well used, and OB for Open Box - Like New. Used records carry spec lines that new ones never have, shutter count on camera bodies among them, plus a warranty line reading B&H 90 Days, while open box units carry a limited one-year B&H warranty instead. The page shows the used price, the new price and the saving side by side, links across to the new item, and says plainly when the photograph is illustrative rather than the unit for sale.
Around the catalogue sit object types worth collecting in their own right. Comparison pages set two or three models against each other on one address and fill fifteen sitemap files of their own. Accessory finders turn a shelf into a compatibility list built around a single host product, with its own item count and its own facets. Explora publishes reviews and news under named authors, and those articles are attached to the products they discuss. Protection plans, leasing quotes, rebate forms with expiry dates, trade-in offers, gift cards, EDU and B2B modes, and a currency selector that shows non-USD estimates while charging in dollars all hang off the same item records, which is why teams that extract B&H Photo data usually take more than the price line.
B&H Photo Video sells from a single Manhattan SuperStore at 420 Ninth Avenue and one storefront, bhphotovideo.com, trading since 1973 under the line The Professional's Source. The top navigation is the department map any B&H Photo scraper starts from: Photography, Computers, Pro Video, Lighting, Pro Audio, Drones, Camcorders, TVs and Entertainment, Audio-Visual, Optics, Mobile, Surveillance, a More drawer, a Used department and a Specials shelf. The mix is professional rather than general retail: camera bodies and lenses, cine rigs, microphones and desks, lightstands and softboxes, workstations, binoculars and telescopes.
Addressing is stable and easy to key on. A product sits at /c/product/ plus the item number, the suffix -REG and a slug, as in /c/product/1459282-REG/canon_eos_rp_mirrorless_digital.html. A department page sits at /c/browse/ with a name, /ci/ and a category id, usually with /N/ and a navigation token; a leaf shelf sits at /c/buy/ with the same ci pattern. Second-hand stock has a path of its own, /c/used/ plus an id and slug. Two more object types have addresses of their own: an accessory finder at /c/accessories/ that pins a whole shelf to one host product, and a model-versus-model page at /c/compare/ where the compared items are joined in a BHitems segment.
The sitemap index sets the scale. Measured in September 2026, product addresses run to about 450,000 across thirty-nine files of 12,000 lines each, with three more files for items no longer stocked. One file holds roughly 775 browse categories and another about 3,900 leaf shelves; a third lists accessory finders, and fifteen files carry nothing but comparison pages. Beside them sit YouTube and Vimeo video sitemaps and a separate sitemap for Explora, the B&H editorial hub.
Get a QuoteDevelopers
Customers worldwide
Pages extracted
Hours saved for our clients
€199 / one-time
setup fee - included
€169 / mo
setup fee €499
€229 / mo
setup fee €499
€349 / mo
setup fee €499
€549 / mo
setup fee €799
Depth is the reason buyers come here first. Where a general retailer publishes six bullets, a listing here carries the manufacturer's full grid - sensor size and crop factor, ISO ranges split between stills and video, internal recording modes with bitrates, every port on the body, viewfinder magnification and eye point, operating range, materials and tripod thread. Teams scrape B&H Photo to enrich a catalogue rather than only to watch a rival, because one address turns into dozens of clean, comparable attributes.
Price needs care, because the site deliberately withholds one on some lines. B&H signs minimum advertised price agreements with suppliers and explains the consequence under its own Why No Price heading: it may sell an item at any price but may not advertise it below the figure the supplier sets. Those records arrive with the selling figure suppressed and only a crossed-out regular price and a saving amount visible, the buy control switched to a mode that reveals the number in the cart. In a B&H Photo price feed a blank is a MAP flag, not a missing value.
Condition and warranty split one model into several sellable things. An Authorized Dealer badge, a USA Warranty filter and a separate B&H Warranty label for imported stock mean a single MFR number can appear as a US-warranted item, an imported one, a used copy graded 9, an open box unit and a kit. Configuration does the same: a body sells as Base, with a lens kit, with a web streaming bundle, each with its own item key, so honest comparison has to match configuration before it matches model.
Scraping supplement products from iHerb.com with full details, including descriptions and packaging variations.
Learn More
Daily scraping of lowest prices for 150K products on Allegro.pl to support marketplace pricing and margin optimization.
Learn More
Regular monitoring of Ralph Lauren clothing, footwear, and accessories sold across Amazon subdomains: AE, DE, ES, FR, IT, NL, PL, UK.
Learn MoreLearn how to use web scraping to solve data problems for your organization
If you sell online, run a marketplace, or advise e-commerce clients, you already know why eBay matters: it’s one of the few places where big retailers compete side by side with thousands of small merchants and private sellers.
E-commerce teams do not just need “some” competitor data anymore. They need a continuous stream of real prices, discounts, stock levels, reviews, and seller behavior from the platforms that actually shape their markets.
Amazon provides valuable information gathered in one place: products, reviews, ratings, exclusive offers, news, etc. So scraping data from Amazon will help solve the problems of the time-consuming process of extracting data from e-commerce.
ScrapeIt takes the whole job as a managed service. We design the crawler, run it to your cadence, watch it, and repair it when the storefront changes shape. Your side receives files or an endpoint and keeps no scraping engineers of its own.
We are not affiliated with B&H Photo Video. We read the site's robots rules before planning a run and stay out of the paths they close, internal search, cart and checkout among them. Nothing behind a login is touched, so account pricing and order history stay out of scope, and reviewer names, nicknames and photographs are left out by default.
No. There is no developer portal and no documented B&H Photo API: the addresses a developer reaches for first do not resolve, the storefront's own JSON endpoints are closed in the site's robots rules, and the affiliate side is a partner console behind a login rather than a catalogue feed. What is public is the storefront itself - product, category, used, accessory and comparison pages, together with the sitemap files. We build a B&H Photo API on exactly that and hand it over as a documented endpoint with a stable schema and a fixed field list.
The identifier block first - BH item code, MFR number and UPC, plus the numeric sku and its REG or USE source - then brand, title, canonical URL, breadcrumbs, the full specification groups, the included-items list with its linked SKUs, price and strikethrough price, the savings breakdown, stock status, store availability, warranty and protection plans, ratings, question counts and compatible models. Join on MFR number against a vendor catalogue, on UPC for cross-retailer comparison, and on the BH item code when you need a key that survives a title rewrite.
That is a minimum advertised price line and we report it as one. The record still carries a crossed-out regular price, a saving amount and a buy control set to reveal the figure in the cart, so the row goes out with the regular price, the saving, and a MAP flag set, with the selling price left empty rather than guessed. We do not add items to a cart or work through checkout to force a number out. Where a supplier lifts the restriction the price reappears in the normal field and the flag clears on the next run.
It affects orderability, not the catalogue. The store closes early on Friday, stays closed Saturday, and publishes a two-year holiday calendar with windows that can run over a week, while checkout itself is described as open 24/6 and shuts from Friday afternoon until Saturday night. Pages stay readable throughout, but the item record carries a business status for online orders, phone orders, customer service and the NYC store, and the buy control changes state, so a run that spans the closing writes availability fields that describe the shop rather than the product. We schedule around it and stamp the status on the row.
We collect only pages an ordinary visitor is served, at polite request rates, and we follow the site's published robots rules. Nothing behind a login is touched, so account pricing, order history and saved gear lists are out of scope. Reviews and questions carry nicknames; we keep the rating, the counts and the text and leave reviewer identities out by default. The B&H user agreement restricts page-scraping, robots, crawlers and other automatic devices without written consent, so we scope each project with the client and their counsel rather than making a blanket legal claim.
Step 1 - Make a Request
You share your needs, expectations, and desired timeframe. We’ll suggest the best solution based on your request and budget.
Step 2 - Configuring Custom Web Crawlers
Our specialists configure the crawlers and extract a sample dataset for your review before proceeding with the full-scale extraction.
Step 3 - Collect and Deliver
Once you approve the sample, we launch the project and start full data collection. We gather, filter, and structure the data for easy use, delivering it on time in your preferred format.
Step 4 - Maintain and Support
Our team manages ongoing processes, monitors website changes, and supports all data extraction cycles. We can also help integrate data into your systems or create dashboards to simplify analysis.
Scrapeit Sp. z o.o.
10/208 Legionowa str., 15-099, Bialystok, Poland
NIP: 5423457175
REGON: 523384582