Dun and Bradstreet Scraper for Open Business Directory Data

Dun and Bradstreet sells its data by the block and by the seat, yet its Business Directory shows each company's outline to anyone. We turn that open layer into a clean company dataset with no people in it.

Plans from €169/month · Free project assessment · Reply within 1 business day

Dun and Bradstreet Scraper
Solutions

Dun and Bradstreet Data Scraping, Run by ScrapeIt

ScrapeIt runs Dun and Bradstreet data scraping as a managed service: we build the collector, run it on our own infrastructure and repair it when the directory changes. The directory is a single-page application, so pages are rendered as a browser sees them, and anti-bot handling, proxy rotation and CAPTCHA solving are part of the service. How to scrape Dun and Bradstreet well is mostly planning: we walk the industry and geography tree, cut every list below the 40-page limit, deduplicate on the profile token and keep the reliability tags. We extract Dun and Bradstreet data from open pages only, with no login, no profile unlocks and nothing from the contact directory. A sample comes first; then the feed runs weekly, monthly or quarterly and arrives as CSV, JSON or XLSX, or lands in S3, SFTP or your warehouse.

Dun and Bradstreet Dataset: Fields on an Open Company Profile

Every profile is built from one template, and we keep D&B's own labels, so the firmographic data lines up with anything else your team takes from D&B.

  • Identity. Company name, Doing Business As name, the profile token from the page address and the company's role in its group: Global Headquarters, Subsidiary, Branch or Independent. The token is an encrypted form of the D-U-N-S number: it identifies the company without revealing the number, so it serves as the join key between runs.
  • Location. Street address, town, state or province, postcode and country, plus the region and city under which the directory files the company.
  • Industry. The NAICS chain from sector to industry, the line of business in plain words, such as Single-family housing construction, and the related industries in the same sector. List pages also show the NAICS code of the industry they cover.
  • Size. Employees (this site), Employees (all sites) and revenue in US dollars, each tagged Actual, Estimated or Modelled. Headcount comes as a band such as 1-24, 25-99 or 10,000+, and revenue shows as a figure for some companies and stays masked for others. Modelled revenue is D&B's own estimate from analytical models, not a filed figure, and the tag travels with every value we deliver.
  • Description. A short company summary; where D&B generated it, the page names the source as AI-generated content, and we keep that flag.
  • Added by the company. Hours, languages spoken, payment methods, tagline, logo and social links, filled in by firms that claimed their listing. D&B keeps these out of the credit file.

The Corporate Family block shows the company's role openly, but the name of the global headquarters and the counts of family members, subsidiaries and branches stay starred out until a free sign-in unlock. The D-U-N-S number itself, credit scores such as PAYDEX, financial statements and contact lists also sit behind sign-in, a credit report or Hoovers. We collect none of that and no names of principals or employees: a record is a company, never a person.

Dun and Bradstreet Dataset: Fields on an Open Company Profile
Where Dun and Bradstreet Company Data Pays Off

Where Dun and Bradstreet Company Data Pays Off

Market sizing. Counting profiles by NAICS industry, state, city and size band gives a bottom-up picture of a market, and a Dun and Bradstreet list of companies for one industry in one state is the usual first delivery. Branches carry profiles of their own, because D&B assigns its numbers per location, so a count of firms needs the headquarters flag and a count of sites does not.

Supplier discovery and supplier risk screening. Procurement teams pull every candidate maker in a region with its size, industry and headquarters status before they pay for credit reports on the shortlist. The directory narrows the field; the scores stay with D&B.

CRM cleanup and entity resolution. Matching your account list to directory profiles by name and address adds industry, size band and group role to each row and exposes duplicates that are really branches of one company.

Details that change the numbers. Employees (this site) and Employees (all sites) must never be added together. A Modelled figure and an Actual one are different kinds of fact, so the tag gets its own column. Each list stops after 40 pages, so a large industry is covered by slicing it by region, city and size band until every slice fits. Profile addresses have already changed format once, so the token, not the full URL, is the stable key.

Inside the Dun and Bradstreet Directory: Industry, Country, Region, City

Dun and Bradstreet is a commercial data company based in Jacksonville, Florida. What services does Dun and Bradstreet provide? Business credit reports and scores, sales intelligence in D&B Hoovers, and the D-U-N-S number that keys all of it. A Dun and Bradstreet scraper works on the one layer that is open to any visitor: the D&B Business Directory at dnb.com/business-directory, where companies from the database get a public profile page. In September 2026 D&B put its records at more than 640 million organizations in over 250 markets.

The directory is a tree. Dun and Bradstreet company information pages list firms by industry and country, then by region and city: company-information.construction.au.australian_capital_territory.canberra.html is construction in Canberra, and ?page= walks the list. Newer lists, the United States first, use /business-directory/ plus the country code, an optional state and city, the industry and /companies, with band segments such as revenue-1b-plus or employees-10000-plus and an isHq switch for headquarters only. The Dun and Bradstreet industry list behind every path follows NAICS from sector to subsector to industry, and industry analysis pages add top companies, movers and shakers and a geographic split per industry.

A profile address joins /business-directory/company-profiles, a name slug and a hexadecimal token, with slashes on the newer pages and dots plus .html on the older ones. Dun and Bradstreet directory search works by company name with a country filter. German, Austrian, Swiss, Hungarian and Polish editions publish directory sitemaps of their own, and the global directory reaches far beyond the United States.

Get a Quote
dev_w
25

Developers

customers
500+

Customers worldwide

pages
1 500 000 000+

Pages extracted

stime
15000+

Hours saved for our clients

Plans

Dun and Bradstreet Scraping Plans and Pricing

Airplane

€199 / one-time

setup fee - included

Data limits100,000
Frequencyone-time
Run timeup to 5 days
Data storing7 days

Helicopter

€169 / mo

setup fee €499

Data limits250,000
Frequencymonthly
Run timeup to 5 days
Data storing14 days

Glasses

€229 / mo

setup fee €499

Data limits1,000,000
Frequencyweekly
Run timeup to 5 days
Data storing30 days

DNA

€549 / mo

setup fee €799

Data limits3,000,000
Frequency3 times daily
Run timesame day
Data storing90 days

Why Teams Scrape the Dun and Bradstreet Directory

The open directory answers market questions that no single profile does. Take a question such as which medical device makers in Ohio sit in which headcount band, asked again every month. The open directory already publishes industry, place and size for that answer, and a scraped feed returns it for the whole market: company name and address, the NAICS chain and line of business, Employees (this site) and Employees (all sites), revenue with its Actual, Estimated or Modelled tag, and the company's role in its group, priced by volume and refresh rate.

A stored series adds what the page does not keep. D&B revises its records continuously and the open page shows no change log, so only repeated runs show which profiles were added, which size bands moved and which companies dropped out.

The same rows also come through the ScrapeIt Dun and Bradstreet API, an endpoint we host with access by key, and Dun and Bradstreet API documentation for every field comes with the dataset. Dun and Bradstreet API pricing is part of our Dun and Bradstreet price list: plans start from EUR 169 a month, or EUR 199 for a one-time extract.

Our Blog

Reads Our Latest News & Blog

Learn how to use web scraping to solve data problems for your organization

What is the Scraping Web Data for Sentiment Analysis & How it Helps Marketers and Data Scientists

What is the Scraping Web Data for Sentiment Analysis & How it Helps Marketers and Data Scientists

The use of sentiment analysis tools in business benefits not only companies but also their customers by allowing them to improve products and services, identify the strengths and weaknesses of competitors' products, and create targeted advertising.

Empower Your Business with Google Maps Data

Empower Your Business with Google Maps Data

Using web scraping to extract Google Maps data will help you quickly and efficiently find businesses in any industry, city, state, or region. And the extracted contact information, such as phone or email address, social networks, or links to web pages, will help to contact them.

How to Generate Business Leads Using Web Scraping

How to Generate Business Leads Using Web Scraping

Lead scraping is a reliable way to get the right customer contacts to market your product, saves organizations time, and helps you better understand the audience you want to attract. Contacts include emails, phone numbers, or social media profiles.

scrapeit logo

Working With ScrapeIt on Directory Data

ScrapeIt is a managed web scraping agency. From D&B we deliver company-level firmographics: industry, place, size and site type, shaped so they join cleanly to your CRM or to other sources. Storefront details such as opening hours, phone numbers and reviews come better from Yellow Pages, Yelp or Google Maps, which we also cover; D&B is the source for size, industry codes and structure. Pricing follows the number of profiles and the refresh rate, agreed in writing before the first run.

FAQ

Do you offer a Dun and Bradstreet API?

Yes. The ScrapeIt Dun and Bradstreet API returns company name, address, NAICS industry and line of business, employee and revenue figures with their Actual, Estimated or Modelled tags, and the company's role in its group as JSON from an endpoint we host, refreshed on the schedule you set. The same data also comes as CSV or XLSX files or straight into your database.

Is Dun and Bradstreet free, and how much does a Dun and Bradstreet database cost?

Browsing the Business Directory and requesting a D-U-N-S number cost nothing, and a free sign-in unlocks extra profile details for a limited number of companies for 30 days. A Dun and Bradstreet database built by ScrapeIt from the open directory is priced by volume and refresh rate: plans start from EUR 169 a month, or EUR 199 for a one-time extract, and the project assessment is free. It holds only what the open pages show.

Is a DUNS number the same as Dun and Bradstreet data, and do you deliver it?

No. The DUNS number, short for Data Universal Numbering System, is a nine-digit identifier that D&B assigns to each business location and uses as the key to its credit file; Dun and Bradstreet is the company that issues it and sells the data attached to it. The open profile does not print the number; it offers it with a paid credit report, so our extract carries the profile token instead. If you already hold the DUNS numbers for your list, we match our rows to it by name and address.

How often can Dun and Bradstreet data be refreshed, and in which formats?

Firmographics move slowly, so most projects refresh a full directory slice monthly or quarterly and a watchlist of key companies weekly. D&B revises its records continuously and the open page shows the latest version without a change log, so every row carries its collection date and each run flags new profiles, size bands that moved and companies that dropped out. Delivery is CSV, JSON, JSON Lines or XLSX, pushed to S3, SFTP, cloud storage or your warehouse, one row per profile with reliability tags in their own columns.

Is it legal to scrape Dun and Bradstreet, and what do you leave out?

Yes. We collect only publicly available Dun and Bradstreet company data - everything a visitor sees in the Business Directory: company name, address, NAICS industry and line of business, employee and revenue figures with their Actual, Estimated or Modelled tags, and the company's role in its group - and we collect it legally. We leave out everything behind sign-in, a credit report or Hoovers, such as the D-U-N-S number, credit scores and contact lists, and never collect names of principals or employees.

How does it Work?

Step 1 - Make a Request

You share your needs, expectations, and desired timeframe. We’ll suggest the best solution based on your request and budget.

Step 2 - Configuring Custom Web Crawlers

Our specialists configure the crawlers and extract a sample dataset for your review before proceeding with the full-scale extraction.

Step 3 - Collect and Deliver

Once you approve the sample, we launch the project and start full data collection. We gather, filter, and structure the data for easy use, delivering it on time in your preferred format.

Step 4 - Maintain and Support

Our team manages ongoing processes, monitors website changes, and supports all data extraction cycles. We can also help integrate data into your systems or create dashboards to simplify analysis.

Request a Quote

Tell us more about you and your project information.
Which sites, which fields, how often. A couple of lines is enough.

We reply within 1 business day. No obligation.

scrapiet

Scrapeit Sp. z o.o.
10/208 Legionowa str., 15-099, Bialystok, Poland
NIP: 5423457175
REGON: 523384582