compass.com is a brokerage storefront, not a listings portal: its own rows name the listing brand and office, and Coming Soon stock shows up here before the portals index it.
You set the scope: which states, metros, ZIP codes or neighborhoods, and which status sets - active for sale, coming soon, pending, recently sold, rentals, off-market records, or a combination. We build the crawler, run it on your schedule and deliver CSV, JSON, XLSX or an API endpoint. Field names, deduplication on the canonical property key and the MLS attribution string are agreed before the first run.
The engineering is ours. The city search grid on compass.com sits behind a bot check, while listing pages and the sitemap indexes behave, so coverage is assembled from the addressable sets rather than by paging a guarded results list. Anti-bot handling, proxy rotation and CAPTCHA solving are part of the managed service, along with adaptive pacing. We work only on pages a signed-out visitor can reach, we do not log in, and we do not claim a perfect success rate on any site.
Listing pages are server-rendered and complete in the first response: schema.org JSON-LD typed as RealEstateListing beside a full listing object. What we extract from Compass property pages:
MLS attribution travels with the record: every page carries a regional disclaimer with the MLS name, copyright and last-updated stamp, kept on each row.
Compass Exclusives is the part buyers ask about first, and the honest answer has two halves. Compass Coming Soon is public: those homes appear in the Compass Listings and Coming Soon grids with a badge, price, beds, baths, address and photos, and each city has its own coming-soon path under the for-sale slug. Square footage is often withheld and there is no days on market or price drop history yet - that is the point of the phase. Private Exclusives are not public. The site states plainly that those listings are private online and reachable only in a Compass office or by contacting Compass, so we do not promise them. A crawl delivers the Coming Soon set, still supply visible here before the portals carry it.
Underneath the live market sits a far larger off-market layer: property pages for homes that are not for sale, built from public records. They carry year built, beds, baths, square feet, lot size, county and parcel number, plus the last recorded sale price and date, but no MLS number, no photos and no asking price. In September 2026 the off-market sitemap index pointed to roughly 11,900 sitemap files of about ten thousand URLs each - national parcel coverage, not a brokerage catalogue.
The agent layer is the other thing only a brokerage site has. Agent profiles publish a bio, service areas and a transactions block with past sale prices, beds, baths and square footage; office pages list the roster. Names, photographs, email addresses and phone numbers are personal data and we leave them out by default, delivering office, team and brand level instead.
Compass is a residential real estate brokerage that publishes its own inventory at compass.com, and the site's own footnote credits RealTrends closed residential sales volume for its claim to be the country's largest independent brokerage. That distinction decides what a Compass scraper is worth. A portal sells audience to agents; a brokerage publishes what its agents actually hold, next to the MLS feed content it is licensed to display, on the same page and in the same record.
The about page describes the footprint as 96 markets, more than 400 offices and more than 33,000 agents. The licensing footnote is more precise: 34 states plus Washington, DC, trading under five brokerage entity names - Compass, Compass RE, Compass Real Estate, Compass Realty Group and Compass Carolinas.
The Terms of Service also name the affiliate brokerages that keep their own branding, among them @properties, Corcoran, Sotheby's International Realty, Coldwell Banker Realty, Christie's International Real Estate, Latter and Blum, Realty Austin, Ansley Real Estate, Washington Fine Properties, Launch Real Estate and OriginPoint. This shows up in the data: Compass-family listings carry a listOfficeGroup object with a brandName and a compassSubsidiary flag, plus a Listed By badge, while MLS records from outside brokerages arrive without it. That one object is a clean filter for whose inventory a row is.
Site navigation follows the same logic - Buy, Rent, Sell, then Compass Exclusives with its three tabs (Private Exclusives, Coming Soon, Compass Listings), New Development, and Agents. Those tabs are the part of the site no portal can copy, and they are where most of our Compass scraping briefs start.
Get a Quote
Developers
Customers worldwide
Pages extracted
Hours saved for our clients
€199 / one-time
setup fee - included
€169 / mo
setup fee €499
€229 / mo
setup fee €499
€349 / mo
setup fee €499
€549 / mo
setup fee €799
The reason to scrape Compass rather than a portal is that the brokerage layer is a field, not an inference. Because listOfficeGroup names the brand on Compass-family rows, a panel built from compass.com answers questions a portal feed cannot: how listing volume splits between Compass offices and the affiliate brands, which brands hold which price bands in a metro, and how the mix shifts month to month.
Pricing teams use the history array. Each event carries a timestamp, a status, a price and the source that reported it, so cuts, relists and contract dates can be reconstructed rather than estimated. For appraisal, iBuyer and lending models, the parcel number on every record ties a live asking price to county assessor data.
Brokerage and proptech vendors buy the office and agent layer as a market map. Office pages carry a street address and an agent count; agent location pages break the network down by state, county and city. For anyone selling title, mortgage, photography, CRM or transaction software into brokerages, that is the addressable market laid out by geography.
Rental teams get a separate view: rent is published with an available date, lease term, pet policy and furnished flag, so a Compass rent panel supports yield work that a sales-only feed cannot. And because Coming Soon inventory is published here days or weeks before it reaches the wider portals, a regular crawl gives an early read on supply in the markets you care about.
Monitoring of real estate listings on funda.nl, pararius.com, rentberry.com, rentola.com, and zimmo.be to support the growth of a European property portal.
Learn More
Daily detection of new private property listings in Switzerland on Homegate.ch and ImmoScout24.ch, giving the agency first access to high-value leads.
Learn More
Scraping residential listings from Immobilienscout24.de in Germany and Mallorca, including complete data and resized images.
Learn MoreLearn how to use web scraping to solve data problems for your organization
Real estate teams work in a fragmented data landscape. The sites that drive demand in Boston look nothing like the ones that matter in Berlin, São Paulo, Dubai, or Mumbai.
Real estate teams are operating in a data environment that is bigger, faster, and more fragmented than ever. Listings go live and disappear in hours, price cuts happen quietly, and the portals that matter most in each country are rarely the same global “top 5.”
Real estate web scraping: a powerful tool for data collection and analysis. Learn how to choose the right data collection method and benefit from real estate web scraping
ScrapeIt is a managed web scraping team. We have no affiliation with Compass, Inc. or with any of its affiliate brokerages, and we do not resell a stored dataset. You get a crawler built to your brief, watched when the site changes, and clean files or an API on the schedule you set. Layout changes on compass.com are handled as maintenance, not as a new project. Start with a sample for one metro, check the fields against your model, then scale to the states you need.
No. There is no public Compass API for data buyers, and no developer portal or key request. The site's robots file disallows the /api/ path outright, with two narrow exceptions for the similar-homes endpoints the site itself calls, and those want the page's own request payload rather than a listing id, so they are not a feed. Compass does publish sitemap indexes for for-sale, for-rent, recently-sold, pending, off-market, agent, office and neighborhood pages, which is what makes systematic coverage possible. If you need this as a dataset, scraping the public pages is the practical route.
Coming Soon, yes. Those homes are published on compass.com with a Compass Coming Soon badge, an asking price, beds, baths, address and photos before they carry days on market or price history, and each city has its own coming-soon page, so the set can be crawled and tracked. Private Exclusives, no. The site states that those listings are private online and available only in a Compass office or by contacting Compass, so they are not on public pages and we will not promise them. Anyone selling you a Private Exclusives feed is either logging in or reselling something they should not have.
Address, city, state, ZIP, county and coordinates; asking price, price per square foot and the charges block that splits annual taxes from monthly HOA and condo or co-op fees; beds, full and half baths, square feet, lot size, year built and property type; MLS number, MLS type and the originating feed; days on market and cumulative days on market; the full price and status history; photos with dimensions; amenities and the agent-written description; and the parcel number. Statuses run Active, Active Under Contract, Closed and Off Market, with Coming Soon and For Sale By Owner carried as badges. Rentals add available date, lease term, pet policy and furnished.
Coverage follows the brokerage footprint: 34 states plus Washington, DC, across 96 markets by the company's own count, with roughly 440 office pages and about 35,000 agent profile pages in the sitemaps as of September 2026. Scope is set by geography and status rather than by a result cap, because we build the address list from the sitemap indexes and slice by city, ZIP, neighborhood, school zone and price band where a listing grid is capped. Daily runs are normal for active inventory and coming soon; weekly or monthly is usual for sold and off-market history. Output is CSV, JSON, XLSX, a database drop or an API.
The Compass Terms of Service prohibit using automated processes to crawl or spider the site or to harvest or scrape content, and license the content for personal, non-commercial use. Separately, listing data displayed there is subject to MLS, IDX and VOW rules, and each page carries the originating MLS copyright and disclaimer. We work only on public pages, we do not log in or bypass access controls, we keep MLS attribution on every row, and we exclude agent names and contact details by default. What you may do with the data depends on your use and your jurisdiction, and we ask clients to confirm scope with their own counsel before a project starts.
Step 1 - Make a Request
You share your needs, expectations, and desired timeframe. We’ll suggest the best solution based on your request and budget.
Step 2 - Configuring Custom Web Crawlers
Our specialists configure the crawlers and extract a sample dataset for your review before proceeding with the full-scale extraction.
Step 3 - Collect and Deliver
Once you approve the sample, we launch the project and start full data collection. We gather, filter, and structure the data for easy use, delivering it on time in your preferred format.
Step 4 - Maintain and Support
Our team manages ongoing processes, monitors website changes, and supports all data extraction cycles. We can also help integrate data into your systems or create dashboards to simplify analysis.
Scrapeit Sp. z o.o.
10/208 Legionowa str., 15-099, Bialystok, Poland
NIP: 5423457175
REGON: 523384582
