UK property websites look alike: a search box, a postcode, a price in pounds. For a data buyer they are seven different datasets: two national portals, a portal built on agent membership, a site where landlords let without an agent, a flatshare site that lists rooms instead of homes, and two agency sites at the top of the market.
This post goes through the seven sites we have pages for: what each shows, what only it adds and what its data is best used for. Around the list: the fields that trip up a first import of UK listings, and how to merge several sites without counting a home twice.
For other countries, see our worldwide list of real estate websites to scrape and the guide to property portals by region.
Who this list of UK real estate websites is for
The list is for teams that order listing data: portals and proptech products enriching their own records, agencies watching competitor branches, investors tracking rent by district, lenders and valuers who need asking prices next to sale history. What such teams do with the data is shown in six use cases from our projects.
Few briefs need all seven: start with one national portal and add the source for the fields it lacks.
What UK property portals share and where they differ
Five of the seven are UK sites publishing in English and pricing in pounds sterling; Savills and Knight Frank are international, so their UK listings are selected first. UK listings carry fields that need a decision before the first run:
- Price qualifier. An asking price often comes with a label: Guide price, Offers over, Offers in excess of, Fixed price, POA. Keep it in its own column: "Offers over" and "Fixed price" mean something different in the Scottish market than a plain English asking price.
- Status. Available, Under Offer, Sold STC, Let Agreed. Sold STC means sold subject to contract: an offer is accepted, the sale is not complete, and the figure shown is still the asking price.
- Tenure. Freehold, leasehold or share of freehold. Years remaining on a lease, ground rent and service charge often sit in the description, not in a field.
- Council tax band and EPC rating. Published unevenly, so they are filled where shown and left empty where not.
- Postcode. Many listings show the outcode (the postcode district) instead of the full postcode. Plan geography on the district.
- Rent period. Per calendar month (pcm) or per week (pw): keep the published value and add a monthly figure.
- Identifiers. Every site numbers its own listings; no ID is shared between sites.
7 UK property websites worth scraping, site by site
The order follows how much of a typical UK brief a site covers on its own: broad portals first, rental specialists next, agency sites last. It is not a ranking of the sites' quality.
1. Rightmove: the national baseline
Rightmove is the largest real estate portal in the UK: residential sales, rentals and commercial property nationwide, each listing with the agent's office and branding. A listing gives address and postcode as published, asking price, status (available, under offer, sold STC), property type, bedrooms, bathrooms, floor area and the date listed. Around the listing sits context: property history with price changes and time on the market, average asking prices for the area, nearby stations, schools and council tax band. A search returns a limited number of result pages, so a national run is cut into areas small enough to list in full. Best for: price comparisons across postcodes and regions, tracking price drops and time on market. See the Rightmove scraper page.
2. Zoopla: sale history and estimates
Zoopla covers the same ground, sales and lettings across the UK, and is the site to pick when a listing has to arrive with market data. Next to the usual listing fields it shows the Zoopla Estimate, the platform's own valuation, and historical sale prices: the amount and date of earlier transactions. It shows the EPC rating, local detail such as crime levels and noise exposure and, where available, rental yield scores. Status reads listed, under offer, sold STC or let agreed; lettings state furnished or unfurnished. Keep the estimate in its own column: it is an opinion, not a price. Best for: valuation models, comparables, yield research. See the Zoopla scraper page.
3. OnTheMarket: agent instructions and price qualifiers
OnTheMarket is built on estate and letting agent membership: there are no private sellers, and every record carries the member branch's name, address and phone. Member agents can list here ahead of other portals, so an instruction often appears first, flagged "New" or "Only with us". Its listings are explicit on UK specifics: price qualifier, tenure including share of freehold, EPC rating, council tax band, ground rent and service charge where disclosed, latitude and longitude. The listing has no price timeline, so reductions and days on market come from comparing snapshots, and a listing that disappears without a Sold STC or Let Agreed flag is a withdrawal. Best for: tracking which branch won which instruction. See the OnTheMarket data scraping page.
4. OpenRent: UK rental listings direct from landlords
OpenRent is where private landlords let without a letting agent: owners list without agency fees and deal with tenants directly. A listing gives address and postcode as published, monthly rent, bedrooms, bathrooms, availability date, letting type, deposit and EPC rating, plus the landlord's preferences: pets allowed, bills included, student-friendly, furnished or unfurnished. Less obvious fields are the Rent Now marker and landlord verification badges. Two cautions: OpenRent listings can also be placed on Rightmove and Zoopla, so the same flat may arrive twice in a merged file; and landlords are private individuals, so their names and contact details are personal data and stay out of the default output. Best for: buy-to-let analysis and rent pricing models. More on the OpenRent scraper page.
5. SpareRoom: room rents and flatshare demand
SpareRoom is a flatshare site: its unit is a room in an occupied home. A three-bedroom flat can appear as three adverts with three rents, so room rents are never averaged with whole-property rents. The site has two sides: Rooms for Rent is supply, Rooms Wanted is demand, with a stated budget, area and move-in date. An offered advert gives the ad reference, postcode district, rent with its period, deposit, bills included, minimum term, room type and the advertiser's role: current flatmate, live in landlord, live out landlord or agent. Search results are capped, so wide areas are collected in slices. Names, photographs and profile links are excluded by default. Best for: room rent benchmarks for HMO, co-living and student housing. See the SpareRoom scraper page.
6. Savills: prime, rural and commercial stock
Savills is an estate agency, not a portal: its site lists the firm's own instructions, from penthouses to farmland estates, retail parks and development plots. It adds the top of the market plus rural and commercial stock. A listing gives price, property type, floor area, land area, bedrooms or units, ownership type (freehold or leasehold), energy efficiency rating and a listing ID; commercial listings add yield, tenancy status and usage tags. Tags such as "New to Market", "Recently Reduced" and "Coming Soon" work as status fields. A new development can be published as one listing with a price range and a bedroom range, so such rows are stored apart from single homes. Best for: prime benchmarks, land, commercial yields. See the Savills scraper page.
7. Knight Frank: prime homes and new developments
Knight Frank is the second agency site: like Savills, it lists the firm's own instructions. Its international hub is knightfrank.com; UK listings sit on knightfrank.co.uk, priced in GBP. A listing gives title and long description, price, property category (mansion, penthouse, estate, new development), square footage, plot size, bedrooms, bathrooms, street address, a listing ID and an internal reference code. Deeper fields are construction year, renovation status, energy rating, leasehold or freehold status, amenities such as concierge or gated entry and, where a property is co-listed, the partner's branding, which matters for merging: a co-listed home may be advertised by two firms. Best for: prime pricing per square foot, new development tracking. See the Knight Frank scraper page.
Get Real Estate and Housing Data
Observe the real estate marketplace and decide the finest time to purchase or sell depending on data.
- Free Sample Data Sets
- Regular Data Delivery
- Legal and GDPR compliance
Get a Quote
Combining UK property listings from several sites into one dataset
The same home can be on several of these sites: an agent can advertise one instruction on more than one portal and on the agency's own site. Count rows across sites and supply is overstated. Three rules keep a merged file honest:
- One schema, source kept. Every row gets the source, the site's own listing ID, channel (sale or let), record type (whole property, room, development, wanted advert), price, price qualifier, rent with its period, status in one vocabulary beside the published label, tenure, EPC rating, council tax band, outcode, first seen and last seen.
- Match, do not delete. To remove duplicate listings across property portals, rows are matched on outcode or postcode, property type, bedrooms, agent branch and price. Matched rows receive a common property key and all source rows stay, because each site holds fields the others lack.
- Keep the grains apart. Rooms, wanted adverts and developments published as one listing never enter the same average as whole properties.
What our property projects taught us about multi-site data
None of the three projects below was in the UK; the problems are the ones a UK build meets.
- Five sites, one structure. A European property portal had us monitor five sites daily, among them Funda and Pararius in the Netherlands and Zimmo in Belgium, at about 230,000 rows per day. Each site described a property in its own way, so the unified structure was part of the deliverable; setup and launch took 3 weeks. A seven-site UK file is the same job with tenure, qualifiers and rent periods added. Case: five EU property sites in one structure.
- Private or agent. In Switzerland an agency needed new listings from private sellers on Homegate and ImmoScout24 every workday at 7 a.m., around 85,000 rows per day. A meaningful share of listings that looked private came from agents hiding their affiliation, so we built a filtering layer to separate them. On SpareRoom the advertiser's role, stated on the advert, answers the same question and changes what a row means. Case: private listings in Switzerland delivered daily.
- Unit level, every day. In Massachusetts, United States, we collect Zillow for-sale and rental listings daily at unit level, approximately 22,000 rows per day. A crawler that stops at the building page returns plausible totals with the units missing. The UK form of that trap is a development or a shared house counted as one home. Case: Massachusetts for-sale and rental data refreshed daily.
How ScrapeIt collects UK property data
ScrapeIt is a managed service: we build, run and repair the crawlers. You name the sites, the outcodes or counties, the fields and the refresh interval. Anti-bot handling (pacing, proxy rotation, CAPTCHA handling, rendering) is part of the service, so the question of which proxies are recommended for scraping Zoopla and Rightmove never reaches you. We never log in and never go behind paywalls.
A project starts with a free project assessment, and you can order a data sample before the full run. Field documentation comes with the dataset; runs are one-off or on the schedule you set. Plans start from EUR 169 a month, or EUR 199 for a one-time extract.
Formats are CSV, Excel (XLSX), JSON, JSONLines and XML, delivered through our API (an endpoint we host), a JSON feed, FTP, SFTP, Amazon S3, Google Cloud Storage, Dropbox, Google Drive, e-mail or a load into your database; an MCP server is available on request. See the real estate data scraping service, the list of property portals we scrape and all UK sites we scrape.
FAQ
What are the best UK property websites to scrape?
Rightmove and Zoopla give national sales and lettings coverage, and OnTheMarket shows agent instructions early. For rents, add OpenRent for landlord lettings and SpareRoom for rooms. Savills and Knight Frank add prime homes, and Savills also rural and commercial stock.
Is it legal to scrape UK property websites?
We collect only publicly available data - everything a visitor can see on the site - and we collect it legally. Names, phone numbers and e-mail addresses of private landlords and room advertisers are personal data: we handle personal data under GDPR and leave such fields out by default.
Can I get UK property data through an API?
Yes, through ours. We host an endpoint that returns the collected listings as JSON (price with its qualifier, status, tenure, EPC rating, postcode, agent branch), refreshed on the schedule you set. The same data also comes as files.
How often should UK property listings be refreshed?
Daily when the value is in a change: a new instruction, a price reduction, a flip to Sold STC or Let Agreed. Weekly is enough to measure supply and asking prices by district. Where a site shows no price timeline, price history starts with your first run, so start early.