Dealer-Ready Datasets with Every Parameter That Matters

A European car dealer came to us with a simple brief and a demanding definition of the word "complete": follow two large automotive portals every day, and bring back everything the vehicle page says, not just the headline numbers. The two sources are car.gr, which covers the Greek car market, and autoscout24.com, which we track for the Italian market.

The questions behind the brief are commercial: what each model is priced at, what competitors list, how prices change, and how long an ad stays online. The last one tells the dealer how long a car may wait for a buyer at a given price, and only a daily record can answer it.

Sources: car.gr, autoscout24.com
Coverage: Greek and Italian car markets; four car.gr sections (cars, motorcycles, boats, vans) and three on AutoScout24 (cars, motorcycles, vans)
Frequency: daily, weekends included: car.gr since December 2023, AutoScout24 since April 2024
Volume: just over 400,000 rows per day
Delivery: daily CSV files on SFTP, in place before the client's automated import at 4:30 in the morning
Setup and launch: 9 working days

A car is not five fields, it is a long list of parameters

Plenty of vehicle monitoring projects stop at a handful of headline fields. This one does not. The dealer asked for all available technical specifications published on a vehicle page, plus the seller behind the listing and the purchase options attached to it.

That single requirement is what makes this project unusual on our side. Cars are described by a large number of technical parameters, so the resulting datasets are among the widest we produce. A car is bought or passed over because of the specific combination of parameters it carries, and knowing who is selling it and on what terms is part of the same decision.

Daily frequency was a choice, not a compromise

The crawl frequency could be set by what the business actually needed, so each portal went onto a daily cycle from its first delivery, with a complete file every day.

Duplicates were the other trap. The first full walk of the Italian car listings on AutoScout24 returned 473,500 links to vehicle pages, but only 373,800 were unique, because the result pages repeat the same cars. Counting links instead of vehicles would have inflated every statistic built on top. The rest of the effort went into reaching every parameter block on a vehicle page, so that the same field means the same thing on both portals.

Nine working days from brief to a running pipeline

Setup and launch took 9 working days, covering the full specification structure and the daily schedule. The second portal followed the same path: the first full AutoScout24 set, 410,000 unique rows in 41 files, was delivered on 1 April 2024, and daily delivery started on 26 April.

Ready for the dealer's import at 4:30 every morning

The client's import job picks the files up from SFTP at 4:30 in the morning, local time, and loads the previous day's data into its databases. Each day's files are named for the next morning and uploaded well before that hour.

An automated import is less forgiving than a human reader. In June 2025 stray quotes inside ad text stopped whole car.gr files from loading. We changed how the CSV files are packed so quotes can no longer break a row, and cleaned the numbers: prices as integers with price-on-request left empty, mileage and horsepower without units, engine size in cc, and the 3.5% of values given in kW left empty.

What the dealer has now

Every day, just over 400,000 rows are collected, covering two national markets at once. Each row carries the full set of technical specifications published for that vehicle, with seller information and purchase options. Daily car.gr files have arrived since 27 December 2023 and AutoScout24 files since 26 April 2024: close to three years of car.gr history, the record needed to see how long a car waits for a buyer at a given price.

See our car.gr scraper, our AutoScout24 scraper, and automotive data scraping, or contact us to set up a daily feed of your own.