On data.gouv.fr each resource shows its Modifiée le date and many add a sha1 checksum, so a quietly replaced file can be caught. Our data.gouv.fr scraper watches the datasets you follow.
Plans from €169 a month · Free project assessment · Reply within 1 business day
CSV · Excel · JSON · XML · FTP · SFTP · Amazon S3 · Google Cloud
API, JSON feed or CSV, XLSX and JSON files
ScheduleOne-time, monthly, weekly, daily or 3 times a day
data.gouv.fr pages, filters, fields and a schedule
Built, monitored and repaired by our team
API, JSON feed or CSV, XLSX and JSON files
Pick what we should follow: the datasets your models depend on, everything one ministry or collectivité publishes, a theme such as transport or elections, or the whole catalogue once a week. We build the crawler, run it on your schedule and repair it when data.gouv.fr changes its pages; page rendering, pacing and proxy rotation are part of the work, not something you arrange.
Deliveries keep the platform's own identifiers - the dataset id and the resource id - so each run updates the same rows and a change shows up as a change. A free project assessment first tells you which producers and datasets a run will cover, and the column descriptions travel with the first file.
A dataset page on data.gouv.fr is a card of metadata with a list of resources under it. We read the card, the Informations tab and every resource, and deliver them as linked tables: one row per dataset, one per resource.
The catalogue describes public bodies and their files, so it rarely touches personal data. Where a discussion post or a reuse carries a person's name, it stays out by default under GDPR.
Single pages are the easy part. A useful feed is about coverage, and about what moved since the previous run.
data.gouv.fr is the French state's catalogue of public datasets, a product of the Direction interministérielle du numérique (DINUM). Its menu separates Données (the jeux de données, or datasets), Réutilisations (projects built on the data) and Organisations (the producers). Each dataset page has tabs for its files, its reuses, its Discussions with users and an Informations panel of metadata.
The producers range widely. National bodies publish reference sets such as the Demandes de valeurs foncières (DVF) and the Plan Cadastral Informatisé of the Ministères économiques et financiers, the Sirene files of companies and establishments from Insee, or the road accident databases of the Ministère de l'intérieur. Collectivités territoriales publish local data, and companies, associations and individual users publish as well.
For a buyer, what matters is that the catalogue moves. Datasets are created and files replaced on rhythms as different as DVF, refreshed in April and October with every earlier file replaced at once, and an Insee polling-station file announced for renewal every five years. Metadata scores shift, and reuses and discussions pile up.
Delivery: CSV, JSON or XLSX files, our API or a JSON feed. MCP server on request.
Full plan detailsFor many teams data.gouv.fr is infrastructure, and infrastructure needs watching.
Learn how to use web scraping to solve data problems for your organization
Data scraping is the wide term that includes documents, scans and old screens; web scraping is the part that works on websites. We compare sources, daily work, output and cost drivers, give a briefing checklist and walk through two of our projects.
Leveraging advances in technology, the AI-powered web scraper has skyrocketed in demand and is helping to expand capabilities by automating tedious daily tasks and speeding up data collection from thousands of websites several times over.
Web scraping is a method of obtaining web data by extracting it from pages of web resources with the help of a program, that is, in automatic mode. It is used to syntactically convert web pages into more usable forms.
ScrapeIt builds, runs and repairs crawlers as a managed service and hands over what they collect. Catalogue work like data.gouv.fr is less about volume than about bookkeeping - stable ids, dates and checksums compared run after run - so that "what changed this week" always has an answer. You pick the producers, themes and schedule; the crawling, the parsing and the checks that each run lines up with the last are on our side.
Still unsure? Write to info@scrapeit.io
Yes. The ScrapeIt data.gouv.fr API returns dataset ids, titles, producers, declared frequency, last update dates and resource checksums as JSON from an endpoint we host, refreshed on the schedule you set. The same records also arrive as CSV or XLSX files, through SFTP or Google Cloud Storage, or loaded into your database.
Yes. Dataset pages, resource details, reuses and discussions on data.gouv.fr are shown to every visitor without an account. We collect only publicly available data - everything a visitor can see on data.gouv.fr - and we collect it legally.
Each producer declares its own Fréquence - for DVF it reads Deux fois par an (twice a year) - and some datasets drift from what they declare. We record the declared Fréquence next to the real Modifiée le dates of every resource, so a daily or weekly run shows both the update and any delay.
Yes. We follow the organisation page and every dataset under it, and each run reports new datasets, replaced or added resources with their old and new Modifiée le dates and checksums, changed coverage or frequency, and new reuses or discussion threads. The report arrives as a change table next to the full snapshot.
Yes. For tabular resources we deliver the rows themselves under the column names the preview shows, and we can merge files that split one series by year or month into a single table. Every row carries the dataset and resource ids and the modification date of its file, so a later correction stays traceable.
You share your needs, expectations, and desired timeframe. We'll suggest the best solution based on your request and budget.
Our specialists configure the crawlers and extract a sample dataset for your review before proceeding with the full-scale extraction.
Once you approve the sample, we launch the project and start full data collection. We gather, filter, and structure the data for easy use, delivering it on time in your preferred format.
Our team manages ongoing processes, monitors website changes, and supports all data extraction cycles. We can also help integrate data into your systems or create dashboards to simplify analysis.
Tell us which sites, which fields and how often. A couple of lines is enough to start.
data.gouv.fr data from €169/month. Free project assessment, reply within 1 business day.