One platform, nine regional broadcasters behind it. Drop the producer field and a federation looks like a single national channel.
Plans from €169 a month · Free project assessment · Reply within 1 business day
CSV · Excel · JSON · XML · FTP · SFTP · Amazon S3 · Google Cloud
API, JSON feed or CSV, XLSX and JSON files
ScheduleOne-time, monthly, weekly, daily or 3 times a day
ARD Mediathek pages, filters, fields and a schedule
Built, monitored and repaired by our team
API, JSON feed or CSV, XLSX and JSON files
ScrapeIt runs the collection as a managed service. You name the producers, genres or the full catalogue; we enumerate from the published sitemaps, record the producing broadcaster and resolve availability windows to absolute dates, and hand back CSV, JSON, Excel or a push into your warehouse.
Where departures matter we run repeat collection so arrivals and expiries become records rather than a difference somebody has to reconstruct.
Programme records carry the title, series and episode identifiers, description, genre, duration, the producing broadcaster, first broadcast date, availability window and the address.
Producing broadcaster is a first class field. It is the federation's defining structure and it is what allows questions about regional commissioning, regional content share and how the institutions differ from each other.
Availability window is recorded with its expiry, because German public broadcasting operates time limits on how long material stays online and those limits are part of what the catalogue is.
Discovery source is recorded per row - which sitemap an address came from - so coverage can be audited rather than assumed complete.
Every row carries the collection timestamp, which is what makes an expiry date interpretable.
Regional commissioning analysis is the distinctive output: how much each institution contributes, in which genres, and how that has changed. It is a question about the structure of German public broadcasting and it needs the producer field to be answerable at all.
Expiry tracking produces the departure feed that every time-limited catalogue supports: what is leaving, when, by producer and genre. It requires windows resolved to absolute dates at collection.
Coverage auditing from the sitemap source field tells you honestly how much of the catalogue a collection actually reached, rather than presenting whatever was found as complete.
Limits: metadata only, never streams or anything behind a sign in, and no viewer data.
ARD Mediathek is the joint on demand platform of Germany's public broadcasting federation. What looks like a single service is a shared front end over the catalogues of the regional broadcasting institutions that make up the federation, each with its own commissioning and regional remit.
That structure is the thing to preserve. A programme made by one regional broadcaster for its own region is a different object from a federation-wide commission, and a catalogue that records only the platform loses the distinction entirely - which for any question about German public broadcasting is the distinction that matters.
Discovery works through published sitemaps rather than through a browsable index. The detail and video sitemaps list programme addresses that respond directly, which makes enumeration straightforward without crawling the interface.
Delivery: CSV, JSON or XLSX files, our API or a JSON feed. MCP server on request.
Full plan detailsThe analytical value is the federated structure and the availability windows - the same time-limited catalogue problem that public broadcasters everywhere present, with an extra dimension because nine institutions feed the same shelf.
The producing broadcaster on every programme record shows how much each regional institution contributes and in which genres. The availability window, resolved to an absolute expiry date, shows what is arriving and what is leaving, by producer and genre. With title, series and episode identifiers, description, duration and first broadcast date beside them, the catalogue becomes a record of how German public broadcasting works rather than a list of programmes.
Because each row also records the sitemap it came from and the moment it was collected, coverage can be checked and every expiry date read against the day it was observed.
Learn how to use web scraping to solve data problems for your organization
Leveraging advances in technology, the AI-powered web scraper has skyrocketed in demand and is helping to expand capabilities by automating tedious daily tasks and speeding up data collection from thousands of websites several times over.
Web scraping is a method of obtaining web data by extracting it from pages of web resources with the help of a program, that is, in automatic mode. It is used to syntactically convert web pages into more usable forms.
If you specialize in machine learning, you need to feed large amounts of data to the algorithms. Web scraping is the easiest and the most efficient method of collecting the data from all over the Internet.
ScrapeIt is a managed extraction company, not a tool you have to learn. Our team builds the pipeline, follows the published sitemaps as the catalogue changes, and repairs the collector before an expiry record develops a gap that cannot be filled.
You see a sample first, in your format, over the producers and genres you actually track, with producer and expiry populated so you can judge the structure on real programmes.
Still unsure? Write to info@scrapeit.io
Yes. The ScrapeIt ARD Mediathek API returns the title, series and episode identifiers, producing broadcaster, first broadcast date and availability window as JSON from an endpoint we host, refreshed on the schedule you set. The same data also comes as CSV or XLSX files or straight into your database.
Yes. ARD Mediathek programme pages and sitemaps are public, and from them we collect titles, series and episode identifiers, descriptions, genres, durations, producing broadcasters, first broadcast dates and availability windows. We collect only publicly available data - everything a visitor can see on ARD Mediathek - and we collect it legally.
Because this is a federation, not a single channel. Regional commissioning and regional content share are the questions people actually have about German public broadcasting, and without the producer field none of them can be asked.
Through the detail and video sitemaps the site publishes. We also record which sitemap each address came from, so coverage can be audited rather than presented as complete because nothing obvious was missing.
Yes - German public broadcasting operates time limits on how long material stays online. We resolve those windows to absolute dates at collection, which is what makes a departure feed possible.
You share your needs, expectations, and desired timeframe. We'll suggest the best solution based on your request and budget.
Our specialists configure the crawlers and extract a sample dataset for your review before proceeding with the full-scale extraction.
Once you approve the sample, we launch the project and start full data collection. We gather, filter, and structure the data for easy use, delivering it on time in your preferred format.
Our team manages ongoing processes, monitors website changes, and supports all data extraction cycles. We can also help integrate data into your systems or create dashboards to simplify analysis.
Tell us which sites, which fields and how often. A couple of lines is enough to start.
ARD Mediathek data from €169/month. Free project assessment, reply within 1 business day.