CFTC scraper for Commitments of Traders data

Our CFTC scraper turns the weekly Commitments of Traders tables, released on Friday for positions held on Tuesday, into one row per market and trader category.

Plans from €169 a month · Free project assessment · Reply within 1 business day

CSV · Excel · JSON · XML · FTP · SFTP · Amazon S3 · Google Cloud

cftc.gov
CFTC scraper for Commitments of Traders data
cftc.govwhat you get
Typical fields for financial sites
tickerpricechange_pctvolumemarket_capupdated_at
Delivery

API, JSON feed or CSV, XLSX and JSON files

Schedule

One-time, monthly, weekly, daily or 3 times a day

Scrape CFTC reports as a managed service

  1. You send

    CFTC pages, filters, fields and a schedule

  2. We run the scrapers

    Built, monitored and repaired by our team

  3. You receive the data

    API, JSON feed or CSV, XLSX and JSON files

You tell us which Commitments of Traders families you need - Legacy, Disaggregated, Traders in Financial Futures or the Supplemental index-trader report - which exchanges or contract codes, and whether futures only or futures and options combined. We build the crawler, run it after each Friday release and repair it when the CFTC changes a page layout. Pacing, proxy rotation and rendering are handled on our side as part of the service.

The CFTC publishes a weekly table of contracts added and dropped, and we carry it into the delivery note, so a market that disappears from the report is flagged instead of silently missing from your file. Output arrives as CSV, XLSX or JSON, through our API or loaded into your database, with field documentation attached. Plans start from EUR 169 a month, or EUR 199 for a one-time extract.

CFTC COT data: fields we extract

Every COT market block opens with a header naming the contract, the exchange and a CFTC contract market code, such as Code-037021, followed by the contract unit and the Tuesday the positions are dated. We keep that code as the key, so a market stays one series even when its name is edited.

  • Market identitymarket and exchange name, contract market code, contract unit, report family, futures only or combined, short or long format, report date.
  • Open interesttotal open interest and its change from the previous week.
  • Legacy positionsnon-commercial long, short and spreads; commercial long and short; total reportable; nonreportable positions long and short.
  • Disaggregated positionsProducer/Merchant/Processor/User, Swap Dealers, Managed Money and Other Reportables, each long and short, with spreading where the category has it.
  • Traders in Financial FuturesDealer/Intermediary, Asset Manager/Institutional, Leveraged Funds and Other Reportables for currencies, Treasuries, stock indexes and VIX.
  • Changes and sharesthe change from the prior week for every column and the percent of open interest held by each category.
  • Number of traderstrader counts per category and the total for the market.
  • Concentration ratiosfrom the long format, the share of open interest held by the largest four and eight traders, plus the crop-year grouping where a market has one.

Index trader positions come from the Supplemental report, which covers 13 selected agricultural contracts. Each row carries the release date and its source address, so any value can be traced back to the table it came from.

CFTC COT data: fields we extract
Building a CFTC database beyond the weekly COT

Building a CFTC database beyond the weekly COT

The current COT pages are replaced with every Friday release. Scheduled runs keyed on contract code and report date build the history: non-commercial positioning in gold, Managed Money in crude oil, Leveraged Funds in the Japanese yen, week after week. The CFTC does not revise COT figures once published, so a stored week stays valid.

Beyond the COT, the Market Reports section holds series on their own calendars: the Weekly Swaps report every Monday with gross notional outstanding, transaction dollar volume and ticket volume split by participant type, cleared status and product; Bank Participation Reports monthly; Cotton On-Call every Thursday; Financial Data for FCMs monthly for futures commission merchants and retail foreign exchange dealers; and Cleared Margin Reports for derivatives clearing organizations.

Enforcement actions complete the picture: each entry has a date, a title linked to the press release and documents tagged Complaint, Consent Order, Administrative Order or Final Judgment, with a year filter reaching back to 1995. Firm names are delivered; names of individual defendants are left out by default.

About the CFTC and its market reports

Source
cftc.gov
Category
financial sites
Delivery
API, JSON feed, CSV, XLSX
Plans
From €169 a month
Get a quote

The Commodity Futures Trading Commission is the US federal agency that oversees the futures, options and swaps markets. For data buyers the centre of cftc.gov is Market Reports, and within it the Commitments of Traders: a breakdown of each Tuesday's open interest for markets where 20 or more traders hold positions at or above the CFTC reporting levels. Reporting firms send the figures on Wednesday, the CFTC verifies them and publishes on Friday at 3:30 p.m. Eastern; holidays shift the date.

The COT report comes in four families that classify traders differently. Legacy splits them into commercial and non-commercial and is organised by exchange - Chicago Board of Trade, Chicago Mercantile Exchange, Commodity Exchange Inc., New York Mercantile Exchange, ICE Futures U.S., ICE Futures Europe, MIAX Futures, Coinbase Derivatives, Nodal Exchange and more. Disaggregated covers agriculture, petroleum, natural gas, electricity and metals. Traders in Financial Futures covers financial contracts and comes in long format only. Supplemental adds index traders for agricultural markets. Classification rests on the business purpose each trader states on CFTC Form 40.

25Developers
500+Customers
1.5BPages extracted
15,000+Hours saved for our clients

CFTC scraping plans and pricing

Airplane

€199one-time

Setup fee included

100,000
One-time
Up to 5 days
7 days

Helicopter

€169/ mo

Setup fee €499

250,000
Monthly
Up to 5 days
14 days

Glasses

€229/ mo

Setup fee €499

1,000,000
Weekly
Up to 5 days
30 days

Microscope popular

€349/ mo

Setup fee €499

2,000,000
Daily
Same day
60 days

DNA

€549/ mo

Setup fee €799

3,000,000
3 times daily
Same day
90 days

Delivery: CSV, JSON or XLSX files, our API or a JSON feed. MCP server on request.

Full plan details

Why collect CFTC data on positioning

COT figures are the standard public read on who holds what in US futures. Commodity desks track Managed Money against Producer/Merchant positions to see when speculative length is stretched; currency teams watch Leveraged Funds and Asset Managers in the yen, euro and sterling contracts; rates teams follow the Treasury futures lines of the financial report. Because every row is dated to a Tuesday, the series lines up with price history for back-testing positioning signals.

The other columns earn their place as well. Number of traders separates a crowded trade from a few large holders, and the concentration ratios show how much of a market sits with a handful of accounts. Swaps notional by product and cleared status feeds market-structure research, FCM financial data supports reviews of brokers as counterparties, and enforcement actions give compliance teams a dated log of cases. We deliver the data; the trading conclusions stay with you.

About ScrapeIt

ScrapeIt is a managed web scraping service: we build, run and maintain the crawlers, and you receive the dataset. A source like the CFTC needs care in three places: a fixed release calendar, fixed-width text tables that must be parsed column by column, and trader categories that have to stay comparable over years. A free project assessment comes first, and a sample covering your markets can be ordered before any schedule is set.

FAQ

Still unsure? Write to info@scrapeit.io

Do you offer a CFTC API for Commitments of Traders positions?

Yes. The ScrapeIt CFTC API returns contract market code, open interest, long and short positions per trader category, weekly changes and number of traders as JSON from an endpoint we host, refreshed after each Friday release or on the schedule you set. The same data also comes as CSV or XLSX files, a JSON feed or a load into your database.

Is it legal to scrape CFTC?

Yes. The COT tables, market reports and enforcement actions are published on cftc.gov for anyone to read. We collect only publicly available data - everything a visitor can see on the CFTC site - and we collect it legally.

When is CFTC COT data released, and when does it reach me?

The CFTC publishes the Commitments of Traders on Friday at 3:30 p.m. Eastern for positions as of the preceding Tuesday, and moves the date in holiday weeks. Our runs follow the CFTC data release schedule, so the new week is collected shortly after it goes live and delivered the same day.

Which report families and exchanges does your CFTC dataset cover?

All four families: Legacy, Disaggregated, Traders in Financial Futures and the Supplemental index-trader report, futures only or combined with options. Exchanges include CBOT, CME, COMEX, NYMEX, ICE Futures U.S. and Europe, MIAX Futures, Coinbase Derivatives and Nodal; you can take every market or a list of contract codes.

Can you build COT history for gold, the yen or other markets?

Yes. Weekly runs keyed on contract market code and report date grow a continuous series per market, and since the CFTC does not revise published weeks, stored rows stay valid. Earlier weeks can be added to the first extract when the project needs a longer back history.

How it works

  1. 1

    Make a request

    You share your needs, expectations, and desired timeframe. We'll suggest the best solution based on your request and budget.

  2. 2

    We configure the crawlers

    Our specialists configure the crawlers and extract a sample dataset for your review before proceeding with the full-scale extraction.

  3. 3

    Collect and deliver

    Once you approve the sample, we launch the project and start full data collection. We gather, filter, and structure the data for easy use, delivering it on time in your preferred format.

  4. 4

    Maintain and support

    Our team manages ongoing processes, monitors website changes, and supports all data extraction cycles. We can also help integrate data into your systems or create dashboards to simplify analysis.

Request a quote

Tell us which sites, which fields and how often. A couple of lines is enough to start.

  • We reply within 1 business day
  • A sample dataset before the full run
  • We sign an NDA on request
  • Delivery by API, JSON feed or files
Which sites, which fields, how often. A couple of lines is enough.

This form is protected by Google reCAPTCHA, which loads when you start filling it in; the Google Privacy Policy and Terms of Service apply. If you prefer not to use it, email us at info@scrapeit.io. Privacy & Cookie Policy

We reply within 1 business day. No obligation.

CFTC data from €169/month. Free project assessment, reply within 1 business day.