On USAspending a contract is a chain of modifications, each moving the obligated amount. Our USAspending scraper keeps the award, every transaction and the recipient.
Plans from €169 a month · Free project assessment · Reply within 1 business day
CSV · Excel · JSON · XML · FTP · SFTP · Amazon S3 · Google Cloud
API, JSON feed or CSV, XLSX and JSON files
ScheduleOne-time, monthly, weekly, daily or 3 times a day
USAspending pages, filters, fields and a schedule
Built, monitored and repaired by our team
API, JSON feed or CSV, XLSX and JSON files
You name the slice - awarding agencies and sub-agencies, award types, NAICS or PSC codes, assistance listings, recipients, places of performance, fiscal years - and we build the collection, run it and maintain it as USAspending changes its pages. Scripted rendering, pacing and proxy rotation are handled on our side.
Results arrive as one table per level you need: prime awards, transactions, sub-awards, recipients. Every award keeps the Unique Award Key the site uses in its own addresses, so reruns update rows instead of duplicating them, and amounts stay exact to the cent rather than the rounded millions and billions on the summary cards. Files go out as CSV, Excel, JSON or JSONLines, to Amazon S3 or Google Cloud Storage, or through our API.
An award page on USAspending opens with its type - Definitive Contract, Delivery Order, Project Grant - and the identifier that type uses: a PIID for contracts, a FAIN for financial assistance. Behind it sits the Unique Award Key, a string such as CONT_AWD that chains the PIID, the agency code and, for orders, the parent IDV. We collect:
Award pages also hold Legislative Mandates, Competition Details and Acquisition Details, which we add when the project needs them. Executive Compensation names people, so it stays out by default, and awards to individuals are not part of what we deliver.
The award table is the start. Other layers of the site fill in what a single award cannot show:
Profiles and summary cards show today's totals. Run the same slice weekly and you also keep how they moved: obligations added month by month, end dates pushed out, potential value raised, new child recipients appearing under a parent.
USAspending.gov is the federal government's public record of its spending, run by the Treasury's Bureau of the Fiscal Service. It grew out of the Federal Funding Accountability and Transparency Act, and the DATA Act widened it to agencies' direct spending, linked to the programmes behind each award. SAM.gov shows what the government intends to buy; USAspending shows the money once it is committed and paid, with every modification after.
Advanced Search filters by keyword, recipient, award ID, fiscal year or custom dates, location, agency, award type, recipient type, award amount, assistance listing, NAICS, Disaster Emergency Fund Code, Treasury Account Symbol, PSC, type of contract pricing, type of set aside and extent competed. Results split into Contracts, Contract IDVs, Grants, Direct Payments, Loans and Other, and can be viewed as prime awards or as sub-awards. Agency, recipient and award pages each have their own address.
A fiscal year runs from October 1 to September 30. Sections state their own cut-off - one agency profile can show status of funds through one month and award spending through the next - so we stamp every row with the date its section states.
Delivery: CSV, JSON or XLSX files, our API or a JSON feed. MCP server on request.
Full plan detailsMost buyers of USAspending data want one of four answers.
Investors and analysts read the same rows for listed contractors: a parent recipient's obligations by agency and quarter, task orders under a large IDV, and modifications that raise potential value.
Learn how to use web scraping to solve data problems for your organization
Eight US sources of federal records and court data, from SAM.gov contract notices to EPA ECHO violations and USPTO trademarks: what each site shows, the identifiers that join them, and how to build one dataset from several.
Data scraping is the wide term that includes documents, scans and old screens; web scraping is the part that works on websites. We compare sources, daily work, output and cost drivers, give a briefing checklist and walk through two of our projects.
Leveraging advances in technology, the AI-powered web scraper has skyrocketed in demand and is helping to expand capabilities by automating tedious daily tasks and speeding up data collection from thousands of websites several times over.
ScrapeIt builds and runs data collection for clients who need records rather than tools. With USAspending that usually means joining levels the site keeps on separate pages - award, transaction, sub-award, recipient, agency - into one keyed dataset and keeping it current. You get field documentation, a sample on your own agencies or codes before you commit, and runs one-off or daily, weekly or on demand. Plans start from EUR 169 a month, or EUR 199 for a one-time extract.
Still unsure? Write to info@scrapeit.io
Yes. The ScrapeIt USAspending API serves Prime Award ID, recipient name and UEI, awarding sub-agency, obligated and outlayed amounts and NAICS code as JSON from an endpoint we host, updated on the schedule you choose. If files suit you better, the same awards come as CSV or Excel, as JSONLines on Amazon S3, or loaded into your database.
Yes. USAspending exists to publish federal award data, and amounts, recipients, agencies and places of performance are open to every visitor. We collect only publicly available data - all that a visitor can see on USAspending - and we collect it legally. Executive names stay out by default, and we do not build profiles of individual recipients.
Yes. Each award's Transaction History lists modifications with number, action date, amount, action type and description, and we deliver them as a separate table keyed to the Unique Award Key. Scheduled reruns also catch changes to the end dates and to potential award amount, so an extension or a ceiling increase shows up on the next run.
Each section of the site states the date its data runs through, and on one agency page those dates can differ by a month. A weekly run catches new awards and modifications for most uses; a daily run suits teams watching a few agencies or IDVs closely. Every row carries our capture date and the section's own cut-off.
Yes, and most projects start that way: every prime award from one awarding sub-agency, or every contract under a set of NAICS codes, across the fiscal years you choose. Transactions and sub-awards link by Unique Award Key and recipients by UEI, loaded into your database or delivered as CSV, JSON or XML files.
You share your needs, expectations, and desired timeframe. We'll suggest the best solution based on your request and budget.
Our specialists configure the crawlers and extract a sample dataset for your review before proceeding with the full-scale extraction.
Once you approve the sample, we launch the project and start full data collection. We gather, filter, and structure the data for easy use, delivering it on time in your preferred format.
Our team manages ongoing processes, monitors website changes, and supports all data extraction cycles. We can also help integrate data into your systems or create dashboards to simplify analysis.
Tell us which sites, which fields and how often. A couple of lines is enough to start.
USAspending data from €169/month. Free project assessment, reply within 1 business day.