Webmotors scraper for Brazilian car and motorcycle listings

Webmotors data we extract from each listing

A Webmotors listing lives at an address that already spells out the car: /comprar/, then make, model, version, number of doors, the manufacture and model years, and a numeric listing id at the end. That id is the key we keep between runs. Our Webmotors scraper reads the fields the search cards and the listing page show a buyer:

• Identity - listing id, URL, make, model and the full version name as Webmotors writes it, with engine, valves, fuel, doors, gearbox and trim in one string.
• Vehicle - manufacture year and model year as separate columns, mileage in km, gearbox (Manual, Automática, Automatizada, CVT), fuel (Flex, Gasolina, GNV, Híbrido), body type, colour, doors, and the Final da placa group the site filters on, never the plate itself.
• Price - asking price in reais, with the Super Preço seal and the Abaixo da Fipe flag that mark cars listed under the FIPE average.
• Condition flags - Aceita troca, IPVA pago, Licenciado, Único dono, Garantia de fábrica, revisions done at the dealer or by the service book, Alienado for cars still under a finance lien, armour (blindagem) and auction history (passagem por leilão).
• Optional equipment - the itens e opcionais ticked from the platform's list, such as ar condicionado, freio ABS, airbag, vidros elétricos and rodas de liga leve.
• Seller - seller type (Concessionária, Loja or Pessoa Física), the dealer's trading name, city and state, and service flags such as Car Delivery and Troca com troco.
• Trust and media - the Vistoriado seal, whether a Visão 360° tour exists, photo URLs and the seller's observações text.

Dealers are businesses, so their names and addresses go in by default. A private seller's name and phone are personal data: they stay out unless the project needs a contact the listing shows openly, and every row is handled under GDPR.

Webmotors price tracker, below-FIPE offers and dealer stock

Most projects want a market, not a handful of cars. Webmotors arranges its stock as a tree of make, model and version pages, each narrowed by state or city and by a year range written into the address (de.2013/ate.2015), so a crawl can be cut along the same lines and merged on the listing id. Sorting by Menor preço, Maior preço, Ano mais novo or Menor Km reaches both ends of a version's price band.

Price history. A listing shows today's asking price. Runs repeated on the same ids turn it into a Webmotors price tracker: every cut, the day a car first appears, the day it disappears, and the moment it gains or loses Super Preço. Sellers can edit the price, photos, the Licenciado and IPVA pago flags, equipment and observações during the first 15 days, and mileage only upwards, so early edits belong in the record.

Dealer and fair coverage. Stock can be collected per dealer, and the offers under the Ofertas filter - Loja Oficial storefronts of brands such as BMW and BYD, feirões and Limpa Pátio clearance events - are kept as tags, so promotional stock separates cleanly from everyday listings.