VentureBeat Story Pages and Sitemaps: Where Each Field Comes From
Everything a visitor sees on a VentureBeat story page can be collected: headline, dek, byline as printed, section and categories, story label, the Presented by sponsor line, the featured flag, published and modified times, full text with subheads and outbound links, and the lead image.
Collection covers the five sections - Orchestration, Infrastructure, Data, Security and Technology - plus DataDecisionMakers and Resources. Partner pieces are kept with their sponsor, and Business Wire releases are collected next to the reporting, with the stream each row came from recorded.
The VentureBeat sitemap index lists one sitemap per day back to January 2015. The daily lists are dependable for the last few years and patchy before that: plenty of older weekdays list nothing, although their stories still open. Category pages show about a dozen stories with no page two.
Sitemaps and the archive give the long list of stories. The fields monitoring depends on - story label, sponsor, featured flag, entities in the text - exist only on the pages.