Building a Totaljobs dataset: searches, salary panels, history
Totaljobs organises listings by job title, sector and place, and its addresses follow suit - data analyst jobs in London, warehouse operative jobs in Manchester, one page per sector from Accountancy to Utilities. A search narrows by date posted, work from home options, job type, type of company, skills, and commute time by walking, cycling, car or public transport, and sorts by published date, relevance, salary or distance. We build the slice plan from those filters and merge on the job id.
The foot of a title-and-place search carries a panel worth keeping: the average salary per year for that role in that place with its range, the number of matching jobs, similar titles, the skills Totaljobs rates useful, the industry the role belongs to, and how many of the jobs are temporary or part-time. Captured on every run, it becomes a pay benchmark series per title and town.
Repeated runs add the rest of the history: first appearance, how long an ad stayed live, and when the same role was posted again. Agencies sometimes list one vacancy several times with identical title, postcode and pay, so we mark duplicates instead of counting them as separate jobs.