How YouTube Is Put Together: Video IDs, Channels, Shorts and Playlists
YouTube is built on four object types, each with one identifier. A video is an eleven character ID that appears in every URL form the platform uses: the watch page, the youtu.be short link, the /shorts/ path for vertical video and the /embed/ player. A channel is a twenty four character ID beginning with UC, and every channel also carries a human readable handle that resolves to the same object. A playlist ID begins with PL, and one playlist per channel is special: swap the UC prefix of a channel ID for UU and you have that channel's uploads playlist, which lists its public videos in order. Hashtag pages sit on their own path as well.
A channel is a set of tabs, not a single page. Home, Videos, Shorts, Live, Podcasts, Playlists, Posts and an in-channel Search each hold a different slice of the same catalogue, so a YouTube scraper that reads only the Videos tab misses Shorts and past live streams entirely. Shorts run up to three minutes and are listed apart from long-form uploads even though they carry the same eleven character video ID.
Two facts shape any attempt to scrape YouTube at all. The sitemap index the platform publishes contains no videos and no channels: it covers marketing sites for Kids, Trends, Creators, Jobs and Premium, so there is no crawl frontier to walk. And robots.txt closes the paths a naive crawler reaches for first, among them search results, the comment path, the per-channel RSS feed and the internal player endpoints. We read that file before we build anything, and we plan collection from seed lists of channels, playlists and video IDs instead of from a spider.
Get a Quote