MatrixDevVideosArtMusicBooksProjectsTechAIHistoryGamingDIYHealthProgrammingPrivacyAskMatrixIdeas4MatrixThemesHelpTop Subs
6

Rumble has made efforts to prevent servers from "scraping" normal information off of a page. It's pretty normal to grab meta data off of a page through a number of competing meta tag schemes. But to do that you have to get the html content to parse.

I suppose maybe as a counter measure to negative scraping they've made it so default curl or node-fetch will just get served looping redirects. The browser doesn't get served these redirects.

Of course there is always a way to more effectively simulate a browser and get the content you want. I "The Scrapist" certainly know how to do that. But I decided if they want to be a bitch I'll use my scrapist skills and code I've already written to rewrite their url to one that live scrapes and redirects the mp4.

If Rumble wants sites to link out to them they can make it easy for those sites to get metadata. Otherwise I'll just rip their mp4, or better yet, still make them serve it.

Comment preview