Heyas, wondering if there’s an open sourced piece of software or the like, that could scrape media platforms for a specific topic. Platforms like YT, X, Lemmy, News Media, etc., perhaps using RSS? But, a program I can host on my server, that only I have access too, via webpage, CLI, whatever…
Thanks for any info…
You must log in or register to comment.
Everyone is suggesting readers. I think you are looking for something like https://docs.rsshub.app it’s capable of generating RSS feeds from pretty much everything.
I use rss-bridge for scraping sites that don’t offer rss feeds: https://rss-bridge.github.io/rss-bridge/index.html
seconded. the built-in custom css selection is excellent. ive been strongly considering self-hosting an RSS bridge, but i think my server has too much unpredictable downtime for it
FreshRSS has been working great for me! It even has the ability for web scraping if you need it.
