There is no simplification that you're looking for. It seems you don't have a programing background. If you really need to scrape something, you need to learn a programing language, HTTP, HTML, and maybe javascript. AFAIK, there is no easy way or point and click scrapper building tool. You will need to invest time and learn. Don't worry, you should be able to get it done in 2-3 months if you do invest your time in.
umami_wasbi
It is a ok tool to get things started.
Starting out with Python by Tony Graddis
I read the 3rd edition in library, now it's 6th. Don't know if it is as good as the memory serves.
How about torrenting?
Ops. Missed that part.
I use BTRFS for snapshots, and auto compression. Maybe it can be done with raids with LVM? AFAIK BTRFS redundancy is basically the same as traditional RAID, similar to using mdadm. Still, you would want a backup strat instead relying on the disk redundancy. I learn that the hardway.
I would just skip RAID, add all disk to a single BTRFS and use the built in profiles for (meta)data redundancy.
Cache I don't know much tho.
Is this finally the dusk of SO? It helps alot, but also suck alot.
Yay, more subscriptions.
👌Adobe, I am sticking to my Affinity Photo 1.
It is their job to find evidences, not my resposibility to provide them.
I'm on S21FE and it does NOT.
I don't a single guide for you but I can layout a road map.
After you got those foundation ready, you can go on and try to build a webscraper. I advice aginst using Scrapy. Not because it is bad but too overwhelming and abstracted for any beginner. I will instead advice you use
requests
for HTTP, and BeautifulSoup4 for HTML parsing. You will build a more solid foundation and transition to scrapy later when you need those advanced function.When you get stuck, don't afraid to pause on your attempt and read tutorials again. Head to the Python Community on Discord to get interactive help. We welcome noobs as we once were noobs too. Just don't ever mention scraping there as they can't help if they suspect you're trying to do something inappropriate, malicious, or illegal. They are notoriously aginst
yt-dlp
which frustrates me a bit. Phrase it nicely and in an generic way. I will be there occasionally offering help.