WindowlessBasement@alien.topBtoData Hoarder@selfhosted.forum•ZFS error vs smartctl, disk need to be replaced?English
1·
1 year agoThe error message tells you what to.
If this is just a random error you are unconcerned by (recent power outage, flakely cables, etc), you can clear the errors. If you believe the drive is failing, you can replace the drive. The array will remain in a degraded state until you make a decision.
Short answer: you’re asking questions that will take a program requesting data (the whole internet archive?) non-stop for a month or more. You are gonna need to learn to code if you want to interact with that much data.
You’re going to need to automate it. A rate-limiter is going to kick in very quickly if you are just spamming the API.
You need to learn for yourself if this is a project you are tackling. Also will need to familiarize yourself with the terms of service of the archive, because most services would consider scraping every piece of data they have as abusive behavior and/or malicious.