Technology

37705 readers

173 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

alyaza@beehaw.org

TheRtRevKaiser@beehaw.org

gyrfalcon@beehaw.org

rs5th@beehaw.org

SemioticStandard@beehaw.org

TheRtRevKaiser@kbin.social

Los@beehaw.org

coldredlight@beehaw.org

remington@beehaw.org

160

The Internet Is Failing The Website Preservation Test (archive.ph)

submitted 1 year ago by Gork@beehaw.org to c/technology@beehaw.org

67 comments fedilink hide all child comments

This is something that keeps me worried at night. Unlike other historical artefacts like pottery, vellum writing, or stone tablets, information on the Internet can just blink into nonexistence when the server hosting it goes offline. This makes it difficult for future anthropologists who want to study our history and document the different Internet epochs. For my part, I always try to send any news article I see to an archival site (like archive.ph) to help collectively preserve our present so it can still be seen by others in the future.

you are viewing a single comment's thread
view the rest of the comments

[–] RealAccountNameHere@beehaw.org 15 points 1 year ago (1 children)

I worry about this too. I've always said and thought that I feel more like a citizen of the Internet then of my country, state, or town, so its history is important to me.

[–] Gork@beehaw.org 4 points 1 year ago (2 children)

Yeah and unless someone has the exact knowledge of what hard drive to look for in a server rack somewhere, tracing an individual site's contents that went 404 is practically impossible.

I wonder though if Cloud applications would be more robust than individual websites since they tend to be managed by larger organizations (AWS, Azure, etc).

Maybe we need a Svalbard Seed Vault extension just to house gigantic redundant RAID arrays. 😄

[–] RealAccountNameHere@beehaw.org 4 points 1 year ago (1 children)

This isn't directly related to your comment, but you seem so smart, and I got to say that is definitely one thing I'm enjoying on this website over Reddit! :-)

[–] Gork@beehaw.org 2 points 1 year ago

Thanks ^_^ I don't consider myself brilliant or anything but I appreciate your compliment! The thing I like the most is that everyone is so friendly around here, yourself included ☺️

[–] jmp242@sopuli.xyz 3 points 1 year ago

We're actually well beyond RAID arrays. Google CEPH. It's actually both super complicated and kind of simple to grow to really large storage amounts with LOTS of redundancy. It's trickier for global scale redundancy, I think you'd need multiple clusters using something else to sync them.

I also always come back to some of the stuff freenet used to do in older versions where everyone who was a client also contributed disk space that was opaque to them, but kept a copy of what you went and looked at, and what you relayed via it for others. The more people looking at content, the more copies you ended up with in the system, and it would only lose data if no one was interested in it for some period of time.