this post was submitted on 04 Dec 2023
2 points (100.0% liked)

Data Hoarder

1 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
 

EDIT: 7 Seagate Backup Hub 8TB and 1 WD Elements external drive (the target drive).

Computer is a Dell Vostro 260 with i5-2400, 8GB RAM, 2TB Patriot P210 SSD boot drive, and 8 Seagate Backup Hub 8TB external hard drives connected to two PCI-E USB 3.0 cards with 5 USB 3.0 ports each. The computer is set to Never for when the screen and computer will shut down and the power profile is Performance.

Been trying since Monday to transfer a little over 6TB of data. Before the data transfer I checked for updates and the computer downloaded all the available updates and installed some and required a restart for another. After the restart I checked for updates again and nothing showed up so I began the transfer before going to bed. I think the estimated time was 15 or 16 hours. I turned off the monitor and went to bed. The open windows were task manager, two file explorer windows showing drives :K (source drive) and drive :L (target drive), and the little file transfer window showing about 130 MB/s.

The next morning I turned on the monitor and it was just the desktop and no windows open. I opened file explorer and only about 1TB transferred over. Usually if I restart the computer with task manager still open the computer will restart and have task manager open.

I went to settings to check for updates and none were found. I paused updates for 7 days and retried the transfer again before going to work. I turned off the monitor. Came home from work and turned on the monitor and again it was just the desktop. I opened file explorer and about 3TB total transferred, including the 1TB from the original attempt.

I went to Device Manager and have three instances of "USB Mass Storage." I went to properties and then Power Management tab and unchecked, "Allow the computer to turn off device to save power" for all three. I then retried the file transfer. The next morning I turn on the monitor to just the desktop. I turned off the computer and went to work. Got home and before bed I retried the transfer. Of course I wake up and turn on the monitor to nothing but the desktop.

Any other settings I need to check and change? It's annoying not being able to transfer all that data in one go.

top 5 comments
sorted by: hot top controversial new old
[–] HandaArchitect@alien.top 2 points 11 months ago (1 children)

I suggest using TeraCopy to handle large file transfers. I assume you are using the default windows file transfer provided by File Explorer which does not seem to handle larger file transfers.

TeraCopy can pause and resume your file transfers as well as provide integrity checks using hashes.

[–] HawaiianSteak@alien.top 1 points 11 months ago

I'm gonna try the suggested file transfer programs for my next large data transfer. The pause and resume feature of TeraCopy and integrity checks are things I haven't considered before. Thanks for recommending!

[–] Arghblarg@lemmy.ca 1 points 11 months ago

Try disconnecting from all networks (unplug ethernet, turn off wifi) if you want to ensure no updates can interrupt the copy operation.

[–] fediverser@alien.top 1 points 11 months ago

This post is an automated archive from a submission made on /r/DataHoarder, powered by Fediverser software running on alien.top. Responses to this submission will not be seen by the original author until they claim ownership of their alien.top account. Please consider reaching out to them let them know about this post and help them migrate to Lemmy.

Lemmy users: you are still very much encouraged to participate in the discussion. There are still many other subscribers on !datahoarder@selfhosted.forum that can benefit from your contribution and join in the conversation.

Reddit users: you can also join the fediverse right away by getting by visiting https://portal.alien.top. If you are looking for a Reddit alternative made for and by an independent community, check out Fediverser.

[–] bryantech@alien.top 1 points 11 months ago

Does your PCI-E card require a power plug from the power supply?