This reply because its the only way I know to mark the thread as resolved
Posts by LybsterKodi
-
-
Thanks - I'll go and zap some files.
-
Hias
Thanks for that. The 6TB HDD did have an extra partition on it (can't remember how it was formatted) but it was rapidly removed with Mini Tool Partition Manager and the whole thing formatted to NTFS.
Your's and Joe's comments pretty much destroy my theory. I'll just have to hope it doesn't recur.
-
"your thought/theory are unlikely"
Agreed, but it is the best fit I have to the facts I know
"against the "boot theory" and for the "dear Pi don't boot my external drive":
usually LE is configured where to boot from during LE installation.
with the UUID's form the disk what is attached during installation."
OK, but all I could find while searching was you can toggle between SD card & USB device as the first one to look at. What I have no idea about and why I thought disabling boot from specified disks is what happens if LibreElec starts its boot from SSD and then tries to spin up the HDD and fails? I know the Pi will close down but I have no idea what else its doing.
"mostly a filesystem gets corrupt when the drive is disconnected while being in use/mounted (e.g. hard power cut)."
We do get the occasional power cut or voltage fluctuation in the Highlands (not as many as I expected when we moved up here though).
The RPi4 is connected to a 128GB SSD for boot and a 6TB HDD for source (videos, records). The 6TB HDD should not be written to unless I carry out a media export and I do not recall ever seeing a disk / memory stick corrupted simply by unplugging unless it had been written to and items not flushed to disk.
OK my experience is primarily Windows based so Linux / LibreElec may be different.
-
Running 20/08/2022 nightly on RPi4, using Local information only with .nfo and .jpg files for each video
I've turned off Download actors thumbnails & Extract thumbnails from video files.
However, when I backed up and copied the tar over to my Windows PC I have c160MB of thumbnails.
1. Is this a LibreElec or a Kodi question
2. How do I stop the thumbnails being produced
3. Am I safe to just delete storage\.kodi\userdata\Thumbnails\
-
I'm still trying to understand why my 6TB USB HDD became corrupted twice. I think the first time was because I hadn't powered up the drive before turning the Pi on. I have a theory that the second time could have been caused by the Pi trying to boot from the 6TB HDD rather than the 128GB SSD even though the 6TB drive was powered up.
I don't think its going to be possible (tried googling but haven't found anything to support the idea) but I'd like to be able to say to the Pi - "you can boot from the SSD but not the HDD" by USB port, disk name or anything. Is there a way?
-
okay, next time please mention in your questions that your're not really interesting in answers, safes some time here ...
The question was
"What does anyone here think? Likely or not?".
If you are interested in answering that I'm interested.
If you are looking for cross platform compatibility, use NTFS. Both NTFS and exFAT are not native filesystems for Linux and NTFS implementation is older and more mature.
Turn off hibernation in disk settings. If disks shutdowns on its own while being mounted, it can only cause mess. Disk should be stopped by OS and not other way. If your storage thinks that it is smarter than OS, you have to use synchronous file system without journal on it.
Thanks.
"Filesystem performance is less critical than device performance."
fully agree with that
I'm convinced the "somebody" doesn't "attack original poster", but "attacks" the OPs wrong attitude what prevents to find the answer for his question(s) himself.
please learn to read the differences in the sentences !

Interesting. I hadn't realised that asking questions here was forbidden. After all if I'm to find out the answer for myself I shouldn't be asking anyone. I was also unaware that you were watching and discounted my efforts googling for information and trying physical tests to see if I could recreate the problem.
As a matter of interest. Did you look at the Wikipedia article, and if so how would it have helped answer my question? I ask because I'm always interested in learning - even at 70.
The expense is worth it
I would have agreed with you totally whilst I was still working and running a small IT Department. As a pensioner who had a large percentage of his savings disintegrated by the Credit Crunch my attitude has changed a bit <G>
-
there exists a comparison of filesystems in wikipedia, search for it
I did a lot of web searching before I posted here. The vast majority do a bit of a pro & con list with zero evidence to support anything. Wikipedia have a very detailed entry if I was interested in technical specs. I'm not.
-
I can now confirm the problem was the cable - new Cat6 cable and no packet loss.
"1) Update the RPi4 bootloader (there where quit a few things USB related in the changelogs)"
LibreElec tells me bootloader & t'other one (can't remember the name) are both up to date and I believe it
"2) Disable Wifi and Bluetooth if you are not using them"
Does never enabling them count <G> - never enable Bluetooth and always disable WiFi
"3) If the Seagate is FAT32 or NTFS that might cause the corruption because those filesystem aren't playing nice with Linux.You might consider switching to EXT4 (at least to test if corruption occur with that too)."
I've posted separately about this. Ext4 isn't really a possibility - simply from a viewpoint of backing up and copying / moving files using Windows (I'll see what the speed is like over the network now with the Cat6 cable). I've been running NTFS since 2018 on the Pi3s and that Seagate is OK. My current theory is the first time I had a duff socket in the extension lead which meant LibreElec/Pi4 tried to power the 6TB HDD, ignored the SSD with LibreElec on it and went to try and reformat the HDD but couldn't power it. The second time is baffling me but might have been flipping the power switches in the wrong order.
Pretty much all the stuff I can find on the web says use ExFat not NTFS for USB drives but no evidence to support the opinion.
-
Thanks - to answer your comments / questions
"Windows does not hibernate external drives."
True, however, Seagate provide a utility so you can tell the HDD to go to sleep after inactivity - I've set it to 15 minutes so having left it to copy 4TB overnight it was sleeping when I came back, turned the PC off and disconnected.
"Unplugging the drive during write operations."
Windows always tell it to eject or close PC down. RPi4 power off machine, but it shouldn't really be writing to the disk anyway - just reading videos.
"Insufficient power for write operations."
I'm pretty sure this was the first cause - power block with duff socket.That was fixed but I suppose its possible that the Pi was overloaded, couldn't read the OS from SSD and tried to create a new install on the HDD.
"Vibration"
Being a brit a tumbler is a glass (one of those things you drink out of) so might have trouble balancing the HDD on it
"Disk failure"
I'm about 23% through a full scann (HDDScan) right now - no bad sectors yet.
"Does it corrupt after being remove from Windows, from libreelec,
or during operation on one of the systems?"
Good question - I only found it (both times) when I plugged back into my Windows PC - massive index corruption both times.
"How does corruption show up in the kernel log? (dmesg)"
No idea - the SSD where I presume it would be stored has been flashed several times since it happened.
"PS: Why does the forum censor the word "
Wish I knew - it also censors f00d
My PS: any views on ExFAT vs NTFS?
-
I'm hopefully onto my last problem area. The 6TB I'll be using on the RPi4 has been corrupted twice and I'm trying to find out why. I found this (https://www.linuxquestions.org/questions/linu…ved-4175536517/) thread which indicates that when Linux mounts a hibernated disk this can cause corruption. I've set my disk to go to sleep after 15 minutes inactivity so its entirely possible that it was that state when I took it off the Windows PC and connected onto the Pi.
What does anyone here think? Likely or not?
The 6TB disk is formatted to NTFS, moving to Ext4 is not a viable proposition, but I could move to ExFAT if people think that would be more stable.
-
"Well,i never thought about old cables."
Neither did I to my shame. Its a Seagate powered backup hub - 6TB HDD. LibreElec will live on a 128GB SSD.
I did run across something which said that the Pi can only deliver 1.2A over all the USB ports, no idea how accurate that is but since the Seagate comes with two USB ports I'll be popping the keyboard dongle and the Haupage in there.
-
I won't know for sure until I receive a cable from Amazon but I think I've sussed it. I deserve to be shot at dawn for such a stupid mistake. Most of my equipment is mature so Cat5 cable is fine but with the RPi4 and the powerline adapter both being gigabit there was data loss. Today I bunged a 5 port 10/100 hub in between the powerline adapter and the Pi4 and things work properly.
Hopefully the only problem I have left to solve is why its trashing the hard drive.
-
Well,another thing i would try is updating the RPi4 bootloader to the latest version (if it's not already the latest one) and test again .
Good guess - did it ages ago. Fortunately I had the sense to "dismantle" my RPi3s carefully so I'm now back to a running system.
I'll mark this thread as resolved and maybe try again in a few months, or when the price of a Pi comes down.
Thanks for trying to sort me out.
-
I'm using SSD as well and I know its speed is good since I tested it just after its arrival.
Thanks to your suggesting a different OS I'm coming to the conclusion that its the RPi4. On wireless (once I connected to my private network rather than the public bit I share) pings were 0% lost. Went back to wired and it loaded amazon.co.uk but then speedtest.net disconnected. Transfering multi GB files over wireless is a bit of a none starter - it can be done but....
I've been trying since last October to get this off the ground. First waiting for LibreElec to implement features I needed now this. I think I'll resurrect my Pi3Bs - just watch them decide not to work now.
-
So far its a bit inconclusive - its loaded my two goto websites (amazon.co.uk & bbc.co.uk) Raspberry Pi OS seems deadly slow but that may just be because I'm not used to it.
Had a bit of a problem to start with since it hooked onto wifi rather than using ethernet.
Pinging from my Windows PC is either 0% or 25%, mainly 25%
The one thing I haven't been able to test is power since I have only the one USB-C power supply (3A) and I've had to move the USB keyboard dongle to a hub.
-
Pretoriano I can understand why you and chewitt have recommended that, and I possibly haven't been clear enough yet. The connection via the powerline adapter to the router is sound. a) its the same one as used with the RPi3 which did not have a problem and b) plugging a PC rather than the RPi4 in to the adapter achieved very acceptable results and c) another device in the second socket of the adapter pings correctly.
I'm failing to understand what moving the Pi and TV (otherwise I have no idea what's going on) or, going out and finding a long enough ethernet cable, so I can plug directly into the router will achieve.
The only thing I'm not sure about currently is whether its the RPi4 hardware or LibreElec or Kodi so I'll try putting Raspberry OS on and see what that does. I'll report back later on.
-
Bit more info
1) my 6TB drive has been corrupted again
2) full reinstall of nightly 14/08/2022
3) the powerline adapter is a double, one socket goes to the Pi and the other to the TV. Simple ping to the RPi4 (after reinstall of LibreElec) results in 25% - 68% lost packets, to the TV 0% loss
4) the RPi4 now seems reluctant to connect to the internet (can't download addon) so even if I could produce logs showing the problem I can't send them.
Having changed everything apart from the RPi4 itself I have no idea what else to try, and I don't feel like spending any more trying to get things working.
Unless anyone has a suggestion I think the RPi4 can be put into a dark cupboard and I'll recommission my RPi3s.