Error: LE 8.2.5 -> 9.2.5 constant library re-scan on data source entry

muelli · October 9, 2020 at 8:31 AM

Hello everybody,

I have a slight problem after upgrading from LE 8.2.5 (Kodi 17.6) to 9.2.5 (Kodi 18.8) on my Pi 4.

Already having asked that in the Kodi forum, they could not find the source of this error and asked me to post it here, it might have sth to do with LE.

Original posting over in the Kodi forum:

----

After migrating from Kodi 17.6 (Libreelec 8.2.5) to Kodi 18.8 (Libreelec 9.2.5) I have aproblem with Kodi always re-scanning all the media files after entry into a datasource.

Clarification:

Storage is mounted via SMB smb://storage/files, there are around 1000 files stored there.

Datasource for said SMB share is created.

On entry into that datasource, kodi 18.8 starts scanning the files and increments the total runtime of all videos and as well updates the media flags(HD or SD) for every file.

This is done every time I enter that datasource and takes around 45s.

This was not the case with Kodi 17.6, upon re-entering that datasource, the runtime as well as the media flags/tags (HD or SD) were already present and are not updated/re-scanned.

Settings have not been changed by me after upgrade.----

Complete kodi debugging logs from system bootup until entering that datasource a few times can be found here:

hastebin

Would be great if somebody knew what is going on, because this keeps me from using 9.2.5 and I am still stuck with 8.2.5.

Thanks for any help.

muelli · October 12, 2020 at 10:33 AM

Out of desperation I did a fresh re-install and added my datasource again...

Problem exactly the same! So this seems to really be a bug in 9.2.5!

**Da Flex** · October 12, 2020 at 5:55 PM Official Post

The log doesn't shows related errors. Maybe you have to increase cache to avoid re-scanning. Try this at advancedsettings.xml:

Code

<advancedsettings>
    <cache>
        <memorysize>139460608</memorysize>
        <buffermode>1</buffermode>
        <readfactor>20</readfactor>
    </cache>
</advancedsettings>

muelli · October 13, 2020 at 10:48 AM

Thanks for the tip, however the final problem remains.

But something is different.

I have my disks set to sleep. With this setting kodi starts scanning the files and incrementing runtimes, without waking up my disks. half way through the scaning process, my disks wake up.

Without that setting the disks are woken up as soon as the scan starts.

Plus, the watchdog seems to restart kodi during the scan, because waking the disks up in the middle of rescan seems to trigger a timeout as nothing happens during disk spin up....

**Da Flex** · October 13, 2020 at 6:38 PM Official Post

Sounds like a proof of my theory. Read the advancedsettings.xml doc and play around with cache settings. I don't think it's a bug.

muelli · October 15, 2020 at 12:55 PM

I beg to differ. The result is always the same! Scanning the file library (local database on the raspberry) all over again and adding up the runtimes. This was done in a fraction of a second on LE 8.2.5 but can be seen (times adding up rapidly, then media tags appearing after that). I cannot see how that would change with adding buffers for files/drives.

The mentioned advancedsettings.xml setting does seem to only have effect to stream buffering and does not influence any kodi DB reading at all....

**Da Flex** · October 15, 2020 at 6:22 PM Official Post

When you read the doc, it says that cache settings can be relevant (2.8.5 cache -> buffermode). Please try this advancedsettings.xml:

Code

<advancedsettings>
    <samba>
        <statfiles>false</statfiles>
    </samba>
    <cache>
        <buffermode>4</buffermode>
    </cache>
</advancedsettings>

This should optimize SMB access for big file amount.

muelli · October 21, 2020 at 1:31 PM

Thanks for the hints, but the problem is persisting. Due to disabling statfiles, it has gotten even worse.

Now LE seems to need to access not only the video DB on the raspberry, but also every single video file on the samba storage. It slows down to the point when the watchdog resets kodi....

**Da Flex** · October 21, 2020 at 7:03 PM Official Post

Next things you can try:

1) disable buffering (<buffermode>3</buffermode>)

2) test latest nightly builds (maybe it's already fixed)

3) if 1) and 2) fails, provide a link to a complete log file

**Klojum** · October 21, 2020 at 7:36 PM Official Post

Quote from muelli

It slows down to the point when the watchdog resets kodi....

The Watchdog thing has been a PITA off and on for years now.

If you do upgrade to a nightly, make a backup of the 9.2.5 setup first. Just in case.

muelli · October 22, 2020 at 1:45 PM

Quote from Da Flex

Next things you can try:

1) disable buffering (<buffermode>3</buffermode>)

2) test latest nightly builds (maybe it's already fixed)

3) if 1) and 2) fails, provide a link to a complete log file

Let me clarify what I do, maybe there is a misunderstanding or I am doing something wrong:

From the main screen: VIDEOS->Files->(select datasource+enter)->list of videos is showed and runtimes is being read from local kodi DB and added up

That last step , showing the runtimes of the files, was shown in a fraction of a second on LE 8.2.5

Results as from the steps above:

1) same as before, every single file on the storage will be touched/read as soon as datasource is opened for the files to be displayed.

2) tried latest nightly for RPi4, LE 9.8 , the problem is still there.

3) full debug log of previous tries with LE 9.2.5 can be found here: hastebin

However I created a new debug log for LE 9.8, just in case hastebin

Just booted up, went to videos->files->my datasource (smb://storage/files) and left and entered again, then shut down.

**Da Flex** · October 26, 2020 at 10:04 PM Official Post

Watch our nightly builds, probably Kodi 18.9 will fix it (known bug).