The YT add-on has its own cache management. That means it's an add-on problem with cache management, not an LE problem.
To only delete YT cache, delete the SQLite cache DBs inside of /storage/.kodi/userdata/addon_data/plugin.video.youtube/HEX_STRING_WITH_SOME_ID.
Deleting from the yt app settings should be enough right ?