All red (again...)

So… I’m afraid the story is not done yet. Have synced the collection from my external EDFAT32-drive to the renamed TBSSD-drive. That went well. When I analyzed the tracks in Engine DJ to get the previews, that didn’t work. Re-importing album-art etc did work. Next step is to sync again from the root-drive, to get artists and titles on their place again. That process is takingover 3,5 hours now (talking about the last %) and still isn’t finished. So something still isn’t right. There’s still an engine library on my internal ssd of my MacBook. Should I delete that? Or move it to the EDFAT32 that I use as my root-drive?

I really don’t know why it’s so slow… We might be able to see something in the logs after a slow sync but I doubt it will give us many answers. Not sure where to look for this really.

I need to reproduce the problem but it might be (partially) hardware related.

Is it always slow with any database? Or just that specific database? You can try moving the database to a different disk and try to sync, see if that is slow. Might be harddrive related or a combination of database/hard drive.

Hi Christiaan, I think the MacBook is only slow on this database. What I noticed is that syncing to the clean SSD-drive wasn’t a problem at all. But syncing again caused the very slow process. And what worries me even more is that playlist-changes aren’t synced, or so it seems. I tried to move the database, but I don’t think it had any effect yet. Could there be some setting I forget?

To be honest, I still didn’t figure out what the best way is to change your ‘root-disk’ for the Lexicon-library. Now it’s my (external) EDFAT32-disk, but I want to change this to the (also external) TBSSD-disk. Just to see if that helps. I did notice that the EDFAT32-disk takes to most time to get installed. Maybe that’s a clue? Should I just remove the current collection and import the one that’s on the TBSSD. I’m kind of lost right now.

You can change the disk by using the Find Lost Files utility. Of course you have to copy/move the music files yourself.

I don’t know why it is slow really… I can’t reproduce that at the moment

Hi Christiaan, thanks again for helping. Went to a MacBook-expert today, to see if he could find out if any processes where going wrong. He couldn’t really find anything also. We did shut off I Cloud-drive and removed old apps and that speeded up the Mac a bit, but still the Lexicon-processes take like forever. I hope we’ll find a solution one day…

I don’t know if this is of any help, but here’s a screenshot of the activity monitor. The syncing process is at that moment going on for twente minutes. I guess one minute for the process itself, the rest of it for ‘finishing up’. As you can see there’s a lot of activity going on.

About ten minutes later: still finishing up, still a lot of activity, so it seems. I guess the clue to the problem is: what is Lexicon doing at this point?

One more thing: if I click on the ‘next tip’-button in Lexicon, that doesn’t respond. My guess is Lexicon is working so hard, it doesn’t have the time or energy…

You told me before that at the end of the process, Lexicon is working on the playlists. As I told you, I don’t have tons of them. I checked and it turned out to be 744. Generally it’s playlists in folders in folders in folders. Could that be a problem?

I just had another user report a similar problem, except with the new Rekordbox database writing. That’s also SQLite and uses the same database code. His problem was on an external SSD connected with USB 3.1. Maybe the problem lies there somewhere, I have to run tests for it.

@Hans_Beuzel I’ll send you a release that logs all SQL statements in a bit, going to build it now.
Same steps as before, delete all logs please.

Here is the logging version

Alright, that will probably be tomorrow!

I don’t know if this is related to the problem, but I noticed that some files where missing in Lexicon on my new root-disk. So I used Carbon Copy Cloner to clone the Engine Music-files. I would expect it to just copy the missing tracks, but it seems to be copying all. Are the files themselves changed in any way by Lexicon? (I thought only the database would be changed.)

No, only the database is changed

So how can it be CCC copies all the files? It’s a programm that first compares the files and if they are not the same, copies the original to the target-disk. So that’s at least strange.

I don’t know but Engine export really doesn’t change the files

Okay, meanwhile I’m doing a sync. It’s finishing up for two hours now. Could I abort the process and send the log or is it necessary to complete the process?

Aborting it is fine, I think we can see something in there already

After that, can you try disabling Spotlight indexing for that drive and see if that helps the speed?