How can I remove duplicates based on whether they are in playlists or not?

If I have two duplicate tracks, and one of them is already in a playlist but the other is unfiled in my collection, how can I make sure that I am removing the right one?

I know I can go into Rekordbox and just look at each one but that will take a while!

What you can do is use the Playlist Occurrency utility (top menu bar) and put it on zero. That gives you all tracks without a playlist. Give all those track a custom tag like No playlist.
Then run the duplicate scanner and show the Custom Tags in the results