Find all files except those in specified folders based on a dupe property

[Herkules97]

Confusing title maybe.

So I am looking through all images on currently plugged in devices to copy some that I find into a folder where they are sorted in some other manner.

Maybe it's a random image from a website that I then sort into a category-named folder like "Memes" if I find it to be that.

How would I go about hiding anything that I've already copied to such folders? I currently have 4. I tried !dupe-from: for them, but then I get 0 results. Reading search functions page, viewtopic.php?t=10176, it looks like I first have to use a dupe property part like sizedupe:/dupe:size in order for it to function.

There is no convenient way to hide any files that exist anywhere that also exists in these 4 folders? !dupe-from:[Folder] seems like it would fit perfectly, without using a dupe: function too.

I am stupid, it would need a duplicate property to search for to ignore. But what if I want to ignore based on a duplicate property, but NOT make the entire list require dupe:. Like !dupe-size-from: and that way it excludes files in a specified folder that exists elsewhere that have the same size? Maybe I've already done something similar to this and forgotten..Not sure I've ever had this sort of task before. If I can ignore duplicate files that exist in the sorted folders, I don't have to go from oldest to newest files. I can look at files from any time, copy to the folders-for-sorting and then they won't show up in future search results. I think maybe to be more sure, and without using something like crc64 indexing, it could support multiple properties.

!dupe-size;name;date-modified-from:"C:\Nothing in here should show up in the search results if I use this" for example.
As in each file is looked at for its size, name and date modified. If elsewhere such a file exists, it is ignored. Not that it looks at one file for its size, name and date modified separately. That would hide more than just duplicates in the specified folder.
I imagine that CPU processing would be big for this sort of thing, but it already is for some stuff I've done. I'm fine with waiting, though sometimes EBV uses resources in a way that makes me think it's soon going to BSOD. Maybe there is a way to slow down EBV so it can't get to the point where other programs freeze or at least have temporary pauses until EBV is done processing a bunch. Maybe using that CPU affinity thing. Idk if that could cause issues, I don't want EBV to crash..Just process slower and thus over a longer period of time so hiccups don't happen for other programs.

[void]

I think maybe to be more sure, and without using something like crc64 indexing

I think a hash property here would probably help, but would make things really slow.

Finding dupes isn't going to help here as it's applied after the search.



One idea is to use file list slots.

Search for:

"c:\my sorted folder\" file:

(where c:\my sorted folder\ is your sorted folder)
Select all files (Ctrl + A)
Copy all filenames (Ctrl + Shift + C)

Search for:

!sizefilelist1:

Right click sizefilelist1: and click Edit File List Slot...
Paste your filenames and click OK.

This will exclude any file with the same size as a file in your filelist1.
It's not perfect as the same size does not mean the same content.
But it might be enough to use as a guide.
-You'll also have to update your filelist1 each time you copy files to "c:\my sorted folder\".



Another option is to just copy to "c:\my sorted folder\"
You'll end up with duplicates, but remove these later..

Maybe there is a way to slow down EBV

Include the following in your search:

max-threads:4

where 4 is the maximum number of threads to use.

[Herkules97]

Another option is to just copy to "c:\my sorted folder\"
You'll end up with duplicates, but remove these later..

Just to clarify, it's not that copying is the issue. More so the scrolling.
Since I am looking at ALL images over the size of 40KB, as the original search was closer to 17 million images on plugged-in devices, there are a lot of images.
I am thinking of doing it as a long-term project, maybe when I am eating sometimes for 5 minutes I scroll a bit, open some images I suspect I might want to sort and then copy if so.

With such a manual process, I won't be copying duplicates or even if I do, they go into the same spot and TeraCopy will ask about it and I can quickly say skip all.

The list is currently 4 million files. I was wondering if it existed, but even if it did..Would I use it? There is a minor risk that there are completely different files with the same size, name, date modified and date created. Probably a tiny minority, but probably not none.

I might copy files from any point in time anyway, this would've just meant they don't show up later when I scroll oldest to newest some more. But at best they should only add 1 more duplicate entry where they are in the list. And with a manual process, I won't copy many files over say a year as I barely resume this task. It might end up being one of those tasks I do so little I forget I was meant to do it at all. I've tried to do it over at least an hour, but it's just too boring. If I was paid to do it I'd probably go homeless instead.