Within Everything find dupe of selected file (size-ext)

[eswul62]

Following scenario: Filter on ext:psd, selected drive: F:
select click a psd file

Now find duplicates elsewhere based on size and ext, but ... leave the current view in place.
This from within Everything.

Currently I use a workaround, jump to the folder (Opus) then do the duplicate search from there, viz. Opus context menu.
That will bring up duplicates in a separate Everything tab bar.

I wonder whether this can be done within Everything, no idea.

Thanks.

SnagIt-22112024 143554.png (25.37 KiB) Viewed 11748 times

[void]

Please consider adding a context menu item to find duplicated items in Everything based on size and extension:

• From the Start menu, search for:
  regedit
• Right click Registry Editor and click Run as administrator.
• Navigate to:
  
  HKEY_CLASSES_ROOT\*
• Create the following key:
  
  shell
  
  
• Navigate to:
  
  HKEY_CLASSES_ROOT\*\shell
• Create the following key:
  
  Find dupes in Everything
  
  
• Navigate to:
  
  HKEY_CLASSES_ROOT\*\shell\Find dupes in Everything
• Create the following key:
  
  command
  
  
• Navigate to:
  
  HKEY_CLASSES_ROOT\*\shell\Find dupes in Everything\command
• Set the (Default) value data to:
  
  "C:\Program Files\Everything\Everything.exe" -new-tab -s size:[getsize:"%1"]" "ext:[extension:"%1"]
  
  (where C:\Program Files\Everything\Everything.exe is your Everything.exe location)

Right click your file and click Find dupes in Everything
Everything will open a new tab with the search:

size:<the size of your file> extension:<the extension of your file>

-new-tab
[extension:...]
[getsize:...]

[eswul62]

Thanks a lot! Matter solved.

FWIW and just for info: one way or the other no dups were found in the new tab.
Regretfully, I couldn't get it working.
Maybe some 'get' was missing, really don't know.
Anyway, I have made a little change to the parameters:

Code: Select all

"C:\Program Files\Everything\Everything.exe" /new-tab -s* size:[getsize:"%1"] ext:[get-property:"%1","extension"]

(as used in Opus)

This works fine.

Thanks again - I wouldn't have figured this out myself (registry settings)

[Turok]

Please consider adding a context menu item to find duplicated items in Everything based on size and extension:

• From the Start menu, search for:
  regedit
• Right click Registry Editor and click Run as administrator.
• Navigate to:
  
  HKEY_CLASSES_ROOT\*
• Create the following key:
  
  shell
  
  
• Navigate to:
  
  HKEY_CLASSES_ROOT\*\shell
• Create the following key:
  
  Find dupes in Everything
  
  
• Navigate to:
  
  HKEY_CLASSES_ROOT\*\shell\Find dupes in Everything
• Create the following key:
  
  command
  
  
• Navigate to:
  
  HKEY_CLASSES_ROOT\*\shell\Find dupes in Everything\command
• Set the (Default) value data to:
  
  "C:\Program Files\Everything\Everything.exe" -new-tab -s size:[getsize:"%1"]" "ext:[extension:"%1"]
  
  (where C:\Program Files\Everything\Everything.exe is your Everything.exe location)

Right click your file and click Find dupes in Everything
Everything will open a new tab with the search:

size:<the size of your file> extension:<the extension of your file>

-new-tab
[extension:...]
[getsize:...]

Excellent, I was looking for this.
But I have a problem. For some files it works, but for others it opens a new tab with just this: "size:"
I'd also like to ask for the command to replace the "getsize" command for one to get "length" if that's possible.

[void]

But for others it opens a new tab with just this: "size:"

Please make sure Everything has access to the file.
-If Everything is running as administrator, Everything will not have access to mapped network drives.
-Is Everything showing [administrator] in the window caption?

Please check the command line sent to Everything:

• In Everything, from the Tools menu, under the Debug submenu, click console.
• Perform your context menu -> Find dupes in Everything
• Check your debug console for:
  
  cl: "C:\Program Files\Everything 1.5a\Everything64.exe" -new-tab -s size:[getsize:"c:\path\to\file.txt"]" "extension:[extension:"c:\path\to\file.txt"]

Please make sure the path looks correct, for example:

c:\path\to\file.txt

-Please try the path in Windows Explorer to ensure it's valid.

To close the debug console:

• In Everything, from the Tools menu, under the Debug submenu, uncheck console.

Please make sure size indexing is enabled under Tools -> Options -> Indexes.
Please make sure Everything is reporting the correct file size for the file.

[getsize:] will pull the size from your index if available.
If the size information is not available from your index, the size is gathered from disk.

I'd also like to ask for the command to replace the "getsize" command for one to get "length" if that's possible.

Please try the following command:

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[eval:[getproperty:"%1","length"]/10000000]

(where C:\Program Files\Everything\Everything.exe is your Everything.exe location)



[getsize:]
[getproperty:]

[Turok]

But for others it opens a new tab with just this: "size:"

Please make sure Everything has access to the file.
-If Everything is running as administrator, Everything will not have access to mapped network drives.
-Is Everything showing [administrator] in the window caption?

Please check the command line sent to Everything:

• In Everything, from the Tools menu, under the Debug submenu, click console.
• Perform your context menu -> Find dupes in Everything
• Check your debug console for:
  
  cl: "C:\Program Files\Everything 1.5a\Everything64.exe" -new-tab -s size:[getsize:"c:\path\to\file.txt"]" "extension:[extension:"c:\path\to\file.txt"]

Please make sure the path looks correct, for example:

c:\path\to\file.txt

-Please try the path in Windows Explorer to ensure it's valid.

To close the debug console:

• In Everything, from the Tools menu, under the Debug submenu, uncheck console.

Please make sure size indexing is enabled under Tools -> Options -> Indexes.
Please make sure Everything is reporting the correct file size for the file.

[getsize:] will pull the size from your index if available.
If the size information is not available from your index, the size is gathered from disk.

I'd also like to ask for the command to replace the "getsize" command for one to get "length" if that's possible.

Please try the following command:

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[getproperty:"%1","length"]

(where C:\Program Files\Everything\Everything.exe is your Everything.exe location)



[getsize:]
[getproperty:]

Thank you for helping.
Sorry for the delay, I had to sort out some other issues with other matters and I didn't have time to concentrate on this.

I followed the steps:

Everything is running as Admin.
The drive is not a mapped drive.
Path is correct.
Size is correct.
Index file size is enabled.

After trying with a few files for each drive, I just noticed that the size search seems to work for any file from all drives except one.


I've also tried the command you provided to perform the length search:

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[getproperty:"%1","length"]

But the result is strange. It performs the search (for example: length:"9830000000"), but it finds nothing, not even the original file from which I made the search.

[therube]

The length of "9830000000" is dealing in microseconds.
In order to find a "length:", you need to convert that to seconds, so 9830000000/1000000 = 9830s

So the you'd want

length:9830

.

[Turok]

The length of "9830000000" is dealing in microseconds.
In order to find a "length:", you need to convert that to seconds, so 9830000000/1000000 = 9830s

So the you'd want

length:9830

.

I see and appreciate the clarification, but this is the result of using this command:

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[getproperty:"%1","length"]

as a key in Regedit which was proposed by Void in order to find dupes by length from a context menu shortcut.
If you're saying that in case the command result was in secs instead of microseconds it would be successful in finding a dupe, then can you tell what should I change in the command to get this result?

[void]

Please try the following:

Code: Select all

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[eval:[getproperty:"%1","length"]/10000000]

[Turok]

Please try the following:

Code: Select all

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[eval:[getproperty:"%1","length"]/10000000]

Excellent! this one works perfectly. Thank you both for the fix
To finish this, and forgive me if it's too much to ask but it would be very useful if there was a command to join both commands, so you can find an exact duplicate with the same size and length. Is there a way?
I've made a few attempts to try to put them together (blindly because I have no idea about this topic) but none of them worked.

Also, void, if there's anything else I can try to make the files on that drive searchable with these commands, I'd appreciate it if you'd tell me, because I'm lost. The disk has the same indexing options as others that do work with these commands

After trying with a few files for each drive, I just noticed that the size search seems to work for any file from all drives except one.

[void]

For same size and length, please try:

Code: Select all

"C:\Program Files\Everything\Everything.exe" -new-tab -s size:[getsize:"%1"]" "length:[eval:[getproperty:"%1","length"]/10000000]

In practice, you should only need to check size as it should be rather unique.

[Turok]

For same size and length, please try:

Code: Select all

"C:\Program Files\Everything\Everything.exe" -new-tab -s size:[getsize:"%1"]" "length:[eval:[getproperty:"%1","length"]/10000000]

In practice, you should only need to check size as it should be rather unique.

Oh can confirm that you're right, it's not necessary, but thanks for providing it it works.

[Turok]

But for others it opens a new tab with just this: "size:"

Please make sure Everything has access to the file.
-If Everything is running as administrator, Everything will not have access to mapped network drives.
-Is Everything showing [administrator] in the window caption?

Please check the command line sent to Everything:

• In Everything, from the Tools menu, under the Debug submenu, click console.
• Perform your context menu -> Find dupes in Everything
• Check your debug console for:
  
  cl: "C:\Program Files\Everything 1.5a\Everything64.exe" -new-tab -s size:[getsize:"c:\path\to\file.txt"]" "extension:[extension:"c:\path\to\file.txt"]

Please make sure the path looks correct, for example:

c:\path\to\file.txt

-Please try the path in Windows Explorer to ensure it's valid.

To close the debug console:

• In Everything, from the Tools menu, under the Debug submenu, uncheck console.

Please make sure size indexing is enabled under Tools -> Options -> Indexes.
Please make sure Everything is reporting the correct file size for the file.

[getsize:] will pull the size from your index if available.
If the size information is not available from your index, the size is gathered from disk.

I'd also like to ask for the command to replace the "getsize" command for one to get "length" if that's possible.

Please try the following command:

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[getproperty:"%1","length"]

(where C:\Program Files\Everything\Everything.exe is your Everything.exe location)



[getsize:]
[getproperty:]

Thank you for helping.
Sorry for the delay, I had to sort out some other issues with other matters and I didn't have time to concentrate on this.

I followed the steps:

Everything is running as Admin.
The drive is not a mapped drive.
Path is correct.
Size is correct.
Index file size is enabled.

After trying with a few files for each drive, I just noticed that the size search seems to work for any file from all drives except one.


I've also tried the command you provided to perform the length search:

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[getproperty:"%1","length"]

But the result is strange. It performs the search (for example: length:"9830000000"), but it finds nothing, not even the original file from which I made the search.

I don't know why, but just tried and now both commands work also on that specific drive. I recently installed a new version, maybe was this.

But to avoid starting a new thread. I'd like to know if there's a command that allows to find for length dupes in a more precise way (microseconds?) than the proposed:

Code: Select all

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[eval:[getproperty:"%1","length"]/10000000]

Because this one finds too many dupes that have the same length in seconds. It works for certain files with not many dupes, but there are lengths shared by many.

The original one (In microseconds?):

Code: Select all

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[getproperty:"%1","length"]

Retrieves no results.

[void]

-s length:[getproperty:"%1","length"]

This will not work, the length needs to be formatted first.

To find length duplicates, with millisecond accuracy, please try:

Code: Select all

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[format-duration:[getproperty:"%1","length"],"[h]:mm:ss.SSS"]

[Turok]

-s length:[getproperty:"%1","length"]

This will not work, the length needs to be formatted first.

To find length duplicates, with millisecond accuracy, please try:

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[format-duration:[getproperty:"%1","length"],"[h]:mm:ss.SSS"]

Ok, I tried but I'm getting no milliseconds like: length:0:00:42.000 or length:0:02:35.000

[void]

What version of Everything are you using? (Help -> About Everything)

[Turok]

What version of Everything are you using? (Help -> About Everything)

Version 1.5.0.1400a (x64)

[void]

Thanks for the version information.

What registry string did you use?

Is Everything finding the length in milliseconds correctly?
-Please change your Tools -> Options -> Advanced -> duration_format to:

[d]:hh:mm:ss.SSS

Check the displayed length matches with the length search after right clicking and clicking Find length duplicate in Everything

[Turok]

Thanks for the version information.

What registry string did you use?

Is Everything finding the length in milliseconds correctly?
-Please change your Tools -> Options -> Advanced -> duration_format to:

[d]:hh:mm:ss.SSS

Check the displayed length matches with the length search after right clicking and clicking Find length duplicate in Everything

I used this string:

Code: Select all

"C:\Program Files\Everything\Everything.exe" -new-tab -s length:[format-duration:[getproperty:"%1","length"],"[h]:mm:ss.SSS"]

So I changed the format in advanced and the result is that many files keep showing no milliseconds value (.000). I'm not sure if the drive matters. To test this I'd need the query to find for files of this length: *:**:**:**.+++ (where asterisks would be any value and + too but higher than a 0). Because there seems to be a certain pattern like: Movies & TV Series episodes mostly show a full format length while videos and audio from sources like Video/Audio hosting sites or social media report .000 milliseconds (not for all though). But could also be the drives where the files are located (?). Or more likely a codecs matter?
For videos, I checked a few of those .000 and in Format Factory the codec reported is:
Codec ID : isom (isom/iso2/avc1/mp41)
(Or another similar with isom in its name/header)

While movies and series episodes have total different codecs.

Despite it, a file (example) reported in Everything as 0:00:00:19.000 in Format Factory > Media file info is reported as: Duration : 19 s 770 ms. So the info is there

Also others (seems to happen for a little percentage) have no length value (it's empty) in Everything but do have it in explorer and format factory as well.
This must be due to the limitation to certain formats I have specified in properties > Length > Include only this format.
Even if these files without length have a .mp4 extension, in FormatFactory it says "FileExtension_invalid".

Example:
Extension :.mp4
Format : MPEG-TS
FileExtension_Invalid : ts m2t m2s m4t m4s tmf ts tp trp ty
Duration : 10 s 478 ms

Video:
Format : AVC

Audio:
Format : MPEG Audio

I guess I'll have to add an extended list of video extensions for these files to be indexed properly.

[void]

But could also be the drives where the files are located (?).

It shouldn't matter.

Or more likely a codecs matter?

It shouldn't matter.



Everything uses the Windows Property System "System.Media.Duration" property to gather the file length.

This is a 100nanosecond value.

Windows provides some default property handlers for common types, like mp4
The registered property handler can be changed.

If the Windows property system doesn't return a value, Everything will fall back to a built-in property handler for mp4 files.

For some reason the Windows property system handler is returning a 100nanosecond value with only seconds as valid.
Maybe it has something to do with the file not being a valid mp4 file.
What does the Everything "File signature" property show for your mp4 files?

[Turok]

But could also be the drives where the files are located (?).

It shouldn't matter.

Or more likely a codecs matter?

It shouldn't matter.



Everything uses the Windows Property System "System.Media.Duration" property to gather the file length.

This is a 100nanosecond value.

Windows provides some default property handlers for common types, like mp4
The registered property handler can be changed.

If the Windows property system doesn't return a value, Everything will fall back to a built-in property handler for mp4 files.

For some reason the Windows property system handler is returning a 100nanosecond value with only seconds as valid.
Maybe it has something to do with the file not being a valid mp4 file.
What does the Everything "File signature" property show for your mp4 files?

Right on the spot, the problem is with .mp4 extension. All the movies and tv series eps with it report .000.
File signature for mp4 files shows: video/mp4

[Turok]

But could also be the drives where the files are located (?).

It shouldn't matter.

Or more likely a codecs matter?

It shouldn't matter.



Everything uses the Windows Property System "System.Media.Duration" property to gather the file length.

This is a 100nanosecond value.

Windows provides some default property handlers for common types, like mp4
The registered property handler can be changed.

If the Windows property system doesn't return a value, Everything will fall back to a built-in property handler for mp4 files.

For some reason the Windows property system handler is returning a 100nanosecond value with only seconds as valid.
Maybe it has something to do with the file not being a valid mp4 file.
What does the Everything "File signature" property show for your mp4 files?

Right on the spot, the problem is with .mp4 extension. All the movies and tv series eps with it report .000.
File signature for mp4 files shows: video/mp4

Cool, with your help and not wanting to give you extra work not directly related to Everything I'm investigating further about this. After asking GPT to get a better clue it got me to check registry keys and there I found the .mp4 property handler is Icaros. I'll see if I can fix this by tweaking it

[Turok]

It shouldn't matter.



It shouldn't matter.



Everything uses the Windows Property System "System.Media.Duration" property to gather the file length.

This is a 100nanosecond value.

Windows provides some default property handlers for common types, like mp4
The registered property handler can be changed.

If the Windows property system doesn't return a value, Everything will fall back to a built-in property handler for mp4 files.

For some reason the Windows property system handler is returning a 100nanosecond value with only seconds as valid.
Maybe it has something to do with the file not being a valid mp4 file.
What does the Everything "File signature" property show for your mp4 files?

Right on the spot, the problem is with .mp4 extension. All the movies and tv series eps with it report .000.
File signature for mp4 files shows: video/mp4

Cool, with your help and not wanting to give you extra work not directly related to Everything I'm investigating further about this. After asking GPT to get a better clue it got me to check registry keys and there I found the .mp4 property handler is Icaros. I'll see if I can fix this by tweaking it

I've tried disabling properties handling inside Icaros and created some new mp4 files. These showed milliseconds, but previously created did not. Installed a new version of Icaros but the problem persists.

GPT recommends this: "Keep Icaros but configure Everything to use its internal MP4 parser" and provides a powershell script "to precompute durations with ffprobe/MediaInfo and import them".
Is there a way to do the first without that script? (I don't trust it wont break something or hit the performance in some way).

Alternatively I can try to disable mp4 from the properties handler in Icaros but when I tried thumbnails stopped being generated and many properties were faulty in explorer. Maybe because I did not restart the process yet.

[void]

"Keep Icaros but configure Everything to use its internal MP4 parser"

Tools -> Options -> Advanced -> property_builtin_handler_priority=1

property_builtin_handler_priority

[Turok]

"Keep Icaros but configure Everything to use its internal MP4 parser"

Tools -> Options -> Advanced -> property_builtin_handler_priority=1

property_builtin_handler_priority

Great, this works! but for new files only. Previously created keep showing no milliseconds. A way to get this done? a re-index maybe? or remove/add length property? whatever, tell me there's a way

[void]

Search for mp4 files:

*.mp4

Select all your files (Ctrl + A)
Press Ctrl + F5 to refresh indexed properties.

[Turok]

Search for mp4 files:

*.mp4

Select all your files (Ctrl + A)
Press Ctrl + F5 to refresh indexed properties.

Like a charm So grateful, this will help me a lot to clean dupes and sort the mess.
Thank you and your talent for providing us with this fantastic software alongside with your dedication and time to help us get the most out of it