Easy way to find corrupted/truncated files? / Queries for missing metadata.

Discussion related to "Everything" 1.5.
Post Reply
Turok
Posts: 46
Joined: Fri Nov 22, 2024 12:26 pm

Easy way to find corrupted/truncated files? / Queries for missing metadata.

Post by Turok »

I have some corrupted videos disperse among different paths. Them appear as "truncated" in Format Factory.
So I'd need a query to use in Everything that can find them all in once.
Maybe the way is to use queries to find files without certain metadata like: No resolution. No FPS. No codecs. No length.
I guess there must be a standard query for it, I just can't find it.
therube
Posts: 5723
Joined: Thu Sep 03, 2009 6:48 pm

Re: Easy way to find corrupted/truncated files? / Queries for missing metadata.

Post by therube »

(Thinking MediaInfo might be better for that?
Can run from GUI or command-line.
Might be able to set up a batch file to parse MI output, looking for "Conformance errors", outputting said file names to a "thesefilesmaycontainerrors.TXT".
.
MediaInfo - Conformance errors.png
MediaInfo - Conformance errors.png (17.99 KiB) Viewed 1870 times
)
Turok
Posts: 46
Joined: Fri Nov 22, 2024 12:26 pm

Re: Easy way to find corrupted/truncated files? / Queries for missing metadata.

Post by Turok »

therube wrote: Wed Nov 12, 2025 5:41 pm (Thinking MediaInfo might be better for that?
Can run from GUI or command-line.
Might be able to set up a batch file to parse MI output, looking for "Conformance errors", outputting said file names to a "thesefilesmaycontainerrors.TXT".
.
MediaInfo - Conformance errors.png)
Nice I'll give it a try, thanks.
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Easy way to find corrupted/truncated files? / Queries for missing metadata.

Post by void »

Everything is not a validator.

However, Everything can be used to find files with missing signatures or properties.

For example, to find mp4 files that do not have a valid file signature:

*.mp4 !file-signature:video/mp4


! = NOT



To find video files with no resolution:

video: !height:




To find video files with no FPS:

video: !frame-rate:




To find video files with no length:

video: !length:
therube
Posts: 5723
Joined: Thu Sep 03, 2009 6:48 pm

Re: Easy way to find corrupted/truncated files? / Queries for missing metadata.

Post by therube »

I'll note, since I happened to run across it yesterday, that not all files may return pertinent data.

Had 2 (old) .mpg (or were they .swf ?), different sizes.
MediaInfo showed exactly the same results for both files.
(Now, something like that is possible, but in this case the files were not "the same" length, the shorter did not play to its expected length.)

Hashmedia also showed that the audio portion of the files was identical (but not the video).
(Don't know if that is accurate ? or is a failure of the hash check? Don't know who the audio is "stored", as in is it a separate "blob" in the file, or is the audio & video recorded "together", in sync or something like that? If the latter, then highly unlikely that the audio was in fact identical.)

Turns out that 1 of the files, binary compare, was simply truncated.
(The files were identical - up to the length of the shorter file.)


Related, How to find similar videos? Does properties help?
Turok
Posts: 46
Joined: Fri Nov 22, 2024 12:26 pm

Re: Easy way to find corrupted/truncated files? / Queries for missing metadata.

Post by Turok »

void wrote: Wed Nov 12, 2025 11:43 pm Everything is not a validator.

However, Everything can be used to find files with missing signatures or properties.

For example, to find mp4 files that do not have a valid file signature:

*.mp4 !file-signature:video/mp4


! = NOT



To find video files with no resolution:

video: !height:




To find video files with no FPS:

video: !frame-rate:




To find video files with no length:

video: !length:
Nice.
Since I have the length property indexed this search is done in seconds. The others take a long time, and I guess it's probably that they end up showing the same results as filtering by no length.
Now it would be helpful if there was a way to filter by no thumbnail -maybe not possible- because the really truncated videos with no length don't show one, while those that show one are ok even with no length.

Is there a reference list of properties I can check to search for "video: !" ?

Tried to replace video: for audio: but there are 0 without length. Is "audio" a correct query?
therube wrote: Wed Nov 12, 2025 5:41 pm (Thinking MediaInfo might be better for that?
Can run from GUI or command-line.
Might be able to set up a batch file to parse MI output, looking for "Conformance errors", outputting said file names to a "thesefilesmaycontainerrors.TXT".
.
MediaInfo - Conformance errors.png)
Tried but I did not found how to set up that batch file filtered by "conformance errors". I need to look further.
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Easy way to find corrupted/truncated files? / Queries for missing metadata.

Post by void »

Now it would be helpful if there was a way to filter by no thumbnail -maybe not possible- because the really truncated videos with no length don't show one while those that show one are ok even with no length.
I don't have an search function to check if the thumbnail is valid.
Thumbnails use a different database.


Is there a reference list of properties I can check to search for "video: !" ?
Video Properties

These can also be found in Everything under Right click Search box -> Search Function -> Property Search -> Select Video on the left.


Tried to replace video: for audio: but there are 0 without length. Is "audio" a correct query?
video:
matches video files, eg: *.avi, *.mp4 and *.mkv

audio:
matches audio files, eg: *.mp3 and *.flac

These macros reference your Video and Audio filter.
Post Reply