Filled up RAM breaks usage of Everything

General discussion related to "Everything".
Post Reply
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

Weeks ago I was suppose to publish such post [entitled "Automated re-scanning issues evolved into inability to use at all"]:
For a dozens od days it seemed that every time I performed a reset of system my Everything had to re-scan - and most likely a lot [all?] of items as it was taking forever to do so [because I have ~14 millions of them]. But this was not happening if I deleted Recycle Bin folders from my volumes i.e. making sure nothing was left in them - but not by merely cleaning them but by removing those folders

At first I thought that only Everything was culprit / being affected as recently I have added some Bookmarks that forced Everything to scan a lot, suspecting that some media files after being sent to Recycle Bin were then unnecessary re-scanned - and which process was somehow causing also rescanning of similar files that were not deleted

But then I have noticed that I have a similar problem in filemanager FreeCommander and even in Windows Explorer: that if I navigate to the overall Recycle Bin system folder they both pretty much freeze at the task of indexing deleted items. And that if I get rid of Recycle Bin folders then I can re-enter them [when they get re-created by the operating system] using those very same filemanagers - but this time without a sweat. And so because of that as culprit I was suspecting very long either names or original paths of some deleted items

But now it is apparently getting even worst. And that is because at first Everything was showing on its bottom bar info about accessing volume D - a letter that is assigned only for newly connected / temporarily drives. And yes: I checked back then if some forgotten pendrive was not connected to my machine and double checked if Disk Management of Windows was not reporting some new / unknown entry. Later on instead of coming to its senses and fixing itself [like it was doing multiple times after all those multiple finished re- cannings in the past days] Everything becomes unusable, because even after a reset of the system when I open Everything it is still was plain frozen. It was only after a lot of clicking and multiple minutes that a pop-up question appears allowing me to cancel a query

So now my Everything is doing yet another re-scannng after which it will become working fine - up until I close and re-open it or reset the system

And thus I am: is there an easy way to know what exactly was triggering this and what was being re-scan?


I am using Everything 1.5.0.1383a x64 Portable on Windows 10 Enterprise 20H2 x64 [10.0.19042]
But as it turns out, i.e. after weeks of first figuring this out and then having acquired more than enough empirical experience plus replacing my not so old set of 4 x 16 GB sticks for a brand new 4 x 16 GB set, the culprit all along wat the Random Access Memory - or to be precise: the lack of it

Because if my RAM resources start hitting those 99-100% then Everything might become unresponsive, as it is unable to process data required for creation of my 1.15 GB database file. So what was happening [at least in the beginning] was me getting rid of those extra / unnecessary items in Recycle Bin - and thus making Everything free of the burden of having to index them. And also I was making mistake the same mistake of opening RAM hungry programs after entering the Windows and awaiting for Everything to finish its bidding


So if the root cause is user's machine running out of RAM then should not Everything inform user about such critical situation - instead of just freezing up? Maybe there could be a pop-up showing up whenever Everything would detect the event of the operating system hitting some percentage of RAM usage? The default value could be set to e.g. 95% but the user should be able to set it to whatever level desired or even set 2 [i.e. first warning and a critical one]

And yes: my other programs also suffer from RAM running out. But some of them pop-up informative or at least general errors - and thus either inform what is wrong or encourage me to investigate what might be wrong
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

I will consider showing warnings when Everything is paged to disk or there's a low memory availability.

Thank you for the suggestion.



Everything will fatal error if it cannot allocate 64K or less memory.
Everything will silently fail for larger allocations when there's not enough memory.



Everything may freeze when it is paged to disk.

To prevent Everything from being paged to disk:
  • In Everything 1.5, from the Tools menu, click Options.
  • Click the Advanced tab on the left.
  • To the right of Show settings containing, search for:
    virtual_lock
  • Select: virtual_lock
  • Set the value to: true
  • To the right of Show settings containing, search for:
    working
  • Select: max_working_set_size
  • Set the value to: 2147483647
  • Select: min_working_set_size
  • Set the value to: 2147483647
  • Click OK.
  • Restart Everything (File -> Exit)
virtual_lock
max_working_set_size
min_working_set_size
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

I will see how Everything will behave with the above settings

But is this
2147483647
value specific for someone who [like me currently] uses 64 GB of RAM? I mean: will I have to adjust it if I change my hardware in this regard?
Last edited by Thy Grand Voidinesss on Tue Aug 19, 2025 2:57 pm, edited 1 time in total.
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

Set min_working_set_size and max_working_set_size to a little more than your normal Everything RAM usage.

I don't recommend setting min_working_set_size and max_working_set_size to more than half your total RAM. (32GB in your case)

Windows may still page Everything to disk in low memory situations.
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

I have just changed it to
2222222222
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

And am I correct to assume that the more items I will have in overall throughout my volumes and the more of them will be pre-cached at

Tools > Options > Indexes > Properties

then the more of such minimum RAM value I should reserve within Everything?
Last edited by Thy Grand Voidinesss on Tue Aug 19, 2025 2:58 pm, edited 1 time in total.
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

Correct, each file/folder may consume some RAM usage for each property.

Property filters will help reduce the amount of required RAM.
For example, if you index length for *.mp3 files, only the .mp3 files will consume extra RAM for the length property.

Aim to set the min_working_set_size and max_working_set_size to around the normal RAM usage of Everything.
The reason for not setting such a high value (something like 8GB+ in your case) is to prevent Everything from using all available RAM in high memory usage situations, like reindexing, sorting, etc..
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

But what will happen now [with this option having been set up] when Everything will reach 100% of its allocated portion of RAM: it will freeze / break [like it was doing it my description of the reported issue symptoms] - or will it just work slower but it will be prevented from freezing [because it will not let go of its allocated memory]?
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

Everything should run fine while it is in the foreground and there's plenty of available RAM.

Windows may start paging memory to disk when RAM usage is over max_working_set_size.
Windows likes to page memory to disk when the program is minimized or in the background or when there's low available RAM.

Everything will run slower or freeze when recalling paged memory from disk.
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

But if my current system has 64 GB of RAM and my next one will probably have 128 GB then, then should not I set min_working_set_size to 3 GB and max_working_set_size to 6 GB in order to make sure Everything will run smoothly, especially when I reconnect my huge archive drives?

I as already said, I pre-cache - quite a few properties of multimedia files. Like for example amount of channels or presence of subtitles; and I have hundred of thousands of such files on my system, plus millions on offline archives. Smooth handling of them on a daily basis is a priority for me

And I know you said
void wrote: Sun Dec 15, 2024 9:32 pm Set min_working_set_size and max_working_set_size to a little more than your normal Everything RAM usage.
[...]
But what constitutes as normal usage? When Everything is idle because nothing new is being indexed or searched for?

And should not the MAX value be significantly bigger than MIN? I mean: whats the point of having them at a similar or even the same level?


All in all: if I do not want my workflow to suffer from slowing of Everything during data transfers to my archive drive and them becoming a subject of newly added Properties to my indexing array, the I should anticipate increased demand for RAM by Everything in future - and thus grand it those GBs ahead of time, right?
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

While awaiting answer to my reflection, this indexation issue has arisen: viewtopic.php?t=16892

Might it have something to do with my RAM settings?
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

Can I have answers to question from this post: viewtopic.php?p=76775#p76775


I have been using now for over a month Everything 1.5.0.1404a x64 Portable on a brand new machine with DDR5 on which I installed from scratch Windows 10 IOT Enterprise LTSC 21H2 x64 upgraded with latest updates, while previously I was running on falling apart hardware with DDR4 and Windows 10 Enterprise 20H2 x64 that I had stopped updating ~3 years later - but the issues still prevails. Sometimes my 64 GB or RAM gets filled up by Everything, thus surpassing few times over the 5.3 GB it seems to use when it does not start to malfunction

And even right now while I was writing this very paragraph and went back to Task Manager to double check if it was still 5.3 GB, I saw it adding suddenly a little over ~100 MB per second [Task Manager > View > Update speed > Normal] - up to 9.5 GB, at which point it stopped. All I did was writing a draft version of this post (as an e-mail in Thunderbird) and did not do any change to my hardware. So I just experience a Matrix like situation: for 7 hours my RAM was OK, but then I looked away for a moment and suddenly Everything started to grab it, but stopped by itself after around half a minute

This latest experience suggest it is some automated background process that fools Everything into collecting excess of unnecessary data. This theory of mine is somewhat confirmed by the fact that less often by Everything, the RAM gets grabbed by some unreported in Task Manager process - because it shows me over half of it being used up, despite me closing all RAM hungry processes. At least that is what it looks like to me - so: is there some way I could add up automatically the values from the

Task Manager > Processes > Memory

column, so that either I could confirm or debunk my suspension that header of this columns mismatches the actual sum from all those entries presented within that tab?


My current Advanced values are

Code: Select all

max_working_set_size
16000000000

min_working_set_size
8000000000
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

What properties are you indexing? (Help -> Troubleshooting Information -> Properties)

My guess is Everything is reading a bad property.
Please try Everything without indexing any properties under Tools -> Options -> Properties.
Does the issue persist?
-Please try re-adding each property back and see which one triggers the issue.



Please reset min_working_set_size and max_working_set_size under Tools -> Options -> Advanced.
Do not set these options when you are indexing over 5GB of data.
I do not recommend indexing over 1GB of data.
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

void wrote: Sat Jan 31, 2026 10:41 pm What properties are you indexing? (Help -> Troubleshooting Information -> Properties)
I am indexing

Code: Select all

properties=[{"name":"Audio Bits Per Sample","include_only_files":"AAC;*.APE;*.FLAC;*.M4A;*.MID;*.MIDI;*.MOD;*.MP2;*.MP3;*.MPC;*.OGG;*.S3M;*.SAP;*.TTA;*.WAV;*.WMA;*.WV;*.◀◀◀AUDIO●●●VIDEO▶▶▶;*.3GP;*.3GP2;*.AVI;*.BDMV;*.BK2;*.DIVX;*.DV;*.F4V;*.FLV;*.IFO;*.M2P;*.M2T;*.M2TS;*.M2V;*.M4R;*.M4V;*.MCF;*.MK3D;*.MKA;*.MKS;*.MKV;*.MOV;*.MPV;*.MTS;*.MP4;*.MPEG;*.MPEG2;*.MPG;*.MXF;*.OGM;*.OGV;*.QT;*.RAM;*.RM;*.RMVB;*.SMF;*.SMK;*.TS;*.VOB;*.WEBM;*.WMV;*.XWM"},{"name":"Audio Channels","include_only_files":"AAC;*.APE;*.FLAC;*.M4A;*.MID;*.MIDI;*.MOD;*.MP2;*.MP3;*.MPC;*.OGG;*.S3M;*.SAP;*.TTA;*.WAV;*.WMA;*.WV;*.◀◀◀AUDIO●●●VIDEO▶▶▶;*.3GP;*.3GP2;*.AVI;*.BDMV;*.BK2;*.DIVX;*.DV;*.F4V;*.FLV;*.IFO;*.M2P;*.M2T;*.M2TS;*.M2V;*.M4R;*.M4V;*.MCF;*.MK3D;*.MKA;*.MKS;*.MKV;*.MOV;*.MPV;*.MTS;*.MP4;*.MPEG;*.MPEG2;*.MPG;*.MXF;*.OGM;*.OGV;*.QT;*.RAM;*.RM;*.RMVB;*.SMF;*.SMK;*.TS;*.VOB;*.WEBM;*.WMV;*.XWM"},{"name":"Audio Sample Rate","include_only_files":"AAC;*.APE;*.FLAC;*.M4A;*.MID;*.MIDI;*.MOD;*.MP2;*.MP3;*.MPC;*.OGG;*.S3M;*.SAP;*.TTA;*.WAV;*.WMA;*.WV;*.◀◀◀AUDIO●●●VIDEO▶▶▶;*.3GP;*.3GP2;*.AVI;*.BDMV;*.BK2;*.DIVX;*.DV;*.F4V;*.FLV;*.IFO;*.M2P;*.M2T;*.M2TS;*.M2V;*.M4R;*.M4V;*.MCF;*.MK3D;*.MKA;*.MKS;*.MKV;*.MOV;*.MPV;*.MTS;*.MP4;*.MPEG;*.MPEG2;*.MPG;*.MXF;*.OGM;*.OGV;*.QT;*.RAM;*.RM;*.RMVB;*.SMF;*.SMK;*.TS;*.VOB;*.WEBM;*.WMV;*.XWM"},{"name":"Audio Track Count","include_only_files":"AAC;*.APE;*.FLAC;*.M4A;*.MID;*.MIDI;*.MOD;*.MP2;*.MP3;*.MPC;*.OGG;*.S3M;*.SAP;*.TTA;*.WAV;*.WMA;*.WV;*.◀◀◀AUDIO●●●VIDEO▶▶▶;*.3GP;*.3GP2;*.AVI;*.BDMV;*.BK2;*.DIVX;*.DV;*.F4V;*.FLV;*.IFO;*.M2P;*.M2T;*.M2TS;*.M2V;*.M4R;*.M4V;*.MCF;*.MK3D;*.MKA;*.MKS;*.MKV;*.MOV;*.MPV;*.MTS;*.MP4;*.MPEG;*.MPEG2;*.MPG;*.MXF;*.OGM;*.OGV;*.QT;*.RAM;*.RM;*.RMVB;*.SMF;*.SMK;*.TS;*.VOB;*.WEBM;*.WMV;*.XWM"},{"name":"Compression Format"},{"name":"Container Filenames","include_only_files":"*.7Z;*.CBZ;*.GZ;*.PK3;*.RAR;*.ZIP"},{"name":"Display Name","include_folders":1,"fast_sort":1},{"name":"Free Disk Size","include_folders":1,"include_files":0,"exclude_folders":"**\\**","fast_sort":1},{"name":"Length","include_only_files":"AAC;*.APE;*.FLAC;*.M4A;*.MID;*.MIDI;*.MOD;*.MP2;*.MP3;*.MPC;*.OGG;*.S3M;*.SAP;*.TTA;*.WAV;*.WMA;*.WV;*.◀◀◀AUDIO●●●VIDEO▶▶▶;*.3GP;*.3GP2;*.AVI;*.BDMV;*.BK2;*.DIVX;*.DV;*.F4V;*.FLV;*.IFO;*.M2P;*.M2T;*.M2TS;*.M2V;*.M4R;*.M4V;*.MCF;*.MK3D;*.MKA;*.MKS;*.MKV;*.MOV;*.MPV;*.MTS;*.MP4;*.MPEG;*.MPEG2;*.MPG;*.MXF;*.OGM;*.OGV;*.QT;*.RAM;*.RM;*.RMVB;*.SMF;*.SMK;*.TS;*.VOB;*.WEBM;*.WMV;*.XWM","fast_sort":1},{"name":"Shortcut Target","include_only_files":"*.LNK","fast_sort":1},{"name":"Subtitle Track Count","include_only_files":"*.3GP;*.3GP2;*.AVI;*.BDMV;*.BK2;*.DIVX;*.DV;*.F4V;*.FLV;*.IFO;*.M2P;*.M2T;*.M2TS;*.M2V;*.M4R;*.M4V;*.MCF;*.MK3D;*.MKA;*.MKS;*.MKV;*.MOV;*.MPV;*.MTS;*.MP4;*.MPEG;*.MPEG2;*.MPG;*.MXF;*.OGM;*.OGV;*.QT;*.RAM;*.RM;*.RMVB;*.SMF;*.SMK;*.TS;*.VOB;*.WEBM;*.WMV;*.XWM"},{"name":"Video Track Count","include_only_files":"*.3GP;*.3GP2;*.AVI;*.BDMV;*.BK2;*.DIVX;*.DV;*.F4V;*.FLV;*.IFO;*.M2P;*.M2T;*.M2TS;*.M2V;*.M4R;*.M4V;*.MCF;*.MK3D;*.MKA;*.MKS;*.MKV;*.MOV;*.MPV;*.MTS;*.MP4;*.MPEG;*.MPEG2;*.MPG;*.MXF;*.OGM;*.OGV;*.QT;*.RAM;*.RM;*.RMVB;*.SMF;*.SMK;*.TS;*.VOB;*.WEBM;*.WMV;*.XWM"}]

void wrote: Sat Jan 31, 2026 10:41 pm My guess is Everything is reading a bad property.
So pin-pointing it will be a task that will take me weeks, if I am to do it when using Everything normally and not focusing all of my time on it

void wrote: Sat Jan 31, 2026 10:41 pm Please try Everything without indexing any properties under Tools -> Options -> Properties.
Does the issue persist?
I think this debugging step should be skipped. Because even if it works, it will leave me practically with a ban on using this feature

void wrote: Sat Jan 31, 2026 10:41 pm -Please try re-adding each property back and see which one triggers the issue.
I think that I will wipe all of them - but then be adding 2 at a time, in order to speed up going through the list

void wrote: Sat Jan 31, 2026 10:41 pm Please reset min_working_set_size and max_working_set_size under Tools -> Options -> Advanced.
But I will most likely start with this, as it it less effort and affects the already used all other settings, right?

void wrote: Sat Jan 31, 2026 10:41 pm Do not set these options when you are indexing over 5GB of data.
I do not recommend indexing over 1GB of data.
Well that would turn my Everything into an almost bare bones / proof of concept demo-like program
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

The next alpha update will:

add detailed allocation information for each property under Tools -> Debug -> Statistics.
add warnings to the debug log for large property value allocations.



Everything's RAM usage will roughly double during a rescan for any folder indexes under Tools -> Options -> Folders/FAT/network-drive.
A rescan is normally scheduled to occur daily.


But I will most likely start with this, as it it less effort and affects the already used all other settings, right?
Up to you, but this will lock Everything memory in physical RAM which will hurt system performance.
And in cases where Everything needs RAM, it will be paged to disk, hurting Everything performance.
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

void wrote: Sun Feb 01, 2026 11:15 pm The next alpha update will:

add detailed allocation information for each property under Tools -> Debug -> Statistics.
add warnings to the debug log for large property value allocations.
[...]
I will wait for that new feature - as it should show in plain sight what is constantly / inevitably eating up my RAM in Everything, right?

Meanwhile, I have have eliminated the FreeFileSync / RealTimeSync program to be the external culprit i.e. its scanning / syncing process affecting somehow (via its scattered
sync.ffs_lock
files) the monitoring done by Everything. I also got acquainted with Sysinternals RAMMap, but so far spotted no irregularities; although I am not that of an advanced user to be sure there are none. And also also I mingled with my
pagefile.sys
settings, but increasing it greatly did not affect my Everything's RAM issue

(If I had a time machine I would have bought 128 GB instead of 64 GB when I started to assemble my new machine - but now I refuse to pay 350% od what I had to pay 4 months ago)
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

I will wait for that new feature - as it should show in plain sight what is constantly / inevitably eating up my RAM in Everything, right?
Yes, it will immediately tell you the problem property.
Verbose debug output will also give you the filename that allocates over 8MB.

I will have an update soon.
Just trying to finalize localization support..
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

Everything 1.5.0.1405a adds the total size of each property index under Tools -> Debug -> Statistics.

Everything 1.5.0.1405a also fixes an issue with reading Vorbis tags that could cause this issue.

What property is using up all your RAM?



Allocations over 8 MB are now shown in the debug console (Tools -> Debug -> Console).
If you also enable Verbose debugging (Tools -> Debug -> Verbose), each filename for every property read is also logged.
Last edited by void on Thu Mar 05, 2026 8:43 pm, edited 1 time in total.
Reason: edit: Tools -> Options -> Statistics to: Tools -> Debug -> Statistics
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

void wrote: Thu Feb 26, 2026 5:58 am Everything 1.5.0.1405a adds the total size of each property index under Tools -> Options -> Statistics.
[...]
In Everything 1.5.0.1406a x64 Portable I do not have

Tools > Options > Statistics

But I do have

Tools > Debug > Statistics


When I executed the above for first time it did nothing for dozens of seconds, but then finally brought up the
Statistics - Everything (1.5a) (Not responding)
window, which finally got unblocked / responsive after another dozens of seconds or so. And it reported to me this:
Folder Name size: 23,030,305 bytes
Folder Path size: 11,446,384 bytes
Folder Size size: 11,446,384 bytes
Folder Date Created size: 11,446,384 bytes
Folder Date Modified size: 11,446,384 bytes
Folder Date Accessed size: 11,446,384 bytes
Folder Attributes size: 11,446,384 bytes
Folder Display Name size: 28,805,022 bytes
Folder Free Disk Size size: 11,446,384 bytes
Folder total data size: 137,640,383 bytes
File Name size: 501,872,486 bytes
File Path size: 98,621,080 bytes
File Size size: 98,621,080 bytes
File Date Created size: 98,621,080 bytes
File Date Modified size: 98,621,080 bytes
File Date Accessed size: 98,621,080 bytes
File Attributes size: 98,621,080 bytes
File Length size: 98,621,080 bytes
File Audio Sample Rate size: 49,310,540 bytes
File Audio Channels size: 49,310,540 bytes
File Audio Bits Per Sample size: 49,310,540 bytes
File Display Name size: 380,778,785 bytes
File Compression Format size: 24,655,270 bytes
File Shortcut Target size: 1,420,113 bytes
File Container Filenames size: 1,007,166,000 bytes
File Audio Track Count size: 49,310,540 bytes
File Video Track Count size: 228,304 bytes
File Subtitle Track Count size: 228,304 bytes
File total data size: 2,754,628,442 bytes
Total data size: 2,892,268,825 bytes
which (if ChatGPT is to be trusted) adds up to 6.45 GB. And this was happening in a situation when Task Manager was again showing me usage of 20 GB by Everything, while my
Everything-1.5a.db
has 2.5 GB; and an automated indexation of (currently) connected (but normally off-line) backup drives was happening (because I did some major cleaning and rearrangements on those drives)

I then closed Everything along with it Service and reopened to

Tools > Debug > Statistics

This time it showed up almost immediately and was responsive from get-go


And in past few weeks there was a period of days when (older) Everything (1404a) was again working A-OK i.e. without grabbing all of the available RAM. It was right after restoration of my system from an image - but then this started to happen again. So maybe this was just a coincidence or a tell-tale sign. And I also got one instance of Media Player Classic Home Cinema doing the same when playing a video file - after of closure and immediate reopening of which things went back to normal. This eat-up of RAM by MPC I have not experience (or at least noticed) ever before. So I reckon that something is wrong with my system, over which Everything had a tendency to trip over? This RAM grabbing by Everything was happening on my old messed up Windows 10 Enterprise 20H2 x64 (10.0.19042) which could be somewhat accounted for - but it happening also on my new Windows 10 IOT Enterprise LTSC 21H2 x64 (19044.6575) on a brand new machine which is unexpected. I took great care of my new system from its conception, planning / writing down its settings ahead when still being on the old one (I have not even finished installing of all my programs on it because I want to avoid precisely such mishaps i.e. some things being broken by others)


So what should should I do now? I am currently forcefully / manually re-indexing those backup drives cause I want a clean slate with them. And then I will restore my system again. So am I suppose to wait for that RAM grabbing by Everything to occur again - and then do what? Check again the
Statistics
and
Start Debug Logging
?
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

Thank you for the statistics.
Tools > Options > Statistics
Sorry, I should have said:
Tools -> Debug -> Statistics


When I executed the above for first time it did nothing for dozens of seconds, but then finally brought up the
Statistics - Everything (1.5a) (Not responding)
window, which finally got unblocked / responsive after another dozens of seconds or so. And it reported to me this:
This time it showed up almost immediately and was responsive from get-go
This indicates Everything was paged to disk.
Nothing in the statistics page is cached and is always recalculated from your index.
Building the statistics page will walk over every single item in your index to calculate total sizes.
Normally it will take a few seconds to build the statistics page.


which (if ChatGPT is to be trusted) adds up to 6.45 GB.
The total data size is 2.89 GB.
The total size is reported under
Total size:


Was the
Total size:
reporting 6.45 GB?
(if Everything is using way more RAM that the reported total size, then this would indicate memory allocation for something outside the index)

There is some overhead with memory allocation (~10%)

I do not recommend indexing over 1GB total size.


So what should should I do now?
Report the
total size
from your statistics.
I will look into ways to try and capture large allocations outside of the index.
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

void wrote: Thu Mar 05, 2026 8:56 pm [...]
Was the
Total size:
reporting 6.45 GB?
(if Everything is using way more RAM that the reported total size, then this would indicate memory allocation for something outside the index)
[...]
I do not know, I did not save the whole report - back then I merely copied what I thought was its relevant section. Stupid me


And now that
Thy Grand Voidinesss wrote: Thu Mar 05, 2026 11:43 am I am currently forcefully / manually re-indexing those backup drives cause I want a clean slate with them
[...]
when I
void wrote: Thu Mar 05, 2026 8:56 pm Report the
total size
from your statistics.
[...]
I get constantly somewhat correct
Total size: 4,059,483,100 bytes
And that is because the RAM-grabbing stopped occurring


At first it was happening as usual thus I was being forced to close and re-open Everything few times during a session. But then that manual re-indexation has stopped at ~50% and Everything became stable. So now my two multi-terabytes HDDs got (as far as I can tell) all of their old items added to the database, while any new ones also appear immediately in it - but despite multiple system resets proceeded by proper program closures via

Everything > File > Exit

the progress bars of indexation is stuck in its middle


(And also, when RAM-grabbing by Everything was still occurring, the MPC-HC also exercised this grabbing once)
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

Thy Grand Voidinesss wrote: Sun Mar 08, 2026 11:39 am [...]
the RAM-grabbing stopped occurring
[...]
But
[...]
manual re-indexation has stopped at ~50%
[...]
And yes: I already did treat (more than once )both drives with
chkdsk /f
but found no errors

I also removed Recycle Bin folders to get rid of any old lingering weird / blocked items
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

Thy Grand Voidinesss wrote: Sun Mar 08, 2026 11:39 am [...]
the RAM-grabbing stopped occurring
[...]
But
[...]
manual re-indexation has stopped at ~50%
[...]
I had disconnected one of the drives and then performed few close & re-open operations and also resets of system. And when it was finished being indexed, I swapped it for the other HDD and thus gradually worked also through it. And then reconnected the first one

And so, for those the last 10 days Everything was working A-OK, thus I was able to conveniently finish my massive cleaning / reorganization / movement of millions of items on both of them at the same time. But today Everything again grabbed for itself excess of RAM
void
Developer
Posts: 19568
Joined: Fri Oct 16, 2009 11:31 pm

Re: Filled up RAM breaks usage of Everything

Post by void »

How much RAM is Everything using?
What is the
Total size
reported under Tools -> Debug -> Statistics -> Database -> Total size?

Please send a VMMap report:
Thy Grand Voidinesss
Posts: 824
Joined: Wed Jun 01, 2022 5:01 pm

Re: Filled up RAM breaks usage of Everything

Post by Thy Grand Voidinesss »

I have not forgotten about this. I am gathering, what I hope will be, a set of valuable reports; and looking for patterns

(Aside from RAM being filled up by it, Everything now once again works A-OK and is invaluable in my daily operation)
Post Reply