Everything / other programs crash: too much RAM use

Discussion related to "Everything" 1.5.
Locked
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Everything / other programs crash: too much RAM use

Post by Biff »

I cannot use Everything anymore. After starting it it starts using more and more RAM (to about 10, 11 GB or so) until it crashes (showing some message about to less RAM or so) and / or other programs crash, the needless junk Lenovo IdeaPad 3 freezes (does not work properly because such is happening, problems with the RAM or so), different error messages are shown.

I removed the content of the field "Content" under "Index" to let Everything not index content anymore to reduce the RAM used, but since then Everything / other programs crash ALWAYS after half a minute or a minute or so after Everything starts.

What could I do to get it work again?

Image
w64bit
Posts: 338
Joined: Wed Jan 09, 2013 9:06 am

Re: Everything / other programs crash: too much RAM use

Post by w64bit »

Check if a setting it's the problem.
Start with default settings.
Close Everything. Backup ini. Remove ini. Start Everything.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

Many thanks!
Check if a setting it's the problem.
Yes, yes, running Everything with default settings is not a problem (two other instances work well), but the settings I set in "Content" and / or "Properties" are, I guess. Too much information to keep having in the RAM for Everything, I assume. So I guess, I have to deactivate the less useful properties (without to losing too much data, indexes, etc.). But when I start Everything (after having deactivated the "Content" indexing) Everything (and other programs) still crashes. Maybe it still uses so much RAM to process the new information and after processing the RAM use would be OK.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

So I removed the Everything-1.5a.ini (there are some more inis). After starting Everything obviously has kept the settings, everything looks like before, the use of RAM is almost as high as before or as high, but without crashes now.

Why is that?

What does removing the ini change?
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

Please upload your old ini and new ini in a bugreport
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

OK, thank you, I just did, two "bug reports".

Just two lines difference, does not look important.
therube
Posts: 5723
Joined: Thu Sep 03, 2009 6:48 pm

Re: Everything / other programs crash: too much RAM use

Post by therube »

About how many files were we talking?
And of those, about how many were you indexing Properties, & which Properties at that?
horst.epp
Posts: 1642
Joined: Fri Apr 04, 2014 3:24 pm

Re: Everything / other programs crash: too much RAM use

Post by horst.epp »

Maybe he has configured Content indexing.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

About how many files were we talking?
Sorry, what files? The indexed ones? About 6.7 mio. files and folders. Each file / folder I have is indexed.

Image
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

Thank you for the ini files.

The ini files are the same.

For 6.7 million files, Everything should be using about 670 MB if you just index filenames, size and date modified. (default indexing options)


You are indexing every basic property under Tools -> Options -> Indexes.
Are you using these indexes? -If not, please disable them.

RAM usage for each setting:
Index Recent Changes: 25MB per 1million files changed.
Journal will use the specified maximum size. (10MB in your case)
Index file size: 8MB per 1million files.
Fast size sort: 8MB per 1million files.
Index folder size: 8MB per 1million folders.
Index date created: 8MB per 1million folders.
Fast date created sort: 8MB per 1million folders.
Index date modified: 8MB per 1million folders.
Fast date modified sort: 8MB per 1million folders.
Index date access: 8MB per 1million folders.
Fast date access sort: 8MB per 1million folders.
Index attributes: 4MB per 1million folders.
Fast attribute sort: 8MB per 1million folders.
Fast extension sort: 8MB per 1million folders.

These will add up quickly for 6 million files. (~500MB)



I see you are indexing several properties.

You will see the following RAM usage for the following:
Aspect Ratio: 4MB per 1million video files.
Audio Bit Rate: 4MB per 1million video files.
Audio Channels: 4MB per 1million video files.
Audio Format: varies, about 18MB per 1million video files.
Available Free Disk Size: 8MB per 1million folders.
Dimensions: 8MB per 1million video files.
Length: 8MB per 1million video files.
Size on Disk: 8MB per 1million files.
Total Bit Rate: 4MB per 1million video files.
Total Disk Size: 8MB per 1million folders.
Used Disk Size: 8MB per 1million folders.
Video Bit Rate: 4MB per 1million video files.
Video Format: varies, about 13MB per 1million video files.

Fast sort for each setting: 8MB per 1million files. (this alone is 624MB)

where video files is: *.mkv;*.mp4;*.avi;*.iso

These will add up quickly for 6 million files. (~739MB)
The actual data is not much (139MB), its the fast sort that will use the most RAM here.



I see you are indexing content.

Content indexing may consume large amounts of RAM.
I don't recommend indexing over 1GB of text content.

Please try the following search:

content: addcol:a a:=LEN($content:) sort:a-descending


Examine values in column A
This value is the indexed content size for each file.
Please make sure there's no really large files. (over 100MB)
-Maybe you are indexing a log file?
-Maybe Everything is reading a binary file as text?
Ideally, the text content should be under 1MB for each file.

Reduce the number of files you are content indexing with content indexing filters under Tools -> Options -> Content.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

Thank you very much!
The ini files are the same.
Besides of the two lines, I guess. And what does it mean here? Is it good or bad? Is it like it should be? So Everything obviously wrote the new ini file.
Are you using these indexes?
Most of them I use quite often, I think.
its the fast sort that will use the most RAM here.
What exactly is the difference / speed between the fast sort and the usual sort (so without activated fast sort)? Sorting lasts (much) longer only?
Content indexing may consume large amounts of RAM.
I don't recommend indexing over 1GB of text content.
Yes, indeed, that actual was the problem here. Content indexing uses extremely much RAM as I could see. But I do not anymore. I had deactivated the context search but Everything (and other programs) crashed all the time after that (too less RAM messages or so). Suddenly Everything did not crash anymore and now the RAM use is between 250 MB and 1500 MB. Before it was up to 11000 MB or more. So I guess up to 1500 MB is the size Everything uses now with all the other settings kept activated. And that seems to be the amount of RAM use you added above with all those properties activated?
Please try the following search:

content: addcol:a a:=LEN($content:) sort:a-descending
Looks like a search for the content (not being indexed anymore). So I assume it would not find anything anymore? I tried that search, but I had to stop it because it uses to much RAM (up to 95 GB or so). Because of the crashes. I could do at a later time.
-Maybe you are indexing a log file?
-Maybe Everything is reading a binary file as text?
No, not that I can find one in the context indexed folders.

Reduce the number of files you are content indexing with content indexing filters under Tools -> Options -> Content.
I would estimate about 1500 files had been content indexed. And some or many over 1 MB.

I had intended to context index every text file (doc, docx, odt, pdf, etc.), html, htm file, etc. on the next computer with 64 GB or 32 GB RAM, but it seems that abosultely is not a very good idea. I assume, it is not possible at all (with 6.7 mio. items)?
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

The ini files are the same.
Besides of the two lines, I guess. And what does it mean here? Is it good or bad? Is it like it should be? So Everything obviously wrote the new ini file.
It's fine.
Did you have a copy of the old ini that was causing crashes?

its the fast sort that will use the most RAM here.
What exactly is the difference / speed between the fast sort and the usual sort (so without activated fast sort)? Sorting lasts (much) longer only?
Sorting by the associated property will be instant when fast sort is enabled.
Sorting without fast sort can take a second or two.


Content indexing may consume large amounts of RAM.
I don't recommend indexing over 1GB of text content.
Yes, indeed, that actual was the problem here. Content indexing uses extremely much RAM as I could see. But I do not anymore. I had deactivated the context search but Everything (and other programs) crashed all the time after that (too less RAM messages or so). Suddenly Everything did not crash anymore and now the RAM use is between 250 MB and 1500 MB. Before it was up to 11000 MB or more. So I guess up to 1500 MB is the size Everything uses now with all the other settings kept activated. And that seems to be the amount of RAM use you added above with all those properties activated?
1500MB is expected for your setup.
My RAM usage guess using the numbers from above:
670MB + 500MB - 192MB (size and date modified included in 670MB) + 739MB
=1717MB

Consider creating a separate indexed content instance.


Please try the following search:

content: addcol:a a:=LEN($content:) sort:a-descending
Looks like a search for the content (not being indexed anymore). So I assume it would not find anything anymore? I tried that search, but I had to stop it because it uses to much RAM (up to 95 GB or so). Because of the crashes. I could do at a later time.
This search will only work when content indexing is enabled.
It would help to identify any problem files that might be consuming larges amounts of RAM.


Reduce the number of files you are content indexing with content indexing filters under Tools -> Options -> Content.

I would estimate about 1500 files had been content indexed. And some or many over 1 MB.
I had intended to context index every text file (doc, docx, odt, pdf, etc.), html, htm file, etc. on the next computer with 64 GB or 32 GB RAM, but it seems that abosultely is not a very good idea. I assume, it is not possible at all (with 6.7 mio. items)?
I would recommend indexing only a specific folder and subfolders, eg: C:\users\your-username\documents
Indexing all txt/html/htm files on your system is bound to cause issues. This is going to index log files. Potentially files that are being modified continuously.

Only index content if the files are on a slow HDD.
There's very little reason to index content on an SSD.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

Did you have a copy of the old ini that was causing crashes?
Yes, it must be the old one I sent you. Actually I woul think the crashes are caused by the shitty Lenovo. Usually it should not happen that the computer crashes because of too less RAM.
Sorting by the associated property will be instant when fast sort is enabled.
Sorting without fast sort can take a second or two.
Oops, one or two?! I had thought it might take minutes or so. So I am wondering if it is worth 624 MB of RAM. I should try it. But once deactivated it would take some time after re-activating it to re-index the information needed?
1500MB is expected for your setup.
My RAM usage guess using the numbers from above:
670MB + 500MB - 192MB (size and date modified included in 670MB) + 739MB
=1717MB
So upt to 1717 MB? Why is it that Everything uses so different amounts of RAM, 300 MB up to 1500, 1700 MB?

Image
Consider creating a separate indexed content instance.
Sorry, what is indexed content instance? I use two normal instances. Is there a way to index content without using so much RAM?
It would help to identify any problem files that might be consuming larges amounts of RAM.
Ah, OK, I should have used earlier.
I would recommend indexing only a specific folder and subfolders
Yes, but that meant one had to separate them from the folders they belong to.
This is going to index log files.
One could not just exclude them?
Only index content if the files are on a slow HDD.
Oops, why? An extern WD MyBook or WD Elements is slow?
There's very little reason to index content on an SSD.
Why?
w64bit
Posts: 338
Joined: Wed Jan 09, 2013 9:06 am

Re: Everything / other programs crash: too much RAM use

Post by w64bit »

Oops, why? An extern WD MyBook or WD Elements is slow?
Yes, HDD it's slow.
HDD speed is 100-150 MB/s
SSD SATA3 speed is 500 MB/s
SSD M.2 speed is up to 7000 MB/s (50 times faster than a HDD)
There's very little reason to index content on an SSD.
Why?
Because you can obtain the content information directly by searching.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

So a normal content search (without index) on an SSD with a normal program is as fast as Everything on a (indexed) HDD. But I would think, if one wanted the content being searchable offline content indexing would be useful, or I am I missing anything? How would one search content with Everything on an online SSD without content index?
w64bit
Posts: 338
Joined: Wed Jan 09, 2013 9:06 am

Re: Everything / other programs crash: too much RAM use

Post by w64bit »

Not without index, without indexing the file content (properties).
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

I beg your pardon?

Edit: Oops, the answer mysteriously has changed. But I understand even less (if possible at all). Not without an index? But without indexing the file content (properties)?
Last edited by Biff on Fri Jun 27, 2025 8:36 pm, edited 1 time in total.
w64bit
Posts: 338
Joined: Wed Jan 09, 2013 9:06 am

Re: Everything / other programs crash: too much RAM use

Post by w64bit »

End. I'm out.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

Urgh, here is the end! Very early.

Oki okey, over and out.

I appreciate your great information very much, was a great help. Many thanks!
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

Sorting without fast sort can take a second or two.
I should try it. But once deactivated it would take some time after re-activating it to re-index the information needed?
Everything will perform a quick reindex when toggling fast sorts.
Everything will re-use your existing property index, it will not regather properties from disk.


So upt to 1717 MB? Why is it that Everything uses so different amounts of RAM, 300 MB up to 1500, 1700 MB?
1717MB is my guess for the RAM usage based on your settings.

Everything is likely being paged to disk.
In the Task Manager, click the Details tab.
Right click the column header and click Select Columns.
Check Commit size and click OK.
Please show all your Everything processes (sort by name) with the Commit size column shown.

The Commit size is memory requested by Everything.
If it's less than the working set size it usually means Everything has been paged to disk (bad)
-How much RAM does your system have?


Sorry, what is indexed content instance? I use two normal instances.
A separate instance just for content indexing.
Instances can run side-by-side.
Using a separate instance might make it easier to manage your content indexing.


Is there a way to index content without using so much RAM?
No.
Check what is being indexed and make sure only a small amount of text content is being indexed.


This is going to index log files.
One could not just exclude them?
I do not recommend indexing all txt and html files.
Please exclude most of them by using Tools -> Options -> Properties -> Exclude folders / Include only folders.
The easiest way is to set include only folders.
Make sure the paths in include only folders do not contain any log files.


Only index content if the files are on a slow HDD.
Oops, why? An extern WD MyBook or WD Elements is slow?
Only consider indexing content for HDDs.
What I really mean is don't bother indexing content on an SSD.
Searching content on an SSD is going to be very quick.
The extra RAM usage from indexing content is generally not worth it.


So a normal content search (without index) on an SSD with a normal program is as fast as Everything on a (indexed) HDD. But I would think, if one wanted the content being searchable offline content indexing would be useful, or I am I missing anything? How would one search content with Everything on an online SSD without content index?
Consider content indexing to search offline content.
However, Everything is not really designed for offline files.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

Everything will perform a quick reindex when toggling fast sorts.
Everything will re-use your existing property index, it will not regather properties from disk.
Ah, so I could just activate / deactivate it when I need it / not need it (without long hesitations für re-indexing). That's great!
Please show all your Everything processes (sort by name) with the Commit size column shown.
Somehow I assume, that's not what you want, sorry, but I cannot find more processes:

Image
If it's less than the working set size it usually means Everything has been paged to disk (bad)
Much too slow?
-How much RAM does your system have?
The trashy Lenovo IdeaPad 3 has 16 GB RAM, 2 of them reserved for something, forgotten for what for. So 14 GB that are usable for the programs, I guess.
A separate instance just for content indexing.
Ah, so a normal instance. Not a special one for content indexing, okey.
Using a separate instance might make it easier to manage your content indexing.
But what would be the advantage? It would cost more RAM, wouldn't it? And the amount of RAM need would be the same as using the main instance, I would think.
However, Everything is not really designed for offline files.
But that is exactly one of the best / most important options of Everything. So I thought it indeed is designed for it.
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

Somehow I assume, that's not what you want, sorry, but I cannot find more processes:
Zugesicherte Größe is the commit size.
Everything is using 1993MB of RAM.

There's not enough RAM in your system so Everything is paged to disk.
Everything will run very poorly.

Please remove any unnecessary indexed information from Everything.

I recommend unchecking ALL options under Tools -> Options -> Indexes, EXCEPT the following:
  • Enable Journal. (10000 KB is fine -the default is 1024 KB)
  • Index file size.
  • Index folder size.
  • Fast size sort.
  • Index date modified.
  • Fast date modified sort.
I recommend unchecking ALL fast sort options under Tools -> Options -> Properties.

-or-

Install more RAM.



Consider forcing Everything to keep memory in physical RAM: (not recommended)
  • In Everything 1.5, from the Tools menu, click Options.
  • Click the Advanced tab on the left.
  • To the right of Show settings containing, search for:
    virtual
  • Select: virtual_lock
  • Set the value to: true
  • To the right of Show settings containing, search for:
    working
  • Select: min_working_set_size
  • Set the value to: 2147483647
  • Select: max_working_set_size
  • Set the value to: 2147483647
  • Click OK.
Enabling these options will reserve 2GB of RAM for Everything.
Enabling these options can cause poor system performance.
-Please don't enable these options if you only have 16GB of RAM.

virtual_lock
min_working_set_size
max_working_set_size


Using a separate instance might make it easier to manage your content indexing.
But what would be the advantage? It would cost more RAM, wouldn't it? And the amount of RAM need would be the same as using the main instance, I would think.
Ideally, you would only run the indexed content instance when needed.
The indexed content instance should only index a small subset of files (eg: C:\users\your-username\documents)
So rather than Everything using 10000MB of RAM all the time, you only run it when needed.
This kind-of defeats the purpose of content indexing again as you are loading the content from disk.

In short, do not use content indexing unless you have plenty of RAM.

Consider using the system to index content and search your system index from Everything with si:



Optimal settings for Everything
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

Everything will run very poorly.
Yes, it sometimes greys out, gets inaccessible. But the search generally works very well.
I recommend unchecking ALL options under Tools -> Options -> Indexes, and checking only the following:

Enable Journal.
Index file size.
Index folder size.
Fast size sort.
Index date modified.
Fast date modified sort.

I recommend unchecking ALL fast sort options under Tools -> Options -> Properties.
OK, thank you!
Install more RAM.
Not possible on the poor Lenovo. How much RAM should I have for Everything (for the next computer)?
Consider forcing Everything to keep memory in physical RAM: (not recommended)

In Everything 1.5, from the Tools menu, click Options.
Click the Advanced tab on the left.
To the right of Show settings containing, search for:

virtual
Select: virtual_lock
Set the value to: true
To the right of Show settings containing, search for:
working
Select: min_working_set_size
Set the value to: 2147483647
Select: max_working_set_size
Set the value to: 2147483647
Click OK.

Enabling these options can cause poor system performance.

virtual_lock
min_working_set_size
max_working_set_size
OK, thank you very much!
So rather than Everything using 10000MB of RAM all the time, you only run it when needed.
Yes, but the risk of crashing programs / freezing system, etc. keeps staying.
In short, do not use content indexing unless you have plenty of RAM.
But even with 64 GB RAM one had to carefully chose what files to content index, I assume. So even with about ten times (maybe 15.000) the amount of files I had have content indexed would use the 64 GB to capacity, I could imagine.
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

How much RAM should I have for Everything (for the next computer)?
Really depends on your usage of Everything and other programs.

I can make up some numbers, but generally aim for at-least 4x the maximum memory usage of Everything.

The OS alone will use 8GB of RAM.

For example, if you want to index everything where Everything uses 14GB of RAM, then make sure your system has 4x14GB + 8GB (64GB RAM)
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

For example, if you want to index everything where Everything uses 16GB of RAM, then make sure your system has 4x 16GB (64GB RAM)
OK, and even that is not that much content, I assume. Maybe it would be good to save html files. as PDF. That would leave out the code and maybe other useless information not saved to PDF.

Thank you very much!
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

Consider using the system to index content and search your system index from Everything with si:

Optimal settings for Everything
Ah, I had missed that completely. I do not understand what "si" means. And this: " Search for files or folders in the system index that match the specified system index search." What are the advantages of that? What is it good for? What is "system index"?

Could one search context with Everything without having context indexed?
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

I do not understand what "si" means.
si: == system index

searching the system index with Everything


And this: " Search for files or folders in the system index that match the specified system index search." What are the advantages of that? What is it good for? What is "system index"?
Your windows index or windows search.
Same results as you would see in Windows Explorer.


Could one search context with Everything without having context indexed?
Of course you can search content without content indexing, just use the content: search function.
It will be slow, so combine content: with as many other search filters as possible, eg: *.docx dm:thisyear

Have you disabled Windows Search? -If not, try si: and see if you get any results.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

Your windows index or windows search.
Same results as you would see in Windows Explorer.
So the common Windows search. OK.

And with "system-index:" and "si:" (according to content:) in the search field one can search within Win with Everything instead of with the Win search obviously. With a better result list, better, more options, I assume. That's the advantage.
Have you disabled Windows Search?
No, I never have used it.

This

"I:\Downloads" content:sdfksdfisdflsdfoe2039230230"
or this
I:\Downloads content:sdfksdfisdflsdfoe2039230230"
finds "test.txt".

But this does not: "I:\Downloads" system-index:sdfksdfisdflsdfoe2039230230
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

Does a search for
si:
find any results.

The results are all the files in your windows index.
If any are shown it indicates your Windows Indexing is enabled and working.



To add a folder to your Windows Index:
From the Start menu, search for:
Indexing Options

Click Indexing Options.
In Indexing Options, click Modify.
Check the desired location and click OK.
Wait for Windows to index your newly added folder.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

oes a search for
si:
find any results.
Yes, it finds 1090 items of 376.000 on C:
To add a folder to your Windows Index:
From the Start menu, search for:
Indexing Options

Click Indexing Options.
In Indexing Options, click Modify.
Check the desired location and click OK.
Wait for Windows to index your newly added folder.
OK, thank you. But I am afraid that Windows might scan files time using CPU, RAM all the time. Does si: (and system-index:) after Win has completely indexed the drives find files instantly? Or what is the difference between using content:? The advantage of using the Win search or index with Everything? Does Win index content at all?
ChrisGreaves
Posts: 821
Joined: Wed Jan 05, 2022 9:29 pm

Re: Everything / other programs crash: too much RAM use

Post by ChrisGreaves »

void wrote: Fri Jun 27, 2025 1:10 am .... You are indexing every basic property under Tools -> Options -> Indexes.
.... I see you are indexing several properties.
.... I see you are indexing content.
.... Content indexing may consume large amounts of RAM.
.... I don't recommend indexing over 1GB of text content.
Hi Void; I think that I understand all this now.
The data that describes a file can grow towards a size that is the size of the data IN the file.

As it grows towards the size of the data in the file, then we are moving towards a state where (as indexes) we will be holding in RAM, and processing (sorting) in RAM, a volume of data about the file that is close to the size of data IN the file.

Loosely speaking, we are trying to manipulate data about the files, equivalent to the volume of data in the files.

That is like trying to hold all the data in the files in RAM!
Cheers, Chris
void
Developer
Posts: 19870
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything / other programs crash: too much RAM use

Post by void »

Does si: (and system-index:) after Win has completely indexed the drives find files instantly?
Yes, Instantly.


Or what is the difference between using content:?
The Windows index stores the content in one location so it will be quicker.
content: will have to open each file and then read out the content.


The advantage of using the Win search or index with Everything?
Windows index stores the content on disk.
Windows index stores each word and a reference to the file. (can only search whole words or word prefixes)

Everything stores the content in RAM.
Everything can do partial searches and complex regex searches on content.

In your case, the Windows index is best for content indexing.


Does Win index content at all?
Yes, content and properties.


I don't recommend indexing over 1GB of text content.
Hi Void; I think that I understand all this now.
Just keep in mind I am referring to the "text" content part.
This doesn't include images and other large objects in files.
You can index 100GB of docx files just fine, just make sure the total indexed text content is under 1GB.
Biff
Posts: 1243
Joined: Mon May 25, 2015 7:09 am

Re: Everything / other programs crash: too much RAM use

Post by Biff »

In your case, the Windows index is best for content indexing.
Yes, no worries about what files to scan and / or where to store them. Sounds good actually, I will try. One drawback will be that one could not transfer the Win index to another installation of Win. So one had to scan the entire drives again.
Locked