Content Indexing the Cloud Files (Sharepoint)

Discussion related to "Everything" 1.5 Alpha.
Post Reply
nesedenyana
Posts: 58
Joined: Mon Sep 19, 2022 10:38 am

Content Indexing the Cloud Files (Sharepoint)

Post by nesedenyana »

Hi,
I have lots of files which are only stored as cloud files in Onedrive. So, when I start content indexing, it starts downloading everything from Onedrive, which is not ideal.
So, there should be a check to "ignore cloud files that are not downloaded". Is it doable? Because, most people -especially in business- uses this cloud files.
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

I will look into only indexing files without the FILE_ATTRIBUTE_RECALL_ON_DATA_ACCESS attribute.

For now, you may want to exclude your one drive folder from your indexed content.
nesedenyana
Posts: 58
Joined: Mon Sep 19, 2022 10:38 am

Re: Content Indexing the Cloud Files (Sharepoint)

Post by nesedenyana »

Yes, that should be it!

For me, almost everything is mix of on-demand and downloaded files, so I cannot keep going, but if we have the change, that should work seamlessly. I am not sure how it would work for file that change the behaviour. As you know, you can download some files, and later on, you can "free up space", so the file will change the behaviour, but you will have the content index.
nesedenyana
Posts: 58
Joined: Mon Sep 19, 2022 10:38 am

Re: Content Indexing the Cloud Files (Sharepoint)

Post by nesedenyana »

Would it be possible to have it on 1320 to test?
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

I will look into adding this in the next alpha.

There might be a better solution that I am exploring..

Do these files have the "NOT_CONTENT_INDEXED" attribute set?
-If you right click one of these files and click Properties, under the General tab, click Advanced, is "Allow this file to have contents indexed in addition to file properties" checked?
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

Everything 1.5.0.1320a adds an option to exclude properties and content for files and folders that have the "Not content indexed" attribute set.



To exclude indexing properties for files and folders with the "Not content indexed" attribute:
  • In Everything, from the Tools menu, click Options.
  • Click the Properties tab on the left.
  • Select your property.
  • Check Exclude not content indexed.
  • Click OK.


To exclude indexing content for files and folders with the "Not content indexed" attribute:
  • In Everything, from the Tools menu, click Options.
  • Click the Content tab on the left.
  • Check Exclude not content indexed.
  • Click OK.


To set or clear the "not content indexed" attribute for files and folders:
  • Right click your file or folder and click Properties.
  • Click the General tab.
  • Click Advanced....
  • Check or uncheck Allow this file to have contents indexed in addition to file properties.
    (If checked, the "not content indexed" attribute is cleared)
    (If unchecked, the "not content indexed" attribute is set)
  • Click OK.
  • Click OK.

Ideally, you would like to set the "not content indexed" attribute to all the files in your cloud.
(uncheck Allow this file to have contents indexed in addition to file properties for all files in your cloud)
nesedenyana
Posts: 58
Joined: Mon Sep 19, 2022 10:38 am

Re: Content Indexing the Cloud Files (Sharepoint)

Post by nesedenyana »

I have checked the exclude not content indexed in the "Content" menu, however, it doesn't make a difference. See an example file.
https://prnt.sc/LmS2Bf8Sw9Ui
nesedenyana
Posts: 58
Joined: Mon Sep 19, 2022 10:38 am

Re: Content Indexing the Cloud Files (Sharepoint)

Post by nesedenyana »

I made a small test. In my personal onedrive, all files in a specific folder was with the properties I posted above. I only selected that folder to be content indexed, in the end, Everything downloaded all the files.
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

Please try adding the NOT_CONTENT_INDEXED attribute to all files in your cloud folder:
  • Select all files/folders in your cloud folder.
  • Right click these selected files.
  • Click Properties.
  • Click Advanced.
  • Uncheck Allow this file to have contents indexed in addition to file properties.
  • Click OK.
  • Check Apply changes to this folder, subfolders and files.
  • Click OK.
    --Wait for the attributes to apply - It may take several minutes--
Re-enable content indexing in Everything.

Does Everything continue to try to index files in your cloud folder?

I'm seeing the expected results my end, but maybe there's an issue with this attribute when stored in the cloud..
Does Windows Explorer report these cloud files as having the I attribute? (I = Not content indexed)
nesedenyana
Posts: 58
Joined: Mon Sep 19, 2022 10:38 am

Re: Content Indexing the Cloud Files (Sharepoint)

Post by nesedenyana »

I understand your solution, but I don't think this is sustainable to ask all users to change a property of all files in their computers to use with Everything. Shouldn't we try to find a solution that uses default nature of the files instead?
I was very excited about content indexing as Everything is an amazing tool for me.
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

What about adding your Onedrive folder to your content exclude filter?:
  • In Everything, from the Tools menu, click Options.
  • Click the Content tab on the left.
  • Change Exclude folders to:
    C:\users\<your-user-name>\onedrive
    (where <your-user-name> is your username)
  • Click OK.


I am still considering an option to exclude files in the cloud. (FILE_ATTRIBUTE_RECALL_ON_DATA_ACCESS)
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

Everything 1.5.0.1322a adds a content_exclude_recall_on_data_access ini setting.

To prevent Everything from indexing cloud files:
  • Copy and paste the following into your Everything search box:
    /content_exclude_recall_on_data_access=1
  • Press ENTER in your Everything search box.
  • If successful, content_exclude_recall_on_data_access=1 is shown in the status bar for a few seconds.
  • Reenable content indexing.
content_exclude_recall_on_data_access



Please let me know if this works/is useful.
I will consider adding a UI option.
nesedenyana
Posts: 58
Joined: Mon Sep 19, 2022 10:38 am

Re: Content Indexing the Cloud Files (Sharepoint)

Post by nesedenyana »

It works. How can we ease this process? I think it should be default. Everything does not have to download the cloud files. It should only index the files already downloaded.
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

Thank you for your feedback nesedenyana,

I will add this option to the UI.
I agree that this option should be enabled by default.
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

Everything 1.5.0.1325a adds a "Recall on data access" setting for indexed properties and indexed content.

This setting is enabled by default for indexed content.





To configure this setting for indexed content:
  • In Everything, from the Tools menu, click Options.
  • Click the Content tab on the left.
  • Check or uncheck Recall on data access.
  • Click OK.


To configure this setting for indexed properties:
  • In Everything, from the Tools menu, click Options.
  • Click the Properties tab on the left.
  • Select your indexed property.
  • Check or uncheck Recall on data access.
  • Click OK.


The "Recall on data access" attribute is set when file content is not completely stored locally.
Accessing the file will cause the system to gather the content (typically from the cloud)

Only the system can set this attribute.
vern.zimm
Posts: 6
Joined: Fri Aug 26, 2022 8:58 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by vern.zimm »

I'm curious if this applies to Box drive as well... I tried the earlier thing, looking for the "allow file to have contents indexed". It is present on OneDrive, however it is not present on Box drive (the whole "Advanced" button is not there, see attached). How can I verify the file property status for the new (recall on data access) way of excluding?

I suspect this is again their method of hosting a special fake drive layer thing above Windows. All of the interaction with the directory goes through the Box service/driver, not through Windows. I also previously mentioned issues with the speed of indexing on Box drive. I apologize, our IT has *still* not gotten us switched over, so I have not had a chance to test it.

Thanks,
Vernon.
Attachments
Box left OneDrive right
Box left OneDrive right
20221104 Box vs OneDrive properties window1.png (49.12 KiB) Viewed 8907 times
Box left OneDrive right
Box left OneDrive right
20221104 Box vs OneDrive properties window2.png (46.03 KiB) Viewed 8907 times
void
Developer
Posts: 15237
Joined: Fri Oct 16, 2009 11:31 pm

Re: Content Indexing the Cloud Files (Sharepoint)

Post by void »

Thanks for your post vern.zimm,


the whole "Advanced" button is not there, see attached
I wonder if the "not content indexed" attribute still works..

To see if this attribute is set, please show the Attributes column in Everything (right click the result list column header and check Attributes)

The attributes column will include:
I = Not content indexed.
M = Recall on data access.

Attributes



Can you change the attributes with the ATTRIB command line option?

You will be unable to change the Recall on data access attribute as this is managed by the OS / volume manager.
Post Reply