client icon indicating copy to clipboard operation
client copied to clipboard

Virtual files + hidden folders not synchronized

Open zeroxx1986 opened this issue 2 years ago • 27 comments
trafficstars

Pre-submission Checks

  • [X] I checked for similar issues, but could not find any. I also checked the closed issues. I could not contribute additional information to any existing issue.
  • [X] I will take the time to fill in all the required fields. I know that the bug report may be dismissed otherwise due to lack of information.

Describe the bug

Completely new OwnCloud client install on Windows 11, virtual filesystem is used, "Sync hidden files" is set in Settings, but the hidden folders (anything starting with ".") are not visible and not synchronized locally, even when trying forced sync many times.

Expected behavior

Hidden folders are synchronized when "Sync hidden files" is turned on.

Steps to reproduce the issue

  1. Add a hidden folder into owncloud, i.e. ".wind" and add some content inside (additional folders / normal files, whatever)
  2. Install a new client in a new computer and sync it to the server
  3. Enable virtual file support
  4. Try to find the ".wind" folder - it's not visible in the local filesystem, while owncloud says everything is synced.
  5. Enable "Sync hidden files" in settings
  6. Force sync
  7. Try to find the ".wind" folder - it's not visible in the local filesystem, while owncloud says everything is synced.

Screenshots

No response

Logs

No response

Client version number

OwnCloud 4.2.0.11670

Desktop environment (Linux only)

No response

Client package version and origin (Linux only)

No response

Installation path (Windows only)

c:\Program Files\ownCloud

Server information

ownCloud 10.12.2 (stable) running in Docker

Additional context

The hidden folder & all files are correctly visible and browsable / downloadable on the webUI.

zeroxx1986 avatar Oct 04 '23 15:10 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar Nov 04 '23 00:11 github-actions[bot]

up

zeroxx1986 avatar Nov 04 '23 08:11 zeroxx1986

I can't reproduce the issue with version 5. image

Action         ,File                                                            ,Folder                        ,Size  ,Account             ,Time                ,Status              ,
Downloaded     ,.wind                                                           ,ownCloud - Albert [email protected] (4)\Personal,      ,Albert [email protected],2023-11-07T10:57:44.883,Success             ,

Please share your synced/not synced table (right click copy)

TheOneRing avatar Nov 07 '23 09:11 TheOneRing

Hi Hannah,

I've created a vanilla VM to reproduce this issue with the newest OwnCloud client - and the issue is still there, easily reproducible.

What I did:

  1. Set up OwnCloud, default settings except for the owncloud folder (I set it to C:\OwnCloud instead)
  2. Checked in settings to sync hidden files
  3. Wait for sync complete (very fast) & just to be sure, forced another sync
  4. Tried copying the synced files table, but it's just only a small subset of the synced files, and even the root folder where this app is residing in (/apps) is not present there, so I'll not add waste logs in here.
  5. Not synced table is completely empty
  6. Checked the folder where the .wind subfolder should be, and it's not there
  7. Over the web, the .wind folder is clearly visible

Is there any other way to capture the whole sync process (this table you mentioned) so you'll get more information?

01_setup image
image image
06_hidden_folder_missing 07_hidden_folder_in_webview

zeroxx1986 avatar Nov 07 '23 11:11 zeroxx1986

If synced the file is supposed to be listed in the synced tab. Could you provide some logs including http logs? Or give https://github.com/owncloud/client/releases/tag/v5.1.1-rc.1 a try.

Please upload logs to: https://cloud.owncloud.com/s/RExA7HZWRuIMvW2

TheOneRing avatar Nov 07 '23 12:11 TheOneRing

Upon trying to collect the logs from zero, I think I've stumbled upon the actual issue..

If I add the account first, then after it syncs (or it started to sync) for the first time I enable the "Sync hidden files" in the Settings, no hidden files or folders are added, no matter how much I try to force sync. The Activity shows nothing under Not Synced tab either.

On the other hand, if I enable the "Sync hidden files" first, then after it I add the account, the setting is ignored and gets unchecked right after the account is added..

The only way this works correctly is if just after the account has been added, immediately I go into settings & check the Sync hidden files - after the initial sync, the hidden files & folders are correctly synced and I do see the previously missing .wind folder.

I uploaded logs related to both scenarios (first & last) to the provided url, thanks!

zeroxx1986 avatar Nov 07 '23 13:11 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar Dec 08 '23 00:12 github-actions[bot]

up

zeroxx1986 avatar Dec 08 '23 07:12 zeroxx1986

Looking into: 02_log_hidden_just_after_account

23-11-07 05:35:29:640 [ info sync.discovery ]:	Processing "apps/WindTerm_2.5.0/.wind/profiles/default.v10/user.config" | valid: true/true/db | mtime: 1699227755/1699227755/0 | size: 581/581/0 | etag: "a7adb2b9cc45ae45848f414a436769d2"//"" | checksum: "SHA1:4a9c7cae4a235f4229fccbd79b605c114763c880"//"" | perm: "WDNVR"//"" | fileid: "00195022oc525k5cd2r1"//"" | inode: 253601/253601/ | type: CSyncEnums::ItemTypeVirtualFile/CSyncEnums::ItemTypeVirtualFile/CSyncEnums::ItemTypeFile

Tested it locally: image

Regarding the sync hidden files checkbox: I couldn't reproduce the described behaviour.

TheOneRing avatar Dec 08 '23 09:12 TheOneRing

Ok so I have a theory, you switched it on before any account was added? The setting is stored in the accounts (for historic reasons) and if there is no account....

TheOneRing avatar Dec 08 '23 10:12 TheOneRing

Ok so I have a theory, you switched it on before any account was added? The setting is stored in the accounts (for historic reasons) and if there is no account....

Yes, You are correct - I did a brand new install, no accounts present prior to it whatsoever.

I think this should be a very generic use-case for home users - for whatever reason, i.e. you reinstall your computer or just have a new one which you want your owncloud to be available, you don't have any prior accounts there at that point - and after the very first sync goes through without this switch being enabled, there is no way to get the hidden files/folders anymore unless you remove everything and tick the sync hidden files option prior of the first sync being done.

Btw I don't see the hidden option being bound to an account an issue, rather the fact that after you do your initial sync with this hidden option disabled, if you enable it, you won't get the hidden files/folders afterwards. It will add & sync anything new, but not the ones which existed earlier - and it happily overwrites existing ones on the server also - like with the same application example (windterm):

  1. you have an existing .wind folder on the server which wasn't synced due to the hidden option not being set initially,
  2. then you enable the hidden option (it won't sync/add the existing .wind folder from the server)
  3. you start windterm,
  4. it sees there's no .wind folder, creates it with initial configuration.
  5. owncloud detects a hidden file/folder change, and syncs it to the server, overwriting the existing one.

zeroxx1986 avatar Dec 08 '23 11:12 zeroxx1986

Hmm did you try force sync after you changed the sync hidden files option? image An incremental sync would not check the whole tree by default, only the next full sync (1/1h) would go through everything.

TheOneRing avatar Dec 08 '23 12:12 TheOneRing

Yes, I did try the force sync, it did not solve the issue, the existing hidden folders/files did not appear after. What would this next full sync (1/1h) be? It does a full sync every 1 hour or 1 day?

zeroxx1986 avatar Dec 08 '23 12:12 zeroxx1986

It does a full sync run whenever you hit "force sync", so that should have done it, if any.

Have you updated to the latest release 5.2.0? If not, please do so and try again. This is the version we test against.

fmoc avatar Dec 08 '23 13:12 fmoc

It does a full sync run whenever you hit "force sync", so that should have done it, if any.

Have you updated to the latest release 5.2.0? If not, please do so and try again. This is the version we test against.

Just tried it. Removed owncloud completely, installed the newest one: 5.2.0.12726. Added my account, let it sync through. After it finished, I ticked Sync hidden files and went back to the Account tab and did a Force sync now - nothing changed, the hidden folder did not appear. Tried doing the force sync several times, same result, nothing changed.

zeroxx1986 avatar Dec 08 '23 15:12 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar Jan 08 '24 00:01 github-actions[bot]

up

zeroxx1986 avatar Jan 08 '24 00:01 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar Feb 08 '24 00:02 github-actions[bot]

up

zeroxx1986 avatar Feb 08 '24 07:02 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar Mar 10 '24 00:03 github-actions[bot]

up

zeroxx1986 avatar Mar 10 '24 00:03 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar Apr 11 '24 00:04 github-actions[bot]

up

zeroxx1986 avatar Apr 11 '24 07:04 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar May 12 '24 00:05 github-actions[bot]

up

zeroxx1986 avatar May 12 '24 09:05 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar Jun 13 '24 00:06 github-actions[bot]

up

zeroxx1986 avatar Jun 13 '24 06:06 zeroxx1986

This issue was marked stale because it has been open for 30 days with no activity. Remove the stale label or comment or this will be closed in 7 days.

github-actions[bot] avatar Jul 14 '24 00:07 github-actions[bot]

The issue was marked as stale for 7 days and closed automatically.

github-actions[bot] avatar Jul 21 '24 00:07 github-actions[bot]