I have to change cloud drive service yet again
-
is there a file system that will track all this meta data, even when the file is deleted? To me it feels like general ledger type transactions where the past history is part of the permanent record. I know its apples and oranges, but is there anything on the horizon that looks at this from the point of view of historical chronology? I would probably lead to meta data bloat, which would be my guess as to why it doesn't exist now.
-
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
@wirestyle22 said in I have to change cloud drive service yet again:
@guyinpv said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
@guyinpv said in I have to change cloud drive service yet again:
@Obsolesce said in I have to change cloud drive service yet again:
Users aren't saving a copy to their hard drive, then putting it back after someone else moves or renames it?
Using the NextCloud Sync client, all the files are already local on their drives. So the users are using CTRL-X to cut files and paste them into other folders. And occasionally, those file operations reverse and a moved file goes back to where it was. Or a renamed files gets reversed. Or worse, a renamed and moved file because a duplicate in its original folder, leaving us with 2 copies with multiple names.
yeah, that's a behavioural thing that has to stop. Has to, period. Simply isn't something that they can do when using that kind of system, any system like that.
What behavior is better?
Assuming you mean they should stop using ctrl-x to cut and paste files. Are you suggesting they should, say, copy the file to their desktop, then delete the NC one, then copy the file back into the new folder location?
Funny thing is, when they ctrl-x and move a file, NC literally records the activity as a file move operation. It knows what just happened. That just makes everything that much more weird.
I know of no business that does this (ctrl+x to move files). If they are all doing this someone must have told them to do it this way. Was that you?
huh - about 50% of my users use ctrl + keys all day long. We do a lot of copy pasting between systems. I know I showed some of them, some knew from before.
They move files around the file system? Why? They want to hide them from other uses? Want to lower efficiency? What purpose does it serve to move files around all of the time?
That's not what I said - I said "50% of my users use ctrl + keys" they are using it mostly to copy paste text between apps, not to move files in the filesystem.
-
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
That said - we have a process where faxes are dumped into a folder, then they are uploaded into our EHR, then they are moved to a trash folder where they are left for 30 days, then deleted. So we do a move process all the time, ever day.
Trashing a file isn't the same as a normal move, because it is always out of the sync system. So it would never be an issue, it's just a deletion in this context. We are talking exclusively about moving around a single file system, not about deletions.
In my case they are not being trashed - they are being moved to a 'finished' folder. the folder is active and online in case there was an issue in the upload process.
-
@scottalanmiller said in I have to change cloud drive service yet again:
The sync process scans the end point for files. Those files are copied up to the server. The data point on the server is where the meta data is attached and how it knows to look for changes. Move that file, and there is no connection to the file on the client any longer.... so...
Client A creates myfile.doc
Client A syncs to Server
Server now has a copy of myfile.doc and stores data about it like its version history, ownership, sharing, etc.
Client A moves file to new location. (Deletes the existing copy, makes a new file with the same name in a different spot. A move IS a deletion and recreation to the local filesystem.)
Sync to the server forces one to be deleted and a new one to be created. The server can't see that a file was "moved", that's not visible to it. It sees what really happened, one was deleted and another was created that just happens to have the same name and contents. But it is NOT the same file to the server (and potentially not to the end user.)
Now the server thinks it should delete the one that was there, and create a new one, so it does.
Now the server pushes down the deletion and the new creation to Clients B and C. Everyone is in sync, although now two users dont' know where their file is, all shares are broken, and all history and permissions are broken. The file is there, but things aren't set up like they were thought to be. No big deal.
Now Client B was working on that file at the time that it was moved and they save it. Since the file was deleted and no longer exists, when they save it it creates a new file.
Client B syncs the new file up to the Server. The Server has no idea that this is the same file that was deleted previously because that file doesn't exist, has no data, and this file is brand new.
Now Clients A and C get a copy of this divergent file, in the original location, from the Server.
To the end users it looks like files are reverting. But what really happened is that the user on Client A broke the meta-data because of their "moving" of files and created a break in the database so that the files being worked on by the end users are not associated with the file that was moved.
OK this whole thing makes sense - So you really believe the OP's issue is that people have open files they are editing, and that is the root of the issue here? The OP hasn't mentioned anything about multiple people being in the same file and seeing files 'reappear'... granted he could have left that out.
-
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
The sync process scans the end point for files. Those files are copied up to the server. The data point on the server is where the meta data is attached and how it knows to look for changes. Move that file, and there is no connection to the file on the client any longer.... so...
Client A creates myfile.doc
Client A syncs to Server
Server now has a copy of myfile.doc and stores data about it like its version history, ownership, sharing, etc.
Client A moves file to new location. (Deletes the existing copy, makes a new file with the same name in a different spot. A move IS a deletion and recreation to the local filesystem.)
Sync to the server forces one to be deleted and a new one to be created. The server can't see that a file was "moved", that's not visible to it. It sees what really happened, one was deleted and another was created that just happens to have the same name and contents. But it is NOT the same file to the server (and potentially not to the end user.)
Now the server thinks it should delete the one that was there, and create a new one, so it does.
Now the server pushes down the deletion and the new creation to Clients B and C. Everyone is in sync, although now two users dont' know where their file is, all shares are broken, and all history and permissions are broken. The file is there, but things aren't set up like they were thought to be. No big deal.
Now Client B was working on that file at the time that it was moved and they save it. Since the file was deleted and no longer exists, when they save it it creates a new file.
Client B syncs the new file up to the Server. The Server has no idea that this is the same file that was deleted previously because that file doesn't exist, has no data, and this file is brand new.
Now Clients A and C get a copy of this divergent file, in the original location, from the Server.
To the end users it looks like files are reverting. But what really happened is that the user on Client A broke the meta-data because of their "moving" of files and created a break in the database so that the files being worked on by the end users are not associated with the file that was moved.
OK this whole thing makes sense - So you really believe the OP's issue is that people have open files they are editing, and that is the root of the issue here? The OP hasn't mentioned anything about multiple people being in the same file and seeing files 'reappear'... granted he could have left that out.
He has mentioned file locking a dozen or so times though and that would seem to confirm what @scottalanmiller is thinking.
-
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
I don't disagree with the OP that his issues definitely seem like shitty programming problems that simply shouldn't exist. 20 people all sync the same files - 5 people are offline most of the time - someone moves a file, one of the offline people come back online - the offline system should see a date notice of the file move and change the once offline client to match the server.
Should it? Should moving files even be really possible? Since there is no notice of file move, that's not a thing, what do you expect the system to see? There is no "move log" or anything of the sort. Simple one file gets deleted, another gets created.
To the cloud sync tool, this could happen for any of a number of reasons. It can't guess. It is the humans breaking the system here, not the computer.
You could complain that the OS' filesystem layer doesn't report "moves" somehow through an API if you want. That seems silly.
The real issue here is that exposing a raw database (filesystem) to end users is fundamentally bad computing, but necessary because people are so used to it. But this is why things like iOS devices refuse to do this and don't let people work with files at all. You stop thinking about it, but it's nothing to do with mobile computing, but lack of filesystem exposure on an iPhone or iPad that makes it so robust and easy to use. Each app gets its own space and works with its own files and you never need to manage file storage.
Letting users see the filesystem is truly too "under the hood" and allows users to do too much damage. We have two choices, move to OSes like iOS that forbid this, or train users on how to properly use a computer that exposes a filesystem. Those are the options.
SMB and I assume other local sharing protocols have been providing file locks for decades - so yes, I expect this.
That said - I know file locks aren't possible when you're offline - so a syncing type solution just can't reasonably be expected to use it.
I completely agree with you on hiding the filesystem from users. We need a way to have a central storage location for files when accessing them via the apps, as well as a personal location (like MS Office allowing local docs or OneDrive)... so once we have that, moving to the app only access to files would be pretty nice.
One issue with the app only access - what happens when you change apps? i.e. switching from using Adobe Acrobat to PDF Element? Is it now up to the OS to know what files belong to what app? or is there simply a single folderless dumping ground for all files?
Assuming you've been using Excel for years, you could have hundreds or thousands of xlsx files. searching through these is painful at best for people. forcing the use of tags will be helpful, but I haven't seen that deployed much if at all. simply searching titles are often useless, because we don't always remember the actual title we give something. etc etc.
-
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
I don't disagree with the OP that his issues definitely seem like shitty programming problems that simply shouldn't exist. 20 people all sync the same files - 5 people are offline most of the time - someone moves a file, one of the offline people come back online - the offline system should see a date notice of the file move and change the once offline client to match the server.
Should it? Should moving files even be really possible? Since there is no notice of file move, that's not a thing, what do you expect the system to see? There is no "move log" or anything of the sort. Simple one file gets deleted, another gets created.
To the cloud sync tool, this could happen for any of a number of reasons. It can't guess. It is the humans breaking the system here, not the computer.
You could complain that the OS' filesystem layer doesn't report "moves" somehow through an API if you want. That seems silly.
The real issue here is that exposing a raw database (filesystem) to end users is fundamentally bad computing, but necessary because people are so used to it. But this is why things like iOS devices refuse to do this and don't let people work with files at all. You stop thinking about it, but it's nothing to do with mobile computing, but lack of filesystem exposure on an iPhone or iPad that makes it so robust and easy to use. Each app gets its own space and works with its own files and you never need to manage file storage.
Letting users see the filesystem is truly too "under the hood" and allows users to do too much damage. We have two choices, move to OSes like iOS that forbid this, or train users on how to properly use a computer that exposes a filesystem. Those are the options.
SMB and I assume other local sharing protocols have been providing file locks for decades - so yes, I expect this.
That depends if the application is holding the file open or not. If someone hits "save as", it's going to put it back. Problem exists regardless.
-
@Dashrender said in I have to change cloud drive service yet again:
One issue with the app only access - what happens when you change apps? i.e. switching from using Adobe Acrobat to PDF Element? Is it now up to the OS to know what files belong to what app? or is there simply a single folderless dumping ground for all files?
All modern OSes already handle that. It's a long ago solved problem.
-
@Dashrender said in I have to change cloud drive service yet again:
simply searching titles are often useless, because we don't always remember the actual title we give something. etc etc.
If titles (and presumable folder titles) don't let you find something, how does moving files around solve any problems?
-
@coliver said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
The sync process scans the end point for files. Those files are copied up to the server. The data point on the server is where the meta data is attached and how it knows to look for changes. Move that file, and there is no connection to the file on the client any longer.... so...
Client A creates myfile.doc
Client A syncs to Server
Server now has a copy of myfile.doc and stores data about it like its version history, ownership, sharing, etc.
Client A moves file to new location. (Deletes the existing copy, makes a new file with the same name in a different spot. A move IS a deletion and recreation to the local filesystem.)
Sync to the server forces one to be deleted and a new one to be created. The server can't see that a file was "moved", that's not visible to it. It sees what really happened, one was deleted and another was created that just happens to have the same name and contents. But it is NOT the same file to the server (and potentially not to the end user.)
Now the server thinks it should delete the one that was there, and create a new one, so it does.
Now the server pushes down the deletion and the new creation to Clients B and C. Everyone is in sync, although now two users dont' know where their file is, all shares are broken, and all history and permissions are broken. The file is there, but things aren't set up like they were thought to be. No big deal.
Now Client B was working on that file at the time that it was moved and they save it. Since the file was deleted and no longer exists, when they save it it creates a new file.
Client B syncs the new file up to the Server. The Server has no idea that this is the same file that was deleted previously because that file doesn't exist, has no data, and this file is brand new.
Now Clients A and C get a copy of this divergent file, in the original location, from the Server.
To the end users it looks like files are reverting. But what really happened is that the user on Client A broke the meta-data because of their "moving" of files and created a break in the database so that the files being worked on by the end users are not associated with the file that was moved.
OK this whole thing makes sense - So you really believe the OP's issue is that people have open files they are editing, and that is the root of the issue here? The OP hasn't mentioned anything about multiple people being in the same file and seeing files 'reappear'... granted he could have left that out.
He has mentioned file locking a dozen or so times though and that would seem to confirm what @scottalanmiller is thinking.
well, my memory of him mentioning file locking was that it didn't exist - not that he was getting "in use" messages because of file locking. But I'm to lazy to read up through the entire thread now.
-
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
One issue with the app only access - what happens when you change apps? i.e. switching from using Adobe Acrobat to PDF Element? Is it now up to the OS to know what files belong to what app? or is there simply a single folderless dumping ground for all files?
All modern OSes already handle that. It's a long ago solved problem.
By all modern, I assume you mean Chrome OS/android and iOS? but not windows?
-
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
One issue with the app only access - what happens when you change apps? i.e. switching from using Adobe Acrobat to PDF Element? Is it now up to the OS to know what files belong to what app? or is there simply a single folderless dumping ground for all files?
All modern OSes already handle that. It's a long ago solved problem.
By all modern, I assume you mean Chrome OS/android and iOS? but not windows?
I'm not following? Windows can manage file types in this fashion as well. Must have missed something.
-
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
simply searching titles are often useless, because we don't always remember the actual title we give something. etc etc.
If titles (and presumable folder titles) don't let you find something, how does moving files around solve any problems?
folders do solve it, because it narrows you from 1000's of files to maybe 100. then you just read through the list.
Again - tags would really solve this much better, because you can often have way more than just one tag, making searching significantly better.
-
@coliver said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
One issue with the app only access - what happens when you change apps? i.e. switching from using Adobe Acrobat to PDF Element? Is it now up to the OS to know what files belong to what app? or is there simply a single folderless dumping ground for all files?
All modern OSes already handle that. It's a long ago solved problem.
By all modern, I assume you mean Chrome OS/android and iOS? but not windows?
I'm not following? Windows can manage file types in this fashion as well. Must have missed something.
Windows doesn't handle anything. The files are just where they are. If you launch Adobe reader - it doesn't show you all PDFs on a system, or even search for them all - at min you'd have to choose the root of the drive you think your file is on, then search for your title, etc. some apps even will search inside the files for text. but without the prestep of choosing the root of that drive, if you're in some subfolder, you could easily miss a file.
I assume that iOS stores all PDFs in a single location - heck, it might store ALL files in a single directory. Then when an app is installed, the app registers that it's for PDFs, and iOS allows it to see all PDFs in that folder.
-
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
simply searching titles are often useless, because we don't always remember the actual title we give something. etc etc.
If titles (and presumable folder titles) don't let you find something, how does moving files around solve any problems?
folders do solve it, because it narrows you from 1000's of files to maybe 100. then you just read through the list.
Again - tags would really solve this much better, because you can often have way more than just one tag, making searching significantly better.
you still have the problem of having meaningful tags. where do these come from and who is responsible for maintaining them? most people are lazy and wouldn't use tags to the level of their capability. plus, whats to say that the tag I give a file is what you would use for searching for that file?
-
@Dashrender said in I have to change cloud drive service yet again:
@coliver said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
One issue with the app only access - what happens when you change apps? i.e. switching from using Adobe Acrobat to PDF Element? Is it now up to the OS to know what files belong to what app? or is there simply a single folderless dumping ground for all files?
All modern OSes already handle that. It's a long ago solved problem.
By all modern, I assume you mean Chrome OS/android and iOS? but not windows?
I'm not following? Windows can manage file types in this fashion as well. Must have missed something.
Windows doesn't handle anything. The files are just where they are. If you launch Adobe reader - it doesn't show you all PDFs on a system, or even search for them all - at min you'd have to choose the root of the drive you think your file is on, then search for your title, etc. some apps even will search inside the files for text. but without the prestep of choosing the root of that drive, if you're in some subfolder, you could easily miss a file.
I assume that iOS stores all PDFs in a single location - heck, it might store ALL files in a single directory. Then when an app is installed, the app registers that it's for PDFs, and iOS allows it to see all PDFs in that folder.
Ah, I see was curious as to what you meant.
-
I feel like this is a 100% human problem, and no matter what we do with the OS, its still human judgment that is the cause of the problems.
-
@Donahue said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
simply searching titles are often useless, because we don't always remember the actual title we give something. etc etc.
If titles (and presumable folder titles) don't let you find something, how does moving files around solve any problems?
folders do solve it, because it narrows you from 1000's of files to maybe 100. then you just read through the list.
Again - tags would really solve this much better, because you can often have way more than just one tag, making searching significantly better.
you still have the problem of having meaningful tags. where do these come from and who is responsible for maintaining them? most people are lazy and wouldn't use tags to the level of their capability. plus, whats to say that the tag I give a file is what you would use for searching for that file?
Well - that would be up to the departments. You could pre create dozens of tags, etc... if the system is like ML here- as you type win - it will show you a list of all existing tags that have win in it.
Yes - getting people to use TAGs is the hardest part. Sharepoint for example, so I'm told, can force this on users.
-
@Donahue said in I have to change cloud drive service yet again:
I feel like this is a 100% human problem, and no matter what we do with the OS, its still human judgment that is the cause of the problems.
yep.
-
@Dashrender said in I have to change cloud drive service yet again:
@Donahue said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
@scottalanmiller said in I have to change cloud drive service yet again:
@Dashrender said in I have to change cloud drive service yet again:
simply searching titles are often useless, because we don't always remember the actual title we give something. etc etc.
If titles (and presumable folder titles) don't let you find something, how does moving files around solve any problems?
folders do solve it, because it narrows you from 1000's of files to maybe 100. then you just read through the list.
Again - tags would really solve this much better, because you can often have way more than just one tag, making searching significantly better.
you still have the problem of having meaningful tags. where do these come from and who is responsible for maintaining them? most people are lazy and wouldn't use tags to the level of their capability. plus, whats to say that the tag I give a file is what you would use for searching for that file?
Well - that would be up to the departments. You could pre create dozens of tags, etc... if the system is like ML here- as you type win - it will show you a list of all existing tags that have win in it.
Yes - getting people to use TAGs is the hardest part. Sharepoint for example, so I'm told, can force this on users.
maybe it could force someone to use A tag, but nothing that can be programmed can force a user to use the correct tag, because it is a matter of intent and actual intelligence. Computers can only be as good as the programmer programming them.
