Looking for a self-hosted file share tool
-
@guyinpv said in Looking for a self-hosted file share tool:
@scottalanmiller said in Looking for a self-hosted file share tool:
Until recently we used Vultr and Fedora for NC and it worked well. RAM was tight for sure, though.
$5 box on VULTR is 1GB now. You think we'd stretch that with about 12 users and moderate activity on mostly Word/Excel files of about 13GB total?
Oh you are looking at the non-storage units?
Yeah. It'll struggle but work.
-
@scottalanmiller Interesting. Well if that's the case I just bump up to the $10 plan. Still cheaper than any other service charging $5 to $10 per user.
I tried to give Turnkey Cloud a try and boy was that a joke.
-
@guyinpv said in Looking for a self-hosted file share tool:
@scottalanmiller Interesting. Well if that's the case I just bump up to the $10 plan. Still cheaper than any other service charging $5 to $10 per user.
At 1GB of RAM, even with swap space added, I found it often failing to be able to update. 2GB should be perfectly fine, though.
We have it with 12GB now, but we aren't using nearly that much.
-
I've put nodequery on it to monitor resource use, it'll alert me if anything goes above 80%. I'll be curious to see how it behaves as I add the users onto it.
-
With all our files uploaded, and just me and my test laptop connected, it's using about 360MB RAM.
-
This is a CentOS 7 VM with 2 vProcs and 3GB RAM.
Using Remi to get PHP 7.1All users have the sync client installed on their computer. This is not accessed any other way, generally.
-
Using Remi to get PHP 7.
Just as a heads up, that’s in the CentOS SCLo repos so you don’t need any of the outside repos any longer.
-
@stacksofplates said in Looking for a self-hosted file share tool:
Using Remi to get PHP 7.
Just as a heads up, that’s in the CentOS SCLo repos so you don’t need any of the outside repos any longer.
Doesn’t that required the named PHP install though?
-
@jaredbusch Cool! 120 users connected and yet it reports about 800MB RAM. Mine is on PHP 7.0.28, MySQL 5.7.21, Ubuntu 16.04. That makes me feel a little better.
As many file sync tools I've tried over the years, the top most important feature becomes stability. As long as the thing keeps syncing, keeps accurate, then I'll deal with the rest.
You'd be surprised how quickly I get myself into trouble.
I found this app for "Group Shared Folders" so that I could have a master share that everybody uses, seemed like a good idea at the time. But then I found out the deleted folder (trash can) doesn't work on group shares.
I created another admin user to act as a master account that I could put a share in for the whole office. Then I used the NC web interface to move all the files from the group share into the new share. This seemed to work fine.
On my test workstations, I had turned off sync so I could move the files locally as well, I want to avoid using a ton of bandwidth if I can help it.
When I turned sync back on, it seemed to go just fine until I noticed in the web interface that most every folder was duplicated! Lots of files appear duplicated as well. But this doesn't translate to Windows, I only see one copy of everything.
When I open the sync client, the duplicates are seen in the folder selection tree.Now it gets weirder. When in the web UI, if I click the share icon on one of the duplicate folders/files, the duplicate magically disappears, just by viewing share info in the sidebar. But if I refresh the folder or click on the folder name, once again all the folders/files reappear as duplicates. This is freaking bizarre. Kinda goes against my need for a stable and robust system.
-
@jaredbusch said in Looking for a self-hosted file share tool:
@stacksofplates said in Looking for a self-hosted file share tool:
Using Remi to get PHP 7.
Just as a heads up, that’s in the CentOS SCLo repos so you don’t need any of the outside repos any longer.
Doesn’t that required the named PHP install though?
Umm, I don't remember off hand. You could be right.
-
@guyinpv said in Looking for a self-hosted file share tool:
@jaredbusch Cool! 120 users connected and yet it reports about 800MB RAM. Mine is on PHP 7.0.28, MySQL 5.7.21, Ubuntu 16.04. That makes me feel a little better.
As many file sync tools I've tried over the years, the top most important feature becomes stability. As long as the thing keeps syncing, keeps accurate, then I'll deal with the rest.
You'd be surprised how quickly I get myself into trouble.
I found this app for "Group Shared Folders" so that I could have a master share that everybody uses, seemed like a good idea at the time. But then I found out the deleted folder (trash can) doesn't work on group shares.
I created another admin user to act as a master account that I could put a share in for the whole office. Then I used the NC web interface to move all the files from the group share into the new share. This seemed to work fine.
On my test workstations, I had turned off sync so I could move the files locally as well, I want to avoid using a ton of bandwidth if I can help it.
When I turned sync back on, it seemed to go just fine until I noticed in the web interface that most every folder was duplicated! Lots of files appear duplicated as well. But this doesn't translate to Windows, I only see one copy of everything.
When I open the sync client, the duplicates are seen in the folder selection tree.Now it gets weirder. When in the web UI, if I click the share icon on one of the duplicate folders/files, the duplicate magically disappears, just by viewing share info in the sidebar. But if I refresh the folder or click on the folder name, once again all the folders/files reappear as duplicates. This is freaking bizarre. Kinda goes against my need for a stable and robust system.
I have no clue WTF you are doing.
But it sounds like your browser shit.
Look at your data store directly.
If it is all good and it still looks bad in a new porn mode browser, then have it rescan the files from the command line.
-
@jaredbusch said in Looking for a self-hosted file share tool:
@stacksofplates said in Looking for a self-hosted file share tool:
Using Remi to get PHP 7.
Just as a heads up, that’s in the CentOS SCLo repos so you don’t need any of the outside repos any longer.
Doesn’t that required the named PHP install though?
Yes, it gives you all versions so you do have to specify.
-
@jaredbusch said in Looking for a self-hosted file share tool:
@guyinpv said in Looking for a self-hosted file share tool:
@jaredbusch Cool! 120 users connected and yet it reports about 800MB RAM. Mine is on PHP 7.0.28, MySQL 5.7.21, Ubuntu 16.04. That makes me feel a little better.
As many file sync tools I've tried over the years, the top most important feature becomes stability. As long as the thing keeps syncing, keeps accurate, then I'll deal with the rest.
You'd be surprised how quickly I get myself into trouble.
I found this app for "Group Shared Folders" so that I could have a master share that everybody uses, seemed like a good idea at the time. But then I found out the deleted folder (trash can) doesn't work on group shares.
I created another admin user to act as a master account that I could put a share in for the whole office. Then I used the NC web interface to move all the files from the group share into the new share. This seemed to work fine.
On my test workstations, I had turned off sync so I could move the files locally as well, I want to avoid using a ton of bandwidth if I can help it.
When I turned sync back on, it seemed to go just fine until I noticed in the web interface that most every folder was duplicated! Lots of files appear duplicated as well. But this doesn't translate to Windows, I only see one copy of everything.
When I open the sync client, the duplicates are seen in the folder selection tree.Now it gets weirder. When in the web UI, if I click the share icon on one of the duplicate folders/files, the duplicate magically disappears, just by viewing share info in the sidebar. But if I refresh the folder or click on the folder name, once again all the folders/files reappear as duplicates. This is freaking bizarre. Kinda goes against my need for a stable and robust system.
I have no clue WTF you are doing.
But it sounds like your browser shit.
Look at your data store directly.
If it is all good and it still looks bad in a new porn mode browser, then have it rescan the files from the command line.
haha, what does that mean?
Like I said, I originally did a "group share", this is a feature via a plugin.
When the features of a group share didn't work out, I went back to just having a regular share owned by a user.
In the web interface, I selected all the files in the group share and used the "move" link to move them into the new share.
Maybe I'm going mad but this seems like a pretty standard operation, move some files and folders from one share into another??But now all those folders/files appear duplicated.
What are the magic commands to force things to rescan at the command line?
-
@guyinpv said in Looking for a self-hosted file share tool:
@jaredbusch said in Looking for a self-hosted file share tool:
@guyinpv said in Looking for a self-hosted file share tool:
@jaredbusch Cool! 120 users connected and yet it reports about 800MB RAM. Mine is on PHP 7.0.28, MySQL 5.7.21, Ubuntu 16.04. That makes me feel a little better.
As many file sync tools I've tried over the years, the top most important feature becomes stability. As long as the thing keeps syncing, keeps accurate, then I'll deal with the rest.
You'd be surprised how quickly I get myself into trouble.
I found this app for "Group Shared Folders" so that I could have a master share that everybody uses, seemed like a good idea at the time. But then I found out the deleted folder (trash can) doesn't work on group shares.
I created another admin user to act as a master account that I could put a share in for the whole office. Then I used the NC web interface to move all the files from the group share into the new share. This seemed to work fine.
On my test workstations, I had turned off sync so I could move the files locally as well, I want to avoid using a ton of bandwidth if I can help it.
When I turned sync back on, it seemed to go just fine until I noticed in the web interface that most every folder was duplicated! Lots of files appear duplicated as well. But this doesn't translate to Windows, I only see one copy of everything.
When I open the sync client, the duplicates are seen in the folder selection tree.Now it gets weirder. When in the web UI, if I click the share icon on one of the duplicate folders/files, the duplicate magically disappears, just by viewing share info in the sidebar. But if I refresh the folder or click on the folder name, once again all the folders/files reappear as duplicates. This is freaking bizarre. Kinda goes against my need for a stable and robust system.
I have no clue WTF you are doing.
But it sounds like your browser shit.
Look at your data store directly.
If it is all good and it still looks bad in a new porn mode browser, then have it rescan the files from the command line.
haha, what does that mean?
Like I said, I originally did a "group share", this is a feature via a plugin.
When the features of a group share didn't work out, I went back to just having a regular share owned by a user.
In the web interface, I selected all the files in the group share and used the "move" link to move them into the new share.
Maybe I'm going mad but this seems like a pretty standard operation, move some files and folders from one share into another??But now all those folders/files appear duplicated.
What are the magic commands to force things to rescan at the command line?
Did you close all browsers tabs and then start a new private browsing session? To ensure your browser was not just showing cached data.
-
I am not at a computer to get you examples.
But first just ssh in and look in the data folder. Look at wha is here. Are there two copies of the files?
If yes. There is the problem.
If no, then run the rescan.
-
@guyinpv Just create a share with an admin account that will never be deleted, then you can create a group for all of your users, and add the group to the share as shown in the pic. The folder will automatically appear for every one in that group.
You can also use the normal link sharing rules with this, so every user shares the same link.
-
@bnrstnr said in Looking for a self-hosted file share tool:
@guyinpv Just create a share with an admin account that will never be deleted, then you can create a group for all of your users, and add the group to the share as shown in the pic. The folder will automatically appear for every one in that group.
You can also use the normal link sharing rules with this, so every user shares the same link.
This.
Whatever that long-winded post is up there, I have no idea. That's an incredibly convoluted way to do that. Curious if you actually duplicated the files or not. Follow JB's advice and check the data directory to verify.
This is the kind of stuff I do and get yelled at. It's like looking in a mirror.
-
@guyinpv said in Looking for a self-hosted file share tool:
@jaredbusch Cool! 120 users connected and yet it reports about 800MB RAM.
"Connected" on a web connection (which is what the sync client is, too) isn't what connected means in a VPN sense. Think about the memory use of 120 users on a website, you'd not even notice. Now if all 120 were actively clicking links and doing things at once, you might notice.
-
@scottalanmiller said in Looking for a self-hosted file share tool:
@guyinpv said in Looking for a self-hosted file share tool:
@jaredbusch Cool! 120 users connected and yet it reports about 800MB RAM.
"Connected" on a web connection (which is what the sync client is, too) isn't what connected means in a VPN sense. Think about the memory use of 120 users on a website, you'd not even notice. Now if all 120 were actively clicking links and doing things at once, you might notice.
Or updating files at the same time because a new globally shared set of documents get uploaded. Mostly network though.
-
@bnrstnr said in Looking for a self-hosted file share tool:
@guyinpv Just create a share with an admin account that will never be deleted, then you can create a group for all of your users, and add the group to the share as shown in the pic. The folder will automatically appear for every one in that group.
You can also use the normal link sharing rules with this, so every user shares the same link.
This is exactly what I did, right out of the box.
But then I found this: https://apps.nextcloud.com/apps/groupfoldersSo I created one of those. Then I found the features of group folders didn't work for me. For example the trash bin doesn't work at all for group folders.
So I went back to method #1. Created a share linked to a group.
Really guys, nothing weird going on here. Then all I did was select all the files in the one folder (group share), and used the button called "move" right in the interface to move them to the normal share, which seemed to work. And then I see all the duplicates. Here is a screenshot of how the web interface looks.
@wirestyle22 said in Looking for a self-hosted file share tool:
Whatever that long-winded post is up there, I have no idea. That's an incredibly convoluted way to do that.
I don't see how it's convoluted to want to move files and folders from one folder into another. You'd think a program meant for file management can do such trivial tasks without screwing up it's own cache or indexes or whatever went wrong.
Anyway, so I looked in the file system and there are definitely no duplicates there. It looks as it should.
I ran the occ commandsfiles:scanfor all users, no errors reported. Then I ranfiles:cleanupto clean the filecache.I didn't see any other commands that seemed relevant.
Anyway, I logged in and duplicates still showing. Grrr.
Then I went in and deleted the previous group share folder (it is empty anyway) and then removed the group share plugin entirely.
At this point there are no clients connected, I'm only working in the web interface.
Others have seen this problem too: https://help.nextcloud.com/t/files-and-folders-shown-twice-in-web-ui/12416/2
https://help.nextcloud.com/t/duplicate-files-delete-not-possible/8869
https://github.com/nextcloud/server/issues/3502
Looks like OwnCloud was dealing with same issue as well: https://github.com/owncloud/core/issues/28018
