What Are You Doing Right Now
-
@thwr said in What Are You Doing Right Now:
@reid-cooper said in What Are You Doing Right Now:
Have not heard of zsync, that seems pretty useful.
The basic idea is that you upload your files to your webserver and generate a data block map using zsyncmake. This must be repeated every time you update a file. That's all you need on the server side.
On the client, you just invoke zsync and point it to the zsync map files (which contains the block map and the relative or absolute URL to the real file). It then compares your local version and starts to sync changed blocks.
We are syncing nearly 60GB of mostly binary files (game mods) for more than 300 highly active users. Generating the map files and a lot of other stuff (like JSON listings and hashes) takes us about 10 minutes on an average SSD.
Are they authenticating somehow? Or does it just point to the directory?
-
@coliver said in What Are You Doing Right Now:
@thwr said in What Are You Doing Right Now:
@reid-cooper said in What Are You Doing Right Now:
Have not heard of zsync, that seems pretty useful.
The basic idea is that you upload your files to your webserver and generate a data block map using zsyncmake. This must be repeated every time you update a file. That's all you need on the server side.
On the client, you just invoke zsync and point it to the zsync map files (which contains the block map and the relative or absolute URL to the real file). It then compares your local version and starts to sync changed blocks.
We are syncing nearly 60GB of mostly binary files (game mods) for more than 300 highly active users. Generating the map files and a lot of other stuff (like JSON listings and hashes) takes us about 10 minutes on an average SSD.
Are they authenticating somehow? Or does it just point to the directory?
It's plain HTTP, so whatever your webserver can do.
There's only one downside: No HTTPS support. I do not like the idea, but that's another story. You can work around by many means: SSH port forwarding or VPN tunnels, for example.
-
@thwr said in What Are You Doing Right Now:
@coliver said in What Are You Doing Right Now:
@thwr said in What Are You Doing Right Now:
@reid-cooper said in What Are You Doing Right Now:
Have not heard of zsync, that seems pretty useful.
The basic idea is that you upload your files to your webserver and generate a data block map using zsyncmake. This must be repeated every time you update a file. That's all you need on the server side.
On the client, you just invoke zsync and point it to the zsync map files (which contains the block map and the relative or absolute URL to the real file). It then compares your local version and starts to sync changed blocks.
We are syncing nearly 60GB of mostly binary files (game mods) for more than 300 highly active users. Generating the map files and a lot of other stuff (like JSON listings and hashes) takes us about 10 minutes on an average SSD.
Are they authenticating somehow? Or does it just point to the directory?
It's plain HTTP, so whatever your webserver can do.
There's only one downside: No HTTPS support. I do not like the idea, but that's another story. You can work around by many means: SSH port forwarding or VPN tunnels, for example.
I did a small workaround, as our content (mods) is not confidential. A script puts rolling credentials into the .htaccess-file of the webservers directory, keeping only the newest X entries. Invoked via cron. A serverside webservice provides the credentials to authenticated clients. So even if someone sniffes users and passwords (both random), he could only use them for a short amount of time.
Not ideal, but like I said, it's not required to be secure. Just a small barrier.
-
Headache healed enough to allow me to play string with my cat before I head to sleep. Day = salvaged
-
Piss off Windows 7 updates temp files...
-
@jaredbusch said in What Are You Doing Right Now:
Piss off Windows 7 updates temp files...
Such a pain...
-
Just wrapped up our family game night.
-
Just ordered Sausage and Chips for my Lunch.......Hurry up dinner time!!!!
-
@hobbit666 Thanks, you've decided my lunch for me. To the chippy!
-
-
Day off today!!
-
@dbeato said in What Are You Doing Right Now:
Day off today!!
Lucky, it's getting bad outside, we're supposed to get 3-6" of snow today.
-
-
Good morning.
-
Funtimes documentation.
-
Thank God It's Friday... I think. Somebody please tell me today is Friday... Today has been a Monday all the way around.
-
I'm definitely looking forward to a weekend!
-
@scottalanmiller said in What Are You Doing Right Now:
I'm definitely looking forward to a weekend!
Me too. Get my truck out of the shop today... Slung a belt on me on Monday... Didn't have a chance to get it seen about until Yesterday.
-
Getting a spec together for an "Archive" refurb server to put dead VM's on that might need spinning up once in a while.
-
Realized a couple Ubuntu boxes were on 17.04 instead of 17.10, should be kinda obvious what I'm dong at the moment.
