Downloading full Website offline
-
Save Page WE
https://chrome.google.com/webstore/detail/save-page-we/dhhpefjklgkmgeafimnjhojgjamoafofExtension on chrome and firefox, saves single page using MHT and does that in good way, if you want single page
-
@scottalanmiller said in Downloading full Website offline:
@dbeato I've got a cool script that tells you which threads on ML are popular. Kind of heavy, and only so useful alone, but it is trivial to modify it to track scripts that you care about. I'll make a post for it.
That would be cool to see.
-
@dbeato said in Downloading full Website offline:
@scottalanmiller said in Downloading full Website offline:
@dbeato I've got a cool script that tells you which threads on ML are popular. Kind of heavy, and only so useful alone, but it is trivial to modify it to track scripts that you care about. I'll make a post for it.
That would be cool to see.
It has been posted.
-
@scottalanmiller said in Downloading full Website offline:
@dbeato said in Downloading full Website offline:
@scottalanmiller said in Downloading full Website offline:
@dbeato I've got a cool script that tells you which threads on ML are popular. Kind of heavy, and only so useful alone, but it is trivial to modify it to track scripts that you care about. I'll make a post for it.
That would be cool to see.
It has been posted.
I saw... I am slow
-
Why back it up that way vs the server or files and DB?
-
@Obsolesce said in Downloading full Website offline:
Why back it up that way vs the server or files and DB?
Because I don't have access to them at least on those two examples.
-
@dbeato said in Downloading full Website offline:
@Obsolesce said in Downloading full Website offline:
Why back it up that way vs the server or files and DB?
Because I don't have access to them at least on those two examples.
Oh, why are you supposed to back up ML without having access to the back-end?
And, how would you restore anything with those backups?
-
@Obsolesce said in Downloading full Website offline:
@dbeato said in Downloading full Website offline:
@Obsolesce said in Downloading full Website offline:
Why back it up that way vs the server or files and DB?
Because I don't have access to them at least on those two examples.
Oh, why are you supposed to back up ML without having access to the back-end?
And, how would you restore anything with those backups?
I am not, I was just downloading an offline version. It was a test. ML is pretty big and other forums are big so not a backup.
-
@Obsolesce said in Downloading full Website offline:
@dbeato said in Downloading full Website offline:
@Obsolesce said in Downloading full Website offline:
Why back it up that way vs the server or files and DB?
Because I don't have access to them at least on those two examples.
Oh, why are you supposed to back up ML without having access to the back-end?
And, how would you restore anything with those backups?
Its an emergency procedure for someone who worries that something might happen to the community and disappear. You could programtically reconstruct the community if you had to.
DB access is way better. Obviously.
-
@Obsolesce said in Downloading full Website offline:
@dbeato said in Downloading full Website offline:
@Obsolesce said in Downloading full Website offline:
Why back it up that way vs the server or files and DB?
Because I don't have access to them at least on those two examples.
Oh, why are you supposed to back up ML without having access to the back-end?
And, how would you restore anything with those backups?
RE: Restore
It builds a static version of the site that you could host.
-
So - is someone considering doing that in case another site fails? I wonder how much storage is needed?
-
@Dashrender said in Downloading full Website offline:
I wonder how much storage is needed?
For example ML took about 24 GB of two days downloading, I stopped it because I didn't need it.
-
@dbeato said in Downloading full Website offline:
@Dashrender said in Downloading full Website offline:
I wonder how much storage is needed?
For example ML took about 24 GB of two days downloading, I stopped it because I didn't need it.
lol, not the site I was talking about
-
@dbeato said in Downloading full Website offline:
@Dashrender said in Downloading full Website offline:
I wonder how much storage is needed?
For example ML took about 24 GB of two days downloading, I stopped it because I didn't need it.
Been a few days and still running here.
-
@Dashrender said in Downloading full Website offline:
@dbeato said in Downloading full Website offline:
@Dashrender said in Downloading full Website offline:
I wonder how much storage is needed?
For example ML took about 24 GB of two days downloading, I stopped it because I didn't need it.
lol, not the site I was talking about
Spiceworks about 87 GB to 100 GB only on posts.
-
@dbeato said in Downloading full Website offline:
@Dashrender said in Downloading full Website offline:
@dbeato said in Downloading full Website offline:
@Dashrender said in Downloading full Website offline:
I wonder how much storage is needed?
For example ML took about 24 GB of two days downloading, I stopped it because I didn't need it.
lol, not the site I was talking about
Spiceworks about 87 GB to 100 GB only on posts.
13.5GB on ML so far.
-
ML has very little "media" on the site. So that doesn't expand very quickly.
-
Is there a way to do a dry run just too see how much storage will be consumed without actually downloading?
-
@black3dynamite said in Downloading full Website offline:
Is there a way to do a dry run just too see how much storage will be consumed without actually downloading?
No that I know of.
-
@black3dynamite said in Downloading full Website offline:
Is there a way to do a dry run just too see how much storage will be consumed without actually downloading?
No, the only way to know the size is to grab every file and add it up. You could come up with a way to store that info and not store the files, but no way to not download it all, add it up, and then know. So not really any value to a dry run, it would hit all the same things as the real deal.
