Wget - Download a Web Dashboard For Local Viewing?
-
I need to figure out a way to download a dashboard from smartsheet.com and have it available on my local network for viewing from a digital signage browser.
I have been playing with wget to download the files from the link, but am not sure it is working the way I need it.
I used this command to download it-
wget --execute="robots = off" --mirror -p --convert-links https://app.smartsheet.com/b/publish?EQBCT=9772cc64df854381b702905a1ff574fcIt downloads the directories and I end up with one html file, called blank.html. You guessed it, this file is a blank white page.
Here is a tree of the files/directories that are created when it is run-
If this isn't the best way to accomplish the goal, what would you do?
-
Downloading full Website offline
https://www.mangolassi.it/topic/18801/downloading-full-website-offline -
@black3dynamite said in Wget - Download a Web Dashboard For Local Viewing?:
Downloading full Website offline
https://www.mangolassi.it/topic/18801/downloading-full-website-offlineThanks. I tried the command -
wget -mkEpnp https://app.smartsheet.com/b/publish?EQBCT=9772cc64df854381b702905a1ff574fcI got another html file and it loads a smartsheet screen and says it is trying to connect to smartsheet and has an animated progress bar. Then this pops up. I guess this won't work.
-
If the site relies on dynamic data then scraping it likely won't help.
Does the page you need to download have to update or just display static information?Something like PhantomJS may help as it can extract the DOM or create a screenshot of exactly what is displayed on a site rather than relying on data from websockets etc.
-
@manxam said in Wget - Download a Web Dashboard For Local Viewing?:
If the site relies on dynamic data then scraping it likely won't help.
Does the page you need to download have to update or just display static information?Something like PhantomJS may help as it can extract the DOM or create a screenshot of exactly what is displayed on a site rather than relying on data from websockets etc.
Yeah. Seems to be the case. I just talked with the department manager that needs the dashboard. She said that nothing on it is confidential, so we can publish to public, which won't require a login.
There are some custom dashboards we have being developed (going to be ready soon) to display amazon seller central data and this may come up again for that, as they want to be able to have them on displays.
-
I didn't realize that PhantomJS is a "dead project" as of 2018 (though still works). It appears that it -- and the Gecko version SlimmerJS -- both became deprecated when Firefox and Chrome started shipping their "headless browsers" which accomplish the same tasks..
While I know you won't be using it for your current project, it may come in handy for yourself or others in the future.
-
Here is Firefox headless mode:
Firefox uses the same browser, just run with the headless switch. Works from version 57 and newer.
https://developer.mozilla.org/en-US/docs/Mozilla/Firefox/Headless_mode -
@Pete-S said in Wget - Download a Web Dashboard For Local Viewing?:
Here is Firefox headless mode:
Firefox uses the same browser, just run with the headless switch. Works from version 57 and newer.
https://developer.mozilla.org/en-US/docs/Mozilla/Firefox/Headless_modeThanks. I won't be able to use this with brightsign, but it might work if I have to run windows for a site that I can't view a public dashboard.
