Forums

Sega Master System / Mark III / Game Gear
SG-1000 / SC-3000 / SF-7000 / OMV
Home - Forums - Games - Scans - Maps - Cheats - Credits
Music - Videos - Development - Hacks - Translations - Homebrew

View topic - Wget, smspower and sid querystring variable

Reply to topic
Author Message
  • Joined: 25 Dec 2005
  • Posts: 607
  • Location: São Paulo - Brazil
Reply with quote
Wget, smspower and sid querystring variable
Post Posted: Sun Jan 17, 2016 3:00 am
Hi all,

I am trying to download the entire VGM page with wget.

Thing is that seemingly it can't accept the smspower cookies so it appends "?sid=11928ea9d0b" to every link and file being downloaded. (the session variable which is stored in cookie when normal browsing).

I tried changing user agent to Chrome, and even adding the cookie information but it seems that each wget execution gets a new sid which nulls the cookie information from previous request invocation.
  View user's profile Send private message
  • Site Admin
  • Joined: 19 Oct 1999
  • Posts: 14687
  • Location: London
Reply with quote
Post Posted: Sun Jan 17, 2016 8:36 am
The sid is to enable a session to be cookied on the next link, but maybe it isn't working with wget. Is it a problem? Just strip them from the files.
  View user's profile Send private message Visit poster's website
  • Joined: 25 Dec 2005
  • Posts: 607
  • Location: São Paulo - Brazil
Reply with quote
Zip
Post Posted: Sun Jan 17, 2016 3:46 pm
When you try to download the zip files you must specify the extension to wget. The sid querystring is appended to the extension and wget ignores the file since it isn't zip.
  View user's profile Send private message
  • Joined: 25 Dec 2005
  • Posts: 607
  • Location: São Paulo - Brazil
Reply with quote
Post Posted: Sun Jan 17, 2016 10:35 pm
Well, I did it.

I saved the html source from browser, stripped all sids, and used the saved file as input to wget, accepting zip files.

It's downloading the entire assets now.
  View user's profile Send private message
  • Joined: 16 May 2002
  • Posts: 1355
  • Location: italy
Reply with quote
Post Posted: Mon Jan 18, 2016 1:13 am
I would have just used the DownThemAll extension, but maybe that's not available in your browser of choice.
  View user's profile Send private message Visit poster's website
  • Joined: 25 Dec 2005
  • Posts: 607
  • Location: São Paulo - Brazil
Reply with quote
Post Posted: Mon Jan 18, 2016 1:15 am
My fingers are itching for a LoTR comment here :) Anyways, thx.
  View user's profile Send private message
Reply to topic



Back to the top of this page

Back to SMS Power!