saving threads with wget

[Smeagol]

deb (or nils, or any other unix geeks)

Is there a reason other than my incompetence why I'm unable to save threads using wget?

I've been trying

wget --post-data="username=MyName&password=MyPasswd" --http-user=MyName --http-passwd=MyPasswd ThreadURL

wget --post-data="username=MyName&password=MyPasswd" --http-user=MyName --http-passwd=MyPasswd ThreadURL

And I've tried using the cookie options. All I can download is the login page though. It saved a cookie file like this but I keep getting redirected to the login page even though the cookie file implies I'm already logged in

I've also tried telling wget to use the cookie file my browser is using.

Am I doing something wrong or is the board set up so that wget actually doesn't work?

[Boogie Man]

Am I doing something wrong or is the board set up so that wget actually doesn't work?

i'm useless with nix, but i wouldn't be surprised if that's the case. isn't it a fav amongst anon. trolls+bots, who wget all the images on a website at least million times, in the hopes of pulling off a dos attack?

[mark]

The authentication is cookie based, so you need to post to the login page + store the cookie that is returned by that. You might find something like httrack easier to use.

[Smeagol]

I've now tried with python, and my conclusion is that threads longer than one page get directed to the login page. I was using cookie authentication.

I shall try httrack.

[Smeagol]

Hmph, no luck with httrack. It isn't handling the authentication so I'm getting a page not found error.