CODEWITHSUNDEEP
python
Mahmoud
Mahmoud

Reputation: 251

Custom opener or Request headers

I am trying to replicate a wget command in a Python script. The wget command goes along these lines:

wget --user user --password pass http://serveraddress/

FYI, and as you can guess, it’s a simple authentication which is mandatory. You are prompted with a pop up form where you enter your username and password. So, unless you enter the credentials you can’t reach the address.
In my script, I prompt the user to enter his username and password and I store them. So far everything makes sense. However, after this I get really confused. The reason is that I read two different things on the web in general and in fact in Python Essential Reference about urllib2.urlopen() (FYI, I have to use the standard library only; so requests is not an option for me).
So, PER says “The basic urlopen() function does not provide support for authentication, cookies, or other advanced features of HTTP. To add support, you must create your own custom opener object using the build_opener() function.” Other people, for example here, say that you need to create a Request object and add headers to it. So, what am I missing here? Any help is much appreciate.

Upvotes: 0

Views: 490

Answers (1)

Robᵩ
Robᵩ

Reputation: 168716

Use the requests package. Your question is, in fact, the very first example they cite in their doc:

r = requests.get('https://api.github.com/user', auth=('user', 'pass'))

However, if you absolutely cannot use requests, the authors conveniently describe how to use the equivalent functionality in urllib2. Go to the requests documentation page, click on "See similar code, without Requests", and steal the urllib2 code from there.

Upvotes: 2

Related Questions