CODEWITHSUNDEEP
pythonpython-3.4
Adi Wong
Adi Wong

Reputation: 403

urllib HTTPS request: <urlopen error unknown url type: https>

I have a script on python3.4 and it has been fine until the website I download the file from decides to use https and now I am getting error but can't figure out how I can retrive the file.

My script import the following library and uses the urlretrive to get the file previously. Since it is now forwarded to https with 302 redirection. I am getting some error.

import urllib
import urllib.request

urllib.request.urlretrieve("http://wordpress.org/latest.tar.gz", "/thefile.gz")

My error:-

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.4/urllib/request.py", line 178, in urlretrieve
    with contextlib.closing(urlopen(url, data)) as fp:
  File "/usr/local/lib/python3.4/urllib/request.py", line 153, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/local/lib/python3.4/urllib/request.py", line 461, in open
    response = meth(req, response)
  File "/usr/local/lib/python3.4/urllib/request.py", line 571, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/local/lib/python3.4/urllib/request.py", line 493, in error
    result = self._call_chain(*args)
  File "/usr/local/lib/python3.4/urllib/request.py", line 433, in _call_chain
    result = func(*args)
  File "/usr/local/lib/python3.4/urllib/request.py", line 676, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "/usr/local/lib/python3.4/urllib/request.py", line 455, in open
    response = self._open(req, data)
  File "/usr/local/lib/python3.4/urllib/request.py", line 478, in _open
    'unknown_open', req)
  File "/usr/local/lib/python3.4/urllib/request.py", line 433, in _call_chain
    result = func(*args)
  File "/usr/local/lib/python3.4/urllib/request.py", line 1257, in unknown_open
    raise URLError('unknown url type: %s' % type)
urllib.error.URLError: <urlopen error unknown url type: https>

Upvotes: 28

Views: 73708

Answers (7)

Abubakar Cool
Abubakar Cool

Reputation: 50

If your url has single or double quotes, i.e. '' or "", then it also gives this error.

Replace your single or double quotes with %20

url='http://stackoverflow.com/wizard.php?id="hah"'

should be changed to

url='http://stackoverflow.com/wizard.php?id=%20hah%20'

Upvotes: -2

ChrisQIU
ChrisQIU

Reputation: 326

I ran into the similar problem.
I used anaconda, and I simply moved these two file to anaconda3\DLLs and it worked.

  • libcrypto-1_1-x64.dll
  • libssl-1_1-x64.dll

I don't know why.
The reason I know this is that I tried to use ssl module to ignore certificate errors.

import ssl
ctx = ssl.create_default_context()
ctx.check_hostname = False
ctx.verify_mode = ssl.CERT_NONE

After these lines, the https error went away and gave me another error:
DLL load failed while importing _ssl: The specified module could not be found.

So I went to this post and found these two important files.

ps: the ssl module is not necessary.

Upvotes: 4

Nitin Barthwal
Nitin Barthwal

Reputation: 25

For me the error was resolved by downloading the correct version of openssl.

I was using python 3.7.5 32 bit version on windows 10 machine.

  1. goto https://slproweb.com/products/Win32OpenSSL.html and download Win32 OpenSSL v1.1.1h EXE | MSI 54MB Installer version . I used 32 bit as my python interpreter was 32 bit.

  2. Install and run.

Issue fixed :)

Upvotes: 2

Khalid
Khalid

Reputation: 49

for HTTP
people who encountered the error ValueError: unknown url type: 'http or ValueError: unknown url type: b'http

while opening some url like below with urllib.request.Request 'http://localhost/simple_form/insert.php'

just change localhost to 127.0.0.1

looks like Request method is looking for a domain.something in url

Upvotes: -2

moyo
moyo

Reputation: 1402

Had this issue, and it was solved by upgrading Python with

brew upgrade python

Upvotes: 2

Farshad Hasanpour
Farshad Hasanpour

Reputation: 221

I had the same problem with Anaconda but after installing the OpenSSL package, it works well.

conda install -c anaconda openssl

Upvotes: 5

Mikko Ohtamaa
Mikko Ohtamaa

Reputation: 83788

Most likely your Python installation or operating system is broken.

Python has only support for HTTPS if it was compiled with HTTPS support. However, this should be the default for all sane installations.

HTTPS support is only available if the socket module was compiled with SSL support.

https://docs.python.org/3/library/http.client.html

Please clarify how you installed Python. Official Python distributions are available at python.org

Upvotes: 23

Related Questions