CODEWITHSUNDEEP
pythonregexscreen-scrapingextract
das
das

Reputation:

Find all IPs on an HTML Page

I want to get an HTML page with python and then print out all the IPs from it. I will define an IP as the following:

x.x.x.x:y

Where: x = a number between 0 and 256. y = a number with < 7 digits.

Thanks.

Upvotes: 0

Views: 1020

Answers (5)

mmdemirbas
mmdemirbas

Reputation: 9158

In action:

\b(?:                # A.B.C in A.B.C.D:port
    (?:
       25[0-5]
    |  2[0-4][0-9]
    |  1[0-9][0-9]
    |  [1-9]?[0-9]
    )\.
  ){3}
  (?:                # D in A.B.C.D:port
    25[0-5]
  | 2[0-4][0-9]
  | 1[0-9][0-9]
  | [1-9]?[0-9]
  )
  :[1-9]\d{0,5}     # port number any number in (0,999999]
\b

Upvotes: 0

Matthew Wilkes
Matthew Wilkes

Reputation: 36

Try:

re.compile("\d?\d?\d.\d?\d?\d.\d?\d?\d.\d?\d?\d:\d+").findall(urllib2.urlopen(url).read())

Upvotes: 0

Unknown
Unknown

Reputation: 46821

Right. The only part I cant do is the regular expression one. – das 9 mins ago If someone shows me that, I will be fine. – das 8 mins ago

import re

ip = re.compile(r"\b(?:(?:25[0-5]|2[0-4]\d|[01]?\d\d?)\.){3}(?:25[0-5]|2[0-4]\d|[01]?\d\d?):\d{1,6}\b")
junk = " 1.1.1.1:123 2.2.2.2:321 312.123.1.12:123 "
print ip.findall(junk)

# outputs ['1.1.1.1:123', '2.2.2.2:321']

Here is a complete example:

import re, urllib2

f = urllib2.urlopen("http://www.samair.ru/proxy/ip-address-01.htm")
junk = f.read()

ip = re.compile(r"\b(?:(?:25[0-5]|2[0-4]\d|[01]?\d\d?)\.){3}(?:25[0-5]|2[0-4]\d|[01]?\d\d?):\d{1,6}\b")
print ip.findall(junk)

# ['114.30.47.10:80', '118.228.148.83:80', '119.70.40.101:8080', '12.47.164.114:8888', '121.
# 17.161.114:3128', '122.152.183.103:80', '122.224.171.91:3128', '123.234.32.27:8080', '124.
# 107.85.115:80', '124.247.222.66:6588', '125.76.228.201:808', '128.112.139.75:3128', '128.2
# 08.004.197:3128', '128.233.252.11:3124', '128.233.252.12:3124']

Upvotes: 3

Ross
Ross

Reputation: 3749

Not to turn this into a who's-a-better-regex-author-war but...

(\d{1,3}\.){3}\d{1,3}\:\d{1,6}

Upvotes: 1

Rob
Rob

Reputation: 48379

The basic approach would be:

  • Use urllib2 to download the contents of the page
  • Use a regular expression to extract IPv4-like addresses
  • Validate each match according to the numeric constraints on each octet
  • Print out the list of matches

Please provide a clearer indication of what specific part you are having trouble with, along with evidence to show what it is you've tried thus far.

Upvotes: 1

Related Questions