Question 7.13: You need to read the contents of a web page into a string us......
You need to read the contents of a web page into a string using Python.
Step-by-Step
Python has an extensive library for making HTTP requests.
The following example reads the contents of the Google home page into the string contents:
| import urllib2 contents = urllib2.urlopen(“https://www.google.com/”).read() print(contents) |
Discussion
Having read the HTML, you are then likely to want to search it and extract the parts of the text that you really want. For this, you will need to use the string manipulation functions (see Recipes 5.14 and 5.15).
See Also
For an example of using web requests to check for Gmail messages, see Recipe 7.15.
Related Answered Questions
Question: 7.14
Verified Answer:
Import sys and use its argv property, as shown in ...
Question: 7.15
Verified Answer:
Python has a library for the Simple Mail Transfer ...
Question: 7.12
Verified Answer:
Use the random library:
>>> import ran...
Question: 7.16
Verified Answer:
Use the bottle Python library to run a pure Python...
Question: 7.11
Verified Answer:
Use the import command:
import random
Discus...
Question: 7.10
Verified Answer:
Use Python’s try/except construct.
The following e...
Question: 7.9
Verified Answer:
Use the Python pickling feature to dump the data s...
Question: 7.8
Verified Answer:
To read a file’s contents, you need to use the fil...
Question: 7.7
Verified Answer:
Use the open, write, and close functions to open a...
Question: 7.4
Verified Answer:
Define a class and provide it with the member vari...