What are the differences between the urllib, urllib2, urllib3 and requests module?

urllib, urllib2, and urllib3 are Python modules for handling URLs and HTTP requests. They share similar functionality but have evolved over time to add new features and address bugs.

urllib is the original module for handling URLs in Python. It is part of the Python standard library in Python 2 and 3. In Python 3, it was reorganized into submodules such as urllib.request, urllib.parse, urllib.error, and urllib.robotparser. It includes the urlopen function for opening URLs, the urlretrieve function for downloading URLs to a local file, and other utilities for URL handling.

urllib2 was added in Python 2 as an improved version of urllib. It introduced features like handling HTTP redirects, adding custom headers, and processing responses. Note that urllib2 was removed in Python 3, and its functionality was merged into the urllib.request submodule.

urllib3 is a third-party library that provides similar functionality to the built-in urllib modules. It is designed to be more efficient, secure, and feature-rich, offering connection pooling, thread safety, and client-side TLS/SSL verification.

requests is a popular third-party library for handling HTTP requests. It is designed to be more user-friendly and Pythonic than the built-in modules, abstracting away much of the boilerplate code required for network communication.

Here is an example of how to use the requests module to make a GET request to a website and retrieve the response:

Make a GET request in Python using the requests module

import requests

try:
    response = requests.get('https://www.example.com')
    response.raise_for_status()  # Raise an exception for bad status codes
    print(response.text)
except requests.exceptions.RequestException as e:
    print(f"An error occurred: {e}")

Quick Comparison & Usage Guidelines