在 Python 中获取网页源代码，可以通过多种方式实现。最常见的方式是使用 `requests` 库发送 HTTP 请求并获取网页内容。以下是一个基本的实现方法： ### 获取网页源代码的基本方法 ```python import requests def get_web_source(url): try: response = requests.get(url, timeout=30) response.raise_for_status() # 如果响应状态码不是200，将抛出HTTPError异常 response.encoding = 'utf-8' # 设置编码格式为utf-8 return response.text except requests.RequestException as e: print(f"请求失败: {e}") return "" url = "https://www.baidu.com" source_code = get_web_source(url) print(source_code) ``` ### 进阶用法：添加请求头（User-Agent） 有些网站会对请求头进行检查，因此可以添加 `User-Agent` 来模拟浏览器访问： ```python import requests url = "https://www.baidu.com" headers = { "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.81 Safari/537.36 Edg/94.0.992.47" } response = requests.get(url, headers=headers) response.encoding = "utf-8" print(response.text) ``` ### 将网页源代码保存到文件 如果需要将获取的网页源代码保存到本地文件中，可以使用以下代码： ```python import requests url = "https://www.baidu.com" headers = { "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.81 Safari/537.36 Edg/94.0.992.47" } response = requests.get(url, headers=headers) response.encoding = "utf-8" with open("web_source.html", "w", encoding="utf-8") as file: file.write(response.text) print("网页源代码已保存到 web_source.html") ``` ### 使用 `BeautifulSoup` 解析网页内容 获取网页源代码后，可以使用 `BeautifulSoup` 库对 HTML 内容进行解析，并提取特定数据[^2]： ```python from bs4 import BeautifulSoup import requests def get_web_source(url): try: response = requests.get(url, timeout=30) response.raise_for_status() response.encoding = 'utf-8' return response.text except requests.RequestException as e: print(f"请求失败: {e}") return "" url = "https://www.baidu.com" html = get_web_source(url) soup = BeautifulSoup(html, 'html.parser') # 示例：获取所有 <a> 标签中的链接 for link in soup.find_all('a'): print(link.get('href')) ``` --- ###