爬取搜狗页面【★】

By 大Van家 on 2021-07-23
阅读时间 1 分钟
文章共 124
阅读量

复习:request模块讲解

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
#!/usr/bin/env python 
# -*- coding:utf-8 -*-
# - 需求:爬取搜狗首页的页面数据
import requests

if __name__ == "__main__":
# step_1:指定url
url = 'https://www.sogou.com/'
# step_2:发起请求
# get方法会返回一个响应对象
response = requests.get(url=url)
# step_3:获取响应数据.text返回的是字符串形式的响应数据
page_text = response.text
print(page_text)
# step_4:持久化存储
with open('./sogou.html', 'w', encoding='utf-8') as fp:
fp.write(page_text)
print('#########CRAWLING END#########')

Tips: Please indicate the source and original author when reprinting or quoting this article.