0
0

python 爬虫 入门 ：一点小实战（爬取小说）。

  1.     小说行当不好做，笔趣阁犹如雨后春笋。你要说笔趣阁的资源哪来的？指不定也是从“笔趣阁”中来。今天咱就来爬一部小说试试（侵删）
  3.     随便找个小说网站，随便点本小说，我就不写网址了，看下面图片,准备爬这一部小说，咱先看看网站的robots.txt，没有Disallow，都可以爬，开整。

  1.     到小说具体页面后，先打开源代码查看，发现直接源码里有文字，而且还有一个唯一id“nr1”，可以直接使用。现在就要确定这么多章小说，每个章节的url了。

  1.     小说首页中， 有部分章节的链接，打开源代码查看，发现小说具体章节的链接没什么规律，必须要从目录获取，目录名有规律，index_n.html,n取值1~60即可。

  1.     到这步骤就出来了，先访问index获取具体页面，然后从页面中摘取文本保存到列表中（为了保持顺序，你也可以先每章一个文件，最后综合。），最后 将列表结果保存到txt文档里面即可。大约有1200章，263.8万字，往多了算也就二十来兆，没一个图片大，可行。
  3.    开始编写代码， 当我们需要从源代码中找数据时，可以将源代码复制下来，粘贴到程序中测试一下。使用debug模式尝试解析代码。以避免测试过多访问导致封ip等事情。
  1. from bs4 import BeautifulSoup
  3. str = '''
  4.     目录源代码 https://m.a4aa.com/5755/index_2.html
  5. '''
  7. bs = BeautifulSoup(str, "html.parser")  # 从目录找到章节ip
  8. data = bs.find_all("section", class_="zxjz fk")[1]
  9. data = [i["href"] for i in data.find_all("a")]
  11. print(data)
  1. from bs4 import BeautifulSoup
  3. str = '''
  4. 小说内容页面源代码 https://m.a4aa.com/5755/3290542.html
  5. '''
  7. bs = BeautifulSoup(str, "html.parser")  # 找到需要保存的所有内容
  8. title = bs.find_all("div", id="nr_title")[0]  # 章节名
  9. text = '\n' + title.string + '\n\n'  # 这样可以识别出目录。
  10. nr1 = bs.find_all("div", id="nr1")[0]  # 章节内容
  11. text += nr1.text
  12. print(text)

代码写完后，开始尝试爬取，爬取一般后禁止访问，爬的太快不让干了，所以更改逻辑，一次爬20章，爬完后歇会再爬。

代码：

  1. import asyncio
  2. import os
  3. import pickle
  4. import time
  6. import aiohttp
  7. from bs4 import BeautifulSoup
  9. async def get_url(url, headers, urls, num):  # 获取目录num下全部url
  10.     url_f = url + "/5755/index_" + str(num) + ".html"  # 产生目录url
  11.     async with aiohttp.ClientSession() as session:
  12.         async with session.get(url=url_f, headers=headers)as resp:  # 一个目录至少20个
  13.             bs = BeautifulSoup(await resp.text(), "html.parser")  # 从目录找到章节ip
  14.             data = bs.find_all("section", class_="zxjz fk")[1]
  15.             data = [i["href"] for i in data.find_all("a")]
  16.     for l in range(len(data)):
  17.         urls[l + (num - 1) * 20] = url + data[l]
  18.     print("目录", num, "完成")
  20. async def get_text(url, headers, str_data, str_data_ok, num):  # 获取章节需要保存的内容
  21.     if str_data_ok[num]:  # 保存过，不管了
  22.         return
  23.     async with aiohttp.ClientSession() as session:
  24.         async with session.get(url=url, headers=headers)as resp:
  25.             bs = BeautifulSoup(await resp.text(), "html.parser")  # 找到需要保存的所有内容
  26.             title = bs.find_all("div", id="nr_title")[0]  # 章节名
  27.             text = '\n\n' + title.string + '\n\n'  # 这样可以识别出目录。
  28.             nr1 = bs.find_all("div", id="nr1")[0]  # 章节内容
  29.             text += nr1.text
  30.             str_data[num] = text  # 保存章节
  31.             # 完工，标注该章结束
  32.             str_data_ok[num] = True
  34. async def get_all_url(url_1, headers, urls):  # 获取所有url存到urls
  35.     tasks = [asyncio.create_task(get_url(url_1, headers, urls, num)) for num in range(1, 61)]
  36.     # tasks = [asyncio.create_task(get_url(url_1, headers, urls, num)) for num in range(1, 2)]  # 先来20章试试水
  37.     await asyncio.wait(tasks)
  39. async def get_all_text(urls, headers, str_data, str_data_ok, start, end):  # 获取所有章节内容存到str_data
  40.     # tasks = [asyncio.create_task(get_text(urls[num], headers, str_data, num)) for num in range(len(urls))]
  41.     # tasks = [asyncio.create_task(get_text(urls[num], headers, str_data, num)) for num in range(20)]
  42.     # 小网站，给人爬崩了，一次请求一部分。
  43.     tasks = [asyncio.create_task(get_text(urls[num], headers, str_data, str_data_ok, num)) for num in range(start, end)]
  44.     await asyncio.wait(tasks)
  46. if __name__ == "__main__":
  48.     # 初始化变量======================================================================
  50.     now_time = [time.time(), 0, 0, 0]
  51.     seat = '小说.pkl'  # python变量保存位置，用于恢复运行
  52.     url_1 = "https://m.a4aa.com"
  53.     max_len = 1188
  54.     urls = [""] * max_len  # 所有章节url
  55.     urls_ok = False  # 章节url是否保存完整
  56.     all_text_data = [""] * max_len  # 所有数据url
  57.     all_text_data_ok = [False] * max_len  # 相应章节是否已经保存
  58.     save_path = "小说.txt"  # 保存位置
  59.     headers = {
  60.         # 用户代理，某些网站验证用户代理，微微改一下，如果提示要验证码之类的，使用它
  61.         "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 "
  62.                       "Safari/537.36 Edg/126.0.0.0",
  63.     }
  65.     #   加载旧变量 ======================================================================
  67.     if os.path.exists(seat):  # 加载过去文件
  68.         print("检测到已保存文件,是否加载(Y\\N):")
  69.         shuru = input()
  70.         if shuru == 'Y' or shuru == 'y':
  71.             with open(seat, 'rb') as f:
  72.                 old_data = pickle.load(f)
  73.                 urls = old_data["urls"]  # 所有url
  74.                 urls_ok = old_data["urls_ok"]
  75.                 all_text_data = old_data["all_text_data"]  # 所有章节文本
  76.                 all_text_data_ok = old_data["all_text_data_ok"]
  77.             print("已完成：", sum(all_text_data_ok) * 100 / len(all_text_data_ok))
  78.             print("已加载")
  79.         else:
  80.             print("未加载")
  82.     # 开始执行程序=======================================================================
  83.     try:  # 出错就保存一下
  85.         # 获取目录===========================================================================
  87.         if not urls_ok:
  88.             loop = asyncio.get_event_loop()
  89.             loop.run_until_complete(get_all_url(url_1, headers, urls))
  90.             urls_ok = True
  91.             print("目录获取完成，开始获取章节", '======================================================')
  92.         else:
  93.             print("目录已保存过，开始获取章节", '======================================================')
  94.         now_time[1] = time.time()
  95.         print("用时：", now_time[1] - now_time[0], 's')
  97.         # 获取章节===============================================================================
  99.         now_num = 0  # 开始章节数-1
  100.         while True:  # 一个小循环，每次拿一章内容保存，保存完休息会
  101.             in_time = time.time()
  102.             now_num2 = now_num + 20  # 结束章节
  103.             if now_num2 > max_len:  # 超限结束
  104.                 now_num2 = max_len
  105.                 loop = asyncio.get_event_loop()
  106.                 loop.run_until_complete(get_all_text(urls, headers, all_text_data, all_text_data_ok, now_num, now_num2))
  107.                 break
  108.             else:
  109.                 loop = asyncio.get_event_loop()
  110.                 loop.run_until_complete(get_all_text(urls, headers, all_text_data, all_text_data_ok, now_num, now_num2))
  111.             print('已保存', now_num + 1, now_num2, '\n用时：', time.time() - in_time, '小睡一下')
  112.             time.sleep(5)
  113.             print('睡眠完毕')
  114.             now_num += 20
  116.         print("文章已全部获取", '======================================================')
  117.         now_time[2] = time.time()
  118.         print("用时：", now_time[2] - now_time[1], 's')
  119.         print("开始保存", '======================================================')
  120.         now_time[3] = time.time()
  122.         # 保存文本=====================================================================
  124.         with open(save_path, mode='w', encoding='utf-8') as f:
  125.             for text in all_text_data:
  126.                 f.write(text)
  127.         print("用时：", now_time[3] - now_time[2], 's')
  128.         print("总用时：", now_time[3] - now_time[0], 's')
  129.         print("已完成：", sum(all_text_data_ok) * 100 / len(all_text_data_ok))
  130.         all_data = {"urls": urls,  # 所有url
  131.                     "urls_ok": urls_ok,
  132.                     "all_text_data": all_text_data,  # 所有章节文本
  133.                     "all_text_data_ok": all_text_data_ok}
  134.         with open(seat, 'wb') as f:  # 保存变量
  135.             pickle.dump(all_data, f)
  137.     except Exception as e:
  138.         print("已完成：", sum(all_text_data_ok) * 100 / len(all_text_data_ok))
  139.         all_data = {"urls": urls,  # 所有url
  140.                     "urls_ok": urls_ok,
  141.                     "all_text_data": all_text_data,  # 所有章节文本
  142.                     "all_text_data_ok": all_text_data_ok}
  143.         with open(seat, 'wb') as f:  # 保存变量
  144.             pickle.dump(all_data, f)

结果：第一次运行：（有一些超时的，问题不大）

  1. C:\Users\86135\AppData\Local\Programs\Python\Python39\python.exe C:/Users/86135/PycharmProjects/pythonProject/测试/测试.py
  2. 检测到已保存文件,是否加载(Y\N):
  3. y
  4. 已完成： 0.0
  5. 已加载
  6. 目录 6 完成
  7. 目录 25 完成
  8. 目录 51 完成
  9. 目录 22 完成
  10. 目录 31 完成
  11. 目录 42 完成
  12. 目录 30 完成
  13. 目录 53 完成
  14. 目录 20 完成
  15. 目录 13 完成
  16. 目录 32 完成
  17. 目录 5 完成
  18. 目录 45 完成
  19. 目录 41 完成
  20. 目录 21 完成
  21. 目录 12 完成
  22. 目录 4 完成
  23. 目录 44 完成
  24. 目录 2 完成
  25. 目录 7 完成
  26. 目录 37 完成
  27. 目录 38 完成
  28. 目录 40 完成
  29. 目录 15 完成
  30. 目录 55 完成
  31. 目录 48 完成
  32. 目录 29 完成
  33. 目录 50 完成
  34. 目录 57 完成
  35. 目录 47 完成
  36. 目录 59 完成
  37. 目录 28 完成
  38. 目录 3 完成
  39. 目录 26 完成
  40. 目录 33 完成
  41. 目录 10 完成
  42. 目录 56 完成
  43. 目录 43 完成
  44. 目录 39 完成
  45. 目录 8 完成
  46. 目录 1 完成
  47. 目录 35 完成
  48. 目录 14 完成
  49. 目录 27 完成
  50. 目录 60 完成
  51. 目录 34 完成
  52. 目录 23 完成
  53. 目录 54 完成
  54. 目录 19 完成
  55. 目录 24 完成
  56. 目录 17 完成
  57. 目录 9 完成
  58. 目录 18 完成
  59. 目录 52 完成
  60. 目录 58 完成
  61. 目录 36 完成
  62. 目录 11 完成
  63. 目录 49 完成
  64. 目录 16 完成
  65. 目录 46 完成
  66. 目录获取完成，开始获取章节 ======================================================
  67. 用时： 26.672559022903442 s
  68. 已保存 1 20 
  69. 用时： 0.9862778186798096 小睡一下
  70. 睡眠完毕
  71. 已保存 21 40 
  72. 用时： 0.9691689014434814 小睡一下
  73. 睡眠完毕
  74. 已保存 41 60 
  75. 用时： 0.9766478538513184 小睡一下
  76. 睡眠完毕
  77. 已保存 61 80 
  78. 用时： 0.9963347911834717 小睡一下
  79. 睡眠完毕
  80. 已保存 81 100 
  81. 用时： 0.9797823429107666 小睡一下
  82. 睡眠完毕
  83. 已保存 101 120 
  84. 用时： 1.000009536743164 小睡一下
  85. 睡眠完毕
  86. 已保存 121 140 
  87. 用时： 0.9792578220367432 小睡一下
  88. 睡眠完毕
  89. 已保存 141 160 
  90. 用时： 0.9902822971343994 小睡一下
  91. 睡眠完毕
  92. 已保存 161 180 
  93. 用时： 0.9691574573516846 小睡一下
  94. 睡眠完毕
  95. 已保存 181 200 
  96. 用时： 30.67471194267273 小睡一下
  97. Task exception was never retrieved
  98. future: <Task finished name='Task-734' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/3293235.html')>
  99. Traceback (most recent call last):
  100.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  101.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  102.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  103.     transport, protocol = await self._create_connection_transport(
  104.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  105.     await waiter
  106. asyncio.exceptions.CancelledError
  108. During handling of the above exception, another exception occurred:
  110. Traceback (most recent call last):
  111.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  112.     conn = await self._connector.connect(
  113.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  114.     proto = await self._create_connection(req, traces, timeout)
  115.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  116.     _, proto = await self._create_direct_connection(req, traces, timeout)
  117.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  118.     raise last_exc
  119.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  120.     transp, proto = await self._wrap_create_connection(
  121.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  122.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  123.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  124.     self._do_exit(exc_type)
  125.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  126.     raise asyncio.TimeoutError
  127. asyncio.exceptions.TimeoutError
  129. The above exception was the direct cause of the following exception:
  131. Traceback (most recent call last):
  132.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  133.     async with session.get(url=url, headers=headers)as resp:
  134.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  135.     self._resp: _RetType = await self._coro
  136.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  137.     raise ConnectionTimeoutError(
  138. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/3293235.html
  139. 睡眠完毕
  140. Task exception was never retrieved
  141. future: <Task finished name='Task-797' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/3293528.html')>
  142. Traceback (most recent call last):
  143.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  144.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  145.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  146.     transport, protocol = await self._create_connection_transport(
  147.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  148.     await waiter
  149. asyncio.exceptions.CancelledError
  151. During handling of the above exception, another exception occurred:
  153. Traceback (most recent call last):
  154.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  155.     conn = await self._connector.connect(
  156.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  157.     proto = await self._create_connection(req, traces, timeout)
  158.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  159.     _, proto = await self._create_direct_connection(req, traces, timeout)
  160.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  161.     raise last_exc
  162.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  163.     transp, proto = await self._wrap_create_connection(
  164.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  165.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  166.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  167.     self._do_exit(exc_type)
  168.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  169.     raise asyncio.TimeoutError
  170. asyncio.exceptions.TimeoutError
  172. The above exception was the direct cause of the following exception:
  174. Traceback (most recent call last):
  175.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  176.     async with session.get(url=url, headers=headers)as resp:
  177.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  178.     self._resp: _RetType = await self._coro
  179.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  180.     raise ConnectionTimeoutError(
  181. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/3293528.html
  182. Task exception was never retrieved
  183. future: <Task finished name='Task-796' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/3293521.html')>
  184. Traceback (most recent call last):
  185.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  186.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  187.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  188.     transport, protocol = await self._create_connection_transport(
  189.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  190.     await waiter
  191. asyncio.exceptions.CancelledError
  193. During handling of the above exception, another exception occurred:
  195. Traceback (most recent call last):
  196.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  197.     conn = await self._connector.connect(
  198.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  199.     proto = await self._create_connection(req, traces, timeout)
  200.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  201.     _, proto = await self._create_direct_connection(req, traces, timeout)
  202.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  203.     raise last_exc
  204.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  205.     transp, proto = await self._wrap_create_connection(
  206.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  207.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  208.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  209.     self._do_exit(exc_type)
  210.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  211.     raise asyncio.TimeoutError
  212. asyncio.exceptions.TimeoutError
  214. The above exception was the direct cause of the following exception:
  216. Traceback (most recent call last):
  217.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  218.     async with session.get(url=url, headers=headers)as resp:
  219.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  220.     self._resp: _RetType = await self._coro
  221.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  222.     raise ConnectionTimeoutError(
  223. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/3293521.html
  224. 已保存 201 220 
  225. 用时： 30.99604558944702 小睡一下
  226. 睡眠完毕
  227. 已保存 221 240 
  228. 用时： 30.971959352493286 小睡一下
  229. Task exception was never retrieved
  230. future: <Task finished name='Task-853' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/3293732.html')>
  231. Traceback (most recent call last):
  232.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  233.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  234.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  235.     transport, protocol = await self._create_connection_transport(
  236.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  237.     await waiter
  238. asyncio.exceptions.CancelledError
  240. During handling of the above exception, another exception occurred:
  242. Traceback (most recent call last):
  243.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  244.     conn = await self._connector.connect(
  245.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  246.     proto = await self._create_connection(req, traces, timeout)
  247.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  248.     _, proto = await self._create_direct_connection(req, traces, timeout)
  249.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  250.     raise last_exc
  251.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  252.     transp, proto = await self._wrap_create_connection(
  253.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  254.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  255.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  256.     self._do_exit(exc_type)
  257.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  258.     raise asyncio.TimeoutError
  259. asyncio.exceptions.TimeoutError
  261. The above exception was the direct cause of the following exception:
  263. Traceback (most recent call last):
  264.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  265.     async with session.get(url=url, headers=headers)as resp:
  266.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  267.     self._resp: _RetType = await self._coro
  268.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  269.     raise ConnectionTimeoutError(
  270. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/3293732.html
  271. 睡眠完毕
  272. 已保存 241 260 
  273. 用时： 6.197637319564819 小睡一下
  274. 睡眠完毕
  275. 已保存 261 280 
  276. 用时： 1.0338616371154785 小睡一下
  277. 睡眠完毕
  278. 已保存 281 300 
  279. 用时： 2.0356712341308594 小睡一下
  280. 睡眠完毕
  281. 已保存 301 320 
  282. 用时： 0.9921369552612305 小睡一下
  283. 睡眠完毕
  284. 已保存 321 340 
  285. 用时： 1.0640060901641846 小睡一下
  286. 睡眠完毕
  287. 已保存 341 360 
  288. 用时： 1.0201935768127441 小睡一下
  289. 睡眠完毕
  290. 已保存 361 380 
  291. 用时： 1.0203821659088135 小睡一下
  292. 睡眠完毕
  293. 已保存 381 400 
  294. 用时： 0.9939565658569336 小睡一下
  295. 睡眠完毕
  296. 已保存 401 420 
  297. 用时： 1.0569934844970703 小睡一下
  298. 睡眠完毕
  299. 已保存 421 440 
  300. 用时： 1.0331060886383057 小睡一下
  301. 睡眠完毕
  302. 已保存 441 460 
  303. 用时： 1.0108842849731445 小睡一下
  304. 睡眠完毕
  305. 已保存 461 480 
  306. 用时： 1.013477087020874 小睡一下
  307. 睡眠完毕
  308. 已保存 481 500 
  309. 用时： 24.80794596672058 小睡一下
  310. 睡眠完毕
  311. 已保存 501 520 
  312. 用时： 1.0152294635772705 小睡一下
  313. 睡眠完毕
  314. 已保存 521 540 
  315. 用时： 22.0968017578125 小睡一下
  316. 睡眠完毕
  317. 已保存 541 560 
  318. 用时： 1.0083670616149902 小睡一下
  319. 睡眠完毕
  320. 已保存 561 580 
  321. 用时： 21.392114400863647 小睡一下
  322. 睡眠完毕
  323. 已保存 581 600 
  324. 用时： 30.079055547714233 小睡一下
  325. Task exception was never retrieved
  326. future: <Task finished name='Task-1949' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/3299056.html')>
  327. Traceback (most recent call last):
  328.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  329.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  330.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  331.     transport, protocol = await self._create_connection_transport(
  332.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  333.     await waiter
  334. asyncio.exceptions.CancelledError
  336. During handling of the above exception, another exception occurred:
  338. Traceback (most recent call last):
  339.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  340.     conn = await self._connector.connect(
  341.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  342.     proto = await self._create_connection(req, traces, timeout)
  343.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  344.     _, proto = await self._create_direct_connection(req, traces, timeout)
  345.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  346.     raise last_exc
  347.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  348.     transp, proto = await self._wrap_create_connection(
  349.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  350.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  351.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  352.     self._do_exit(exc_type)
  353.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  354.     raise asyncio.TimeoutError
  355. asyncio.exceptions.TimeoutError
  357. The above exception was the direct cause of the following exception:
  359. Traceback (most recent call last):
  360.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  361.     async with session.get(url=url, headers=headers)as resp:
  362.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  363.     self._resp: _RetType = await self._coro
  364.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  365.     raise ConnectionTimeoutError(
  366. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/3299056.html
  367. 睡眠完毕
  368. 已保存 601 620 
  369. 用时： 1.0188708305358887 小睡一下
  370. 睡眠完毕
  371. 已保存 621 640 
  372. 用时： 1.039496660232544 小睡一下
  373. 睡眠完毕
  374. 已保存 641 660 
  375. 用时： 1.0427892208099365 小睡一下
  376. 睡眠完毕
  377. 已保存 661 680 
  378. 用时： 1.0124883651733398 小睡一下
  379. 睡眠完毕
  380. 已保存 681 700 
  381. 用时： 1.0155725479125977 小睡一下
  382. 睡眠完毕
  383. 已保存 701 720 
  384. 用时： 1.0273873805999756 小睡一下
  385. 睡眠完毕
  386. 已保存 721 740 
  387. 用时： 1.036287546157837 小睡一下
  388. 睡眠完毕
  389. 已保存 741 760 
  390. 用时： 1.0013742446899414 小睡一下
  391. 睡眠完毕
  392. 已保存 761 780 
  393. 用时： 1.0504977703094482 小睡一下
  394. 睡眠完毕
  395. 已保存 781 800 
  396. 用时： 1.0260164737701416 小睡一下
  397. 睡眠完毕
  398. 已保存 801 820 
  399. 用时： 30.63787031173706 小睡一下
  400. Task exception was never retrieved
  401. future: <Task finished name='Task-2636' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/13370518.html')>
  402. Traceback (most recent call last):
  403.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  404.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  405.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  406.     transport, protocol = await self._create_connection_transport(
  407.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  408.     await waiter
  409. asyncio.exceptions.CancelledError
  411. During handling of the above exception, another exception occurred:
  413. Traceback (most recent call last):
  414.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  415.     conn = await self._connector.connect(
  416.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  417.     proto = await self._create_connection(req, traces, timeout)
  418.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  419.     _, proto = await self._create_direct_connection(req, traces, timeout)
  420.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  421.     raise last_exc
  422.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  423.     transp, proto = await self._wrap_create_connection(
  424.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  425.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  426.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  427.     self._do_exit(exc_type)
  428.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  429.     raise asyncio.TimeoutError
  430. asyncio.exceptions.TimeoutError
  432. The above exception was the direct cause of the following exception:
  434. Traceback (most recent call last):
  435.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  436.     async with session.get(url=url, headers=headers)as resp:
  437.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  438.     self._resp: _RetType = await self._coro
  439.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  440.     raise ConnectionTimeoutError(
  441. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/13370518.html
  442. 睡眠完毕
  443. 已保存 821 840 
  444. 用时： 30.976993560791016 小睡一下
  445. Task exception was never retrieved
  446. future: <Task finished name='Task-2679' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/13404059.html')>
  447. Traceback (most recent call last):
  448.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  449.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  450.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  451.     transport, protocol = await self._create_connection_transport(
  452.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  453.     await waiter
  454. asyncio.exceptions.CancelledError
  456. During handling of the above exception, another exception occurred:
  458. Traceback (most recent call last):
  459.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  460.     conn = await self._connector.connect(
  461.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  462.     proto = await self._create_connection(req, traces, timeout)
  463.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  464.     _, proto = await self._create_direct_connection(req, traces, timeout)
  465.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  466.     raise last_exc
  467.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  468.     transp, proto = await self._wrap_create_connection(
  469.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  470.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  471.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  472.     self._do_exit(exc_type)
  473.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  474.     raise asyncio.TimeoutError
  475. asyncio.exceptions.TimeoutError
  477. The above exception was the direct cause of the following exception:
  479. Traceback (most recent call last):
  480.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  481.     async with session.get(url=url, headers=headers)as resp:
  482.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  483.     self._resp: _RetType = await self._coro
  484.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  485.     raise ConnectionTimeoutError(
  486. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/13404059.html
  487. 睡眠完毕
  488. 已保存 841 860 
  489. 用时： 1.0284440517425537 小睡一下
  490. 睡眠完毕
  491. 已保存 861 880 
  492. 用时： 1.0212693214416504 小睡一下
  493. 睡眠完毕
  494. 已保存 881 900 
  495. 用时： 1.0207250118255615 小睡一下
  496. 睡眠完毕
  497. 已保存 901 920 
  498. 用时： 1.0172266960144043 小睡一下
  499. 睡眠完毕
  500. 已保存 921 940 
  501. 用时： 1.0471982955932617 小睡一下
  502. 睡眠完毕
  503. 已保存 941 960 
  504. 用时： 1.0365018844604492 小睡一下
  505. 睡眠完毕
  506. 已保存 961 980 
  507. 用时： 0.9948766231536865 小睡一下
  508. 睡眠完毕
  509. 已保存 981 1000 
  510. 用时： 3.99578857421875 小睡一下
  511. 睡眠完毕
  512. 已保存 1001 1020 
  513. 用时： 11.078922271728516 小睡一下
  514. 睡眠完毕
  515. Task exception was never retrieved
  516. future: <Task finished name='Task-3294' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/19071953.html')>
  517. Traceback (most recent call last):
  518.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  519.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  520.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  521.     transport, protocol = await self._create_connection_transport(
  522.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  523.     await waiter
  524. asyncio.exceptions.CancelledError
  526. During handling of the above exception, another exception occurred:
  528. Traceback (most recent call last):
  529.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  530.     conn = await self._connector.connect(
  531.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  532.     proto = await self._create_connection(req, traces, timeout)
  533.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  534.     _, proto = await self._create_direct_connection(req, traces, timeout)
  535.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  536.     raise last_exc
  537.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  538.     transp, proto = await self._wrap_create_connection(
  539.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  540.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  541.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  542.     self._do_exit(exc_type)
  543.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  544.     raise asyncio.TimeoutError
  545. asyncio.exceptions.TimeoutError
  547. The above exception was the direct cause of the following exception:
  549. Traceback (most recent call last):
  550.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  551.     async with session.get(url=url, headers=headers)as resp:
  552.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  553.     self._resp: _RetType = await self._coro
  554.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  555.     raise ConnectionTimeoutError(
  556. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/19071953.html
  557. Task exception was never retrieved
  558. future: <Task finished name='Task-3293' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/19071952.html')>
  559. Traceback (most recent call last):
  560.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  561.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  562.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  563.     transport, protocol = await self._create_connection_transport(
  564.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  565.     await waiter
  566. asyncio.exceptions.CancelledError
  568. During handling of the above exception, another exception occurred:
  570. Traceback (most recent call last):
  571.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  572.     conn = await self._connector.connect(
  573.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  574.     proto = await self._create_connection(req, traces, timeout)
  575.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  576.     _, proto = await self._create_direct_connection(req, traces, timeout)
  577.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  578.     raise last_exc
  579.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  580.     transp, proto = await self._wrap_create_connection(
  581.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  582.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  583.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  584.     self._do_exit(exc_type)
  585.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  586.     raise asyncio.TimeoutError
  587. asyncio.exceptions.TimeoutError
  589. The above exception was the direct cause of the following exception:
  591. Traceback (most recent call last):
  592.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  593.     async with session.get(url=url, headers=headers)as resp:
  594.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  595.     self._resp: _RetType = await self._coro
  596.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  597.     raise ConnectionTimeoutError(
  598. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/19071952.html
  599. 已保存 1021 1040 
  600. 用时： 30.70367741584778 小睡一下
  601. 睡眠完毕
  602. 已保存 1041 1060 
  603. 用时： 1.005244255065918 小睡一下
  604. 睡眠完毕
  605. Task exception was never retrieved
  606. future: <Task finished name='Task-3424' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/19791607.html')>
  607. Traceback (most recent call last):
  608.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  609.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  610.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  611.     transport, protocol = await self._create_connection_transport(
  612.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  613.     await waiter
  614. asyncio.exceptions.CancelledError
  616. During handling of the above exception, another exception occurred:
  618. Traceback (most recent call last):
  619.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  620.     conn = await self._connector.connect(
  621.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  622.     proto = await self._create_connection(req, traces, timeout)
  623.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  624.     _, proto = await self._create_direct_connection(req, traces, timeout)
  625.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  626.     raise last_exc
  627.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  628.     transp, proto = await self._wrap_create_connection(
  629.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  630.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  631.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  632.     self._do_exit(exc_type)
  633.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  634.     raise asyncio.TimeoutError
  635. asyncio.exceptions.TimeoutError
  637. The above exception was the direct cause of the following exception:
  639. Traceback (most recent call last):
  640.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  641.     async with session.get(url=url, headers=headers)as resp:
  642.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  643.     self._resp: _RetType = await self._coro
  644.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  645.     raise ConnectionTimeoutError(
  646. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/19791607.html
  647. Task exception was never retrieved
  648. future: <Task finished name='Task-3413' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/19620830.html')>
  649. Traceback (most recent call last):
  650.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  651.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  652.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  653.     transport, protocol = await self._create_connection_transport(
  654.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  655.     await waiter
  656. asyncio.exceptions.CancelledError
  658. During handling of the above exception, another exception occurred:
  660. Traceback (most recent call last):
  661.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  662.     conn = await self._connector.connect(
  663.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  664.     proto = await self._create_connection(req, traces, timeout)
  665.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  666.     _, proto = await self._create_direct_connection(req, traces, timeout)
  667.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  668.     raise last_exc
  669.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  670.     transp, proto = await self._wrap_create_connection(
  671.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  672.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  673.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  674.     self._do_exit(exc_type)
  675.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  676.     raise asyncio.TimeoutError
  677. asyncio.exceptions.TimeoutError
  679. The above exception was the direct cause of the following exception:
  681. Traceback (most recent call last):
  682.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  683.     async with session.get(url=url, headers=headers)as resp:
  684.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  685.     self._resp: _RetType = await self._coro
  686.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  687.     raise ConnectionTimeoutError(
  688. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/19620830.html
  689. 已保存 1061 1080 
  690. 用时： 30.98487401008606 小睡一下
  691. Task exception was never retrieved
  692. future: <Task finished name='Task-3412' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/19620828.html')>
  693. Traceback (most recent call last):
  694.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  695.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  696.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  697.     transport, protocol = await self._create_connection_transport(
  698.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  699.     await waiter
  700. asyncio.exceptions.CancelledError
  702. During handling of the above exception, another exception occurred:
  704. Traceback (most recent call last):
  705.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  706.     conn = await self._connector.connect(
  707.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  708.     proto = await self._create_connection(req, traces, timeout)
  709.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  710.     _, proto = await self._create_direct_connection(req, traces, timeout)
  711.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  712.     raise last_exc
  713.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  714.     transp, proto = await self._wrap_create_connection(
  715.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  716.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  717.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  718.     self._do_exit(exc_type)
  719.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  720.     raise asyncio.TimeoutError
  721. asyncio.exceptions.TimeoutError
  723. The above exception was the direct cause of the following exception:
  725. Traceback (most recent call last):
  726.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  727.     async with session.get(url=url, headers=headers)as resp:
  728.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  729.     self._resp: _RetType = await self._coro
  730.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  731.     raise ConnectionTimeoutError(
  732. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/19620828.html
  733. 睡眠完毕
  734. 已保存 1081 1100 
  735. 用时： 1.0197718143463135 小睡一下
  736. 睡眠完毕
  737. 已保存 1101 1120 
  738. 用时： 1.0471570491790771 小睡一下
  739. 睡眠完毕
  740. 已保存 1121 1140 
  741. 用时： 1.0287730693817139 小睡一下
  742. 睡眠完毕
  743. 已保存 1141 1160 
  744. 用时： 0.9939365386962891 小睡一下
  745. 睡眠完毕
  746. 已保存 1161 1180 
  747. 用时： 30.855279684066772 小睡一下
  748. Task exception was never retrieved
  749. future: <Task finished name='Task-3716' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/23189130.html')>
  750. Traceback (most recent call last):
  751.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  752.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  753.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  754.     transport, protocol = await self._create_connection_transport(
  755.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  756.     await waiter
  757. asyncio.exceptions.CancelledError
  759. During handling of the above exception, another exception occurred:
  761. Traceback (most recent call last):
  762.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  763.     conn = await self._connector.connect(
  764.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  765.     proto = await self._create_connection(req, traces, timeout)
  766.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  767.     _, proto = await self._create_direct_connection(req, traces, timeout)
  768.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  769.     raise last_exc
  770.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  771.     transp, proto = await self._wrap_create_connection(
  772.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  773.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  774.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  775.     self._do_exit(exc_type)
  776.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  777.     raise asyncio.TimeoutError
  778. asyncio.exceptions.TimeoutError
  780. The above exception was the direct cause of the following exception:
  782. Traceback (most recent call last):
  783.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  784.     async with session.get(url=url, headers=headers)as resp:
  785.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  786.     self._resp: _RetType = await self._coro
  787.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  788.     raise ConnectionTimeoutError(
  789. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/23189130.html
  790. 睡眠完毕
  791. 文章已全部获取 ======================================================
  792. 用时： 738.5638995170593 s
  793. 开始保存 ======================================================
  794. Task exception was never retrieved
  795. future: <Task finished name='Task-3772' coro=<get_text() done, defined at C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py:22> exception=ConnectionTimeoutError('Connection timeout to host https://m.a4aa.com/5755/26752119.html')>
  796. Traceback (most recent call last):
  797.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  798.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  799.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1081, in create_connection
  800.     transport, protocol = await self._create_connection_transport(
  801.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\asyncio\base_events.py", line 1111, in _create_connection_transport
  802.     await waiter
  803. asyncio.exceptions.CancelledError
  805. During handling of the above exception, another exception occurred:
  807. Traceback (most recent call last):
  808.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 663, in _request
  809.     conn = await self._connector.connect(
  810.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 563, in connect
  811.     proto = await self._create_connection(req, traces, timeout)
  812.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1032, in _create_connection
  813.     _, proto = await self._create_direct_connection(req, traces, timeout)
  814.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1366, in _create_direct_connection
  815.     raise last_exc
  816.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1335, in _create_direct_connection
  817.     transp, proto = await self._wrap_create_connection(
  818.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\connector.py", line 1098, in _wrap_create_connection
  819.     return await self._loop.create_connection(*args, **kwargs, sock=sock)
  820.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 141, in __aexit__
  821.     self._do_exit(exc_type)
  822.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\async_timeout\__init__.py", line 228, in _do_exit
  823.     raise asyncio.TimeoutError
  824. asyncio.exceptions.TimeoutError
  826. The above exception was the direct cause of the following exception:
  828. Traceback (most recent call last):
  829.   File "C:\Users\86135\PycharmProjects\pythonProject\测试\测试.py", line 26, in get_text
  830.     async with session.get(url=url, headers=headers)as resp:
  831.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 1359, in __aenter__
  832.     self._resp: _RetType = await self._coro
  833.   File "C:\Users\86135\AppData\Local\Programs\Python\Python39\lib\site-packages\aiohttp\client.py", line 667, in _request
  834.     raise ConnectionTimeoutError(
  835. aiohttp.client_exceptions.ConnectionTimeoutError: Connection timeout to host https://m.a4aa.com/5755/26752119.html
  836. 用时： 0.0 s
  837. 总用时： 765.2364585399628 s
  838. 已完成： 98.82154882154882
  840. 进程已结束，退出代码为 0

第二次运行：(将之前超时失败的全部整完。)

  1. C:\Users\86135\AppData\Local\Programs\Python\Python39\python.exe C:/Users/86135/PycharmProjects/pythonProject/测试/测试.py
  2. 检测到已保存文件,是否加载(Y\N):
  3. y
  4. 已完成： 98.82154882154882
  5. 已加载
  6. 目录已保存过，开始获取章节 ======================================================
  7. 用时： 1.8765432834625244 s
  8. 已保存 1 20 
  9. 用时： 0.0020132064819335938 小睡一下
  10. 睡眠完毕
  11. 已保存 21 40 
  12. 用时： 0.0 小睡一下
  13. 睡眠完毕
  14. 已保存 41 60 
  15. 用时： 0.0 小睡一下
  16. 睡眠完毕
  17. 已保存 61 80 
  18. 用时： 0.0 小睡一下
  19. 睡眠完毕
  20. 已保存 81 100 
  21. 用时： 0.0 小睡一下
  22. 睡眠完毕
  23. 已保存 101 120 
  24. 用时： 0.0 小睡一下
  25. 睡眠完毕
  26. 已保存 121 140 
  27. 用时： 0.0 小睡一下
  28. 睡眠完毕
  29. 已保存 141 160 
  30. 用时： 0.0 小睡一下
  31. 睡眠完毕
  32. 已保存 161 180 
  33. 用时： 0.0 小睡一下
  34. 睡眠完毕
  35. 已保存 181 200 
  36. 用时： 1.1031506061553955 小睡一下
  37. 睡眠完毕
  38. 已保存 201 220 
  39. 用时： 1.1709847450256348 小睡一下
  40. 睡眠完毕
  41. 已保存 221 240 
  42. 用时： 1.0908143520355225 小睡一下
  43. 睡眠完毕
  44. 已保存 241 260 
  45. 用时： 0.0 小睡一下
  46. 睡眠完毕
  47. 已保存 261 280 
  48. 用时： 0.0 小睡一下
  49. 睡眠完毕
  50. 已保存 281 300 
  51. 用时： 0.0 小睡一下
  52. 睡眠完毕
  53. 已保存 301 320 
  54. 用时： 0.0 小睡一下
  55. 睡眠完毕
  56. 已保存 321 340 
  57. 用时： 0.0 小睡一下
  58. 睡眠完毕
  59. 已保存 341 360 
  60. 用时： 0.0 小睡一下
  61. 睡眠完毕
  62. 已保存 361 380 
  63. 用时： 0.0 小睡一下
  64. 睡眠完毕
  65. 已保存 381 400 
  66. 用时： 0.0 小睡一下
  67. 睡眠完毕
  68. 已保存 401 420 
  69. 用时： 0.0 小睡一下
  70. 睡眠完毕
  71. 已保存 421 440 
  72. 用时： 0.0 小睡一下
  73. 睡眠完毕
  74. 已保存 441 460 
  75. 用时： 0.0 小睡一下
  76. 睡眠完毕
  77. 已保存 461 480 
  78. 用时： 0.0 小睡一下
  79. 睡眠完毕
  80. 已保存 481 500 
  81. 用时： 0.0 小睡一下
  82. 睡眠完毕
  83. 已保存 501 520 
  84. 用时： 0.0 小睡一下
  85. 睡眠完毕
  86. 已保存 521 540 
  87. 用时： 0.0 小睡一下
  88. 睡眠完毕
  89. 已保存 541 560 
  90. 用时： 0.0 小睡一下
  91. 睡眠完毕
  92. 已保存 561 580 
  93. 用时： 0.0 小睡一下
  94. 睡眠完毕
  95. 已保存 581 600 
  96. 用时： 1.1043505668640137 小睡一下
  97. 睡眠完毕
  98. 已保存 601 620 
  99. 用时： 0.0 小睡一下
  100. 睡眠完毕
  101. 已保存 621 640 
  102. 用时： 0.0 小睡一下
  103. 睡眠完毕
  104. 已保存 641 660 
  105. 用时： 0.0 小睡一下
  106. 睡眠完毕
  107. 已保存 661 680 
  108. 用时： 0.0 小睡一下
  109. 睡眠完毕
  110. 已保存 681 700 
  111. 用时： 0.0 小睡一下
  112. 睡眠完毕
  113. 已保存 701 720 
  114. 用时： 0.0 小睡一下
  115. 睡眠完毕
  116. 已保存 721 740 
  117. 用时： 0.0 小睡一下
  118. 睡眠完毕
  119. 已保存 741 760 
  120. 用时： 0.0 小睡一下
  121. 睡眠完毕
  122. 已保存 761 780 
  123. 用时： 0.0 小睡一下
  124. 睡眠完毕
  125. 已保存 781 800 
  126. 用时： 0.0 小睡一下
  127. 睡眠完毕
  128. 已保存 801 820 
  129. 用时： 1.184851884841919 小睡一下
  130. 睡眠完毕
  131. 已保存 821 840 
  132. 用时： 1.1437313556671143 小睡一下
  133. 睡眠完毕
  134. 已保存 841 860 
  135. 用时： 0.0 小睡一下
  136. 睡眠完毕
  137. 已保存 861 880 
  138. 用时： 0.0 小睡一下
  139. 睡眠完毕
  140. 已保存 881 900 
  141. 用时： 0.0 小睡一下
  142. 睡眠完毕
  143. 已保存 901 920 
  144. 用时： 0.0 小睡一下
  145. 睡眠完毕
  146. 已保存 921 940 
  147. 用时： 0.0 小睡一下
  148. 睡眠完毕
  149. 已保存 941 960 
  150. 用时： 0.0 小睡一下
  151. 睡眠完毕
  152. 已保存 961 980 
  153. 用时： 0.0 小睡一下
  154. 睡眠完毕
  155. 已保存 981 1000 
  156. 用时： 0.0 小睡一下
  157. 睡眠完毕
  158. 已保存 1001 1020 
  159. 用时： 0.0 小睡一下
  160. 睡眠完毕
  161. 已保存 1021 1040 
  162. 用时： 1.0622766017913818 小睡一下
  163. 睡眠完毕
  164. 已保存 1041 1060 
  165. 用时： 0.0 小睡一下
  166. 睡眠完毕
  167. 已保存 1061 1080 
  168. 用时： 1.0756304264068604 小睡一下
  169. 睡眠完毕
  170. 已保存 1081 1100 
  171. 用时： 0.0 小睡一下
  172. 睡眠完毕
  173. 已保存 1101 1120 
  174. 用时： 0.0 小睡一下
  175. 睡眠完毕
  176. 已保存 1121 1140 
  177. 用时： 0.0 小睡一下
  178. 睡眠完毕
  179. 已保存 1141 1160 
  180. 用时： 0.0 小睡一下
  181. 睡眠完毕
  182. 已保存 1161 1180 
  183. 用时： 1.0669140815734863 小睡一下
  184. 睡眠完毕
  185. 文章已全部获取 ======================================================
  186. 用时： 306.5122067928314 s
  187. 开始保存 ======================================================
  188. 用时： 0.0 s
  189. 总用时： 308.38875007629395 s
  190. 已完成： 100.0
  192. 进程已结束，退出代码为 0

这是最后的文件结果：

发送到手机上看看：没有问题。

标签： 爬虫
本文转载自: https://blog.csdn.net/weixin_58196051/article/details/143159343
版权归原作者 i道i 所有， 如有侵权，请联系我们删除。
登录后发布评论

“python 爬虫 入门 ：一点小实战（爬取小说）。”的评论:

还没有评论
关于作者
...
overfit同步小助手
文章同步
相关阅读

网络安全法-网络运行安全

使用selenium/drissionpage时如何阻止chrome自动跳转http到https

docker desktop 里部署的Open WebUI 管理员密码忘记了的处理方法

在ubuntu20.04中搭建onsite比赛运行环境

利用开源的低代码表单设计器FcDesigner高效管理和渲染复杂表单结构

Kafka学习笔记

【前端】浏览器输入url到页面呈现发生了什么？

文章导航
代码：