python 中的协程
2022/7/7 1:20:20
本文主要是介绍python 中的协程,对大家解决编程问题具有一定的参考价值,需要的程序猿们随着小编来一起学习吧!
import aiohttp import aiofiles import asyncio # 协程请求 async def get_page_one(href, pathName): async with aiohttp.ClientSession() as session: async with session.get(href, headers=header) as resp: hm = await resp.text(encoding="utf-8") tree = etree.HTML(hm) data = "".join(tree.xpath('//div[@id="neirong"]/p/text()')) # 将数据写入文件 async with aiofiles.open(pathName, "w", encoding="utf-8") as file: await file.write(data) print(pathName+"数据更新完成") #任务绑定 async def main(result_list): # 循环result_list tasks = [] for i in result_list: if not os.path.exists(i["title"]): os.mkdir(i["title"]) href = i["url"] path_name = i["title"]+"/"+i["name"]+".txt" path_name = path_name.replace("****", " ") #作用去除**** # 创建协程任务 task = asyncio.create_task(get_page_one(href, path_name)) tasks.append(task) await asyncio.wait(tasks) #执行 if __name__ == '__main__': url="https://www.51shucheng.net/jiakong/qingyunian" result_list = get_chapter_info(url) event_loop = asyncio.get_event_loop() event_loop.run_until_complete(main(result_list))
这篇关于python 中的协程的文章就介绍到这儿,希望我们推荐的文章对大家有所帮助,也希望大家多多支持为之网!
- 2024-05-08有遇到过吗?同样的规则 Excel 中 比Python 结果大
- 2024-03-30开始python成长之路
- 2024-03-29python optparse
- 2024-03-29python map 函数
- 2024-03-20invalid format specifier python
- 2024-03-18pool.map python
- 2024-03-18threads in python
- 2024-03-14python Ai 应用开发基础训练,字符串,字典,文件
- 2024-03-13id3 algorithm python
- 2024-03-13sum array elements python