selenium切换标签页解决get超时问题的完整代码
作者:颹蕭蕭 时间:2023-08-26 09:41:25
从 gif 直观地感受一下效果
我有大量 url 需要访问,但是有些 url 会超时
为了避免超时,设置driver.set_page_load_timeout(3)
限时3秒,一旦超时就会产生 TimeoutException
而且超时后标签页就卡柱了,只能通过 driver.close()
关闭
如果你只有一个标签页,关闭就直接退出了,还得重启
自然想到先保留一个备用的标签,原标签超时需要关闭的时候就切换过来,然后再关闭,并打开新标签,保证任何时候都有两个标签页可用!!
def visit(urls, timeout=3):
driver.implicitly_wait(timeout) # 操作、获取元素时的隐式等待时间
driver.set_page_load_timeout(timeout) # 页面加载超时等待时间
main_win = driver.current_window_handle
for url in urls:
all_win = driver.window_handles
try:
if len(all_win) == 1:
driver.execute_script('window.open();')
driver.get(url)
# 页面处理
pass
except Exception:
for win in all_win:
if main_win != win:
driver.close() # 关闭卡住的标签
driver.switch_to.window(win) # 切换到备用标签
main_win = win # 切换到备用标签
break
完整代码
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.support.wait import WebDriverWait
from selenium.webdriver.chrome.options import Options
import time
import requests
import zipfile
import os
def un_zip(file_name, to_dir='./'):
"""unzip zip file"""
zip_file = zipfile.ZipFile(file_name)
if os.path.isdir(to_dir):
pass
else:
os.mkdir(to_dir)
for names in zip_file.namelist():
zip_file.extract(names, to_dir)
zip_file.close()
def download_driver(to_dir='./', version=''):
print('install chrome-driver first')
url = 'http://npm.taobao.org/mirrors/chromedriver/LATEST_RELEASE'
if len(version)>0:
url = 'http://npm.taobao.org/mirrors/chromedriver/LATEST_RELEASE_'+version
version = requests.get(url).content.decode('utf8')
driver_file = 'http://npm.taobao.org/mirrors/chromedriver/' + version + '/chromedriver_win32.zip'
r = requests.get(driver_file)
download_zip = "chromedriver_win32.zip"
with open(download_zip, "wb") as code:
code.write(r.content)
un_zip(download_zip, to_dir)
os.remove(download_zip)
try:
driver = webdriver.Chrome()
except Exception as e:
download_driver(to_dir='./', version='76')
driver = webdriver.Chrome()
with open("url.txt", 'r') as file:
urls = [ line.strip('\n') for line in file.readlines()]
visit(urls)
for i in driver.window_handles:
driver.switch_to.window(i)
driver.close()
来源:https://blog.csdn.net/itnerd/article/details/108282337
标签:selenium,标签页,超时
![](/images/zang.png)
![](/images/jiucuo.png)
猜你喜欢
使用css给图片添加阴影入门篇
2009-07-06 14:38:00
扩展性很好的一个分页存储过程分享
2011-11-03 17:04:16
Python接口测试文件上传实例解析
2023-04-19 15:59:28
![](https://img.aspxhome.com/file/2023/1/67311_0s.jpg)
ubuntu系统下使用pm2设置nodejs开机自启动的方法
2023-10-02 22:23:16
设计与表达
2009-07-27 11:45:00
![](https://img.aspxhome.com/file/UploadPic/20097/27/0907_sheji_biaoda_01-84s.jpg)
Dreamweaver表格布局经验谈
2007-02-03 11:39:00
关于NumPy中asarray的用法及说明
2023-01-07 17:55:12
JavaScript中一个奇葩的IE浏览器判断方法
2024-04-17 10:24:44
GO语言运行环境下载、安装、配置图文教程
2024-05-11 09:09:11
![](https://img.aspxhome.com/file/2023/7/127027_0s.png)
Java timezone设置和mybatis连接数据库时区设置方式
2024-01-24 09:43:18
![](https://img.aspxhome.com/file/2023/5/99735_0s.png)
Python 常用模块 re 使用方法详解
2021-02-23 13:10:19
mysql oracle和sqlserver分页查询实例解析
2024-01-24 00:30:29
![](https://img.aspxhome.com/file/2023/1/67021_0s.jpg)
java数据库开发之JDBC基础使用方法及实例详解
2024-01-21 04:37:00
django中上传图片分页三级联动效果的实现代码
2022-02-26 18:39:31
![](https://img.aspxhome.com/file/2023/9/64629_0s.png)
详解Python 关联规则分析
2023-09-03 11:54:18
![](https://img.aspxhome.com/file/2023/9/135219_0s.png)
sqlserver 日期比较、日期查询常用语句:月的第一天,季度的第一天等
2010-08-01 18:58:00
PyQt5 QTable插入图片并动态更新的实例
2022-02-11 03:22:43
![](https://img.aspxhome.com/file/2023/9/107459_0s.jpg)
vue filters的使用详解
2024-06-05 09:17:14
![](https://img.aspxhome.com/file/2023/5/123055_0s.png)
vue 自定义icon图标的步骤
2024-04-30 10:37:15
![](https://img.aspxhome.com/file/2023/3/130133_0s.png)
PHP PDOStatement::errorInfo讲解
2023-06-04 14:11:53