Linux机器上Selenium+Python3+Chrome使用driver.get()只能获取到标签而没有内容的解决方法

  • 代码:

#!/usr/bin/python3
#coding=utf8
from selenium import webdriver
from selenium.webdriver.chrome.options import Options

chrome_options = Options()
chrome_options.add_argument('--headless')
chrome_options.add_argument('--no-sandbox')
chrome_options.add_argument('--disable-gpu')
chrome_options.add_argument('--disable-dev-shm-usage')
driver = webdriver.Chrome(chrome_options=chrome_options)

driver.get("http://toutiao.com/group/6552087122092753412") #获取头条网页源代码
print(driver.page_source)

driver.quit()
  • 问题现象:

[root@qiufeng workspace]# python3 test.py

[root@qiufeng workspace]#
  • 解决方法:

# 注释headless
# chrome_options.add_argument('--headless')
# 添加header
chrome_options.add_argument('user-agent="Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36"')
  • 结果:

[root@qiufeng workspace]# python3 test.py
成都街拍,夏季时尚穿搭参考,你更喜欢哪一款?