Python-因解析器选择爬取大学排名时出现小问题

解析器为python标准库时爬取url=http://www.zuihaodaxue.cn/zuihaodaxuepaiming2017.html出现问题
但是爬取http://www.zuihaodaxue.cn/zuihaodaxuepaiming2016.html或其他年份时不会出现问题

import requests
from bs4 import BeautifulSoup
allUniv = []
def getHTMLText(url):
    try:
        r = requests.get(url,timeout=30)
        r.raise_for_status()
        r.encoding = 'utf-8'
        return r.text
    except:
        return ""
def fillUnivList(soup):
    data = soup.find_all('tr')
    for tr in data:
        ltd = tr.find_all('td')
        if len(ltd)==0:
            continue
        singleUniv = []
        for td in ltd:
            singleUniv.append(td.string)
        allUniv.append(singleUniv)
def printUnivList(num):
    print("{:^4}{:^10}{:^5}{:^8}{:^10}".format("排名","学校名称","省市","总分","培养规模"))
    for i in range(num):
        u = allUniv[i]
        print("{:^4}{:^10}{:^5}{:^8}{:^10}".format(u[0],u[1],u[2],u[3],u[6]))
def main(num):
    url = "http://www.zuihaodaxue.cn/zuihaodaxuepaiming2017.html"
    html = getHTMLText(url)
    soup = BeautifulSoup(html,features="lxml")#改成 soup = BeautifulSoup(html,"html.parser")就会出现问题
    fillUnivList(soup)
    # print(allUniv)#######
    printUnivList(num)
main(10)

Python-因解析器选择爬取大学排名时出现小问题_第1张图片
Python-因解析器选择爬取大学排名时出现小问题_第2张图片

Python-因解析器选择爬取大学排名时出现小问题_第3张图片
更换BeautifulSoup解析器即可解决

你可能感兴趣的:(初学python)