我在使用Beautifulsoup解析带有“class”属性的HTML元素时遇到了麻烦。代码看起来像这样
soup = BeautifulSoup(sdata)
mydivs = soup.findAll('div')
for div in mydivs:
if (div["class"] == "stylelistrow"):
print div
我在脚本完成后的同一行上得到一个错误。
File "./beautifulcoding.py", line 130, in getlanguage
if (div["class"] == "stylelistrow"):
File "/usr/local/lib/python2.6/dist-packages/BeautifulSoup.py", line 599, in __getitem__
return self._getAttrMap()[key]
KeyError: 'class'
如何消除这个错误呢?
当前回答
其他答案对我不起作用。
在其他回答中，findAll被用于soup对象本身，但我需要一种方法来对从findAll之后获得的对象中提取的特定元素中的对象执行类名查找。
如果您试图在嵌套的HTML元素中进行搜索，以按类名获取对象，请尝试下面的-
# parse html
page_soup = soup(web_page.read(), "html.parser")
# filter out items matching class name
all_songs = page_soup.findAll("li", "song_item")
# traverse through all_songs
for song in all_songs:
# get text out of span element matching class 'song_name'
# doing a 'find' by class name within a specific song element taken out of 'all_songs' collection
song.find("span", "song_name").text
注意事项:
I'm not explicitly defining the search to be on 'class' attribute findAll("li", {"class": "song_item"}), since it's the only attribute I'm searching on and it will by default search for class attribute if you don't exclusively tell which attribute you want to find on. When you do a findAll or find, the resulting object is of class bs4.element.ResultSet which is a subclass of list. You can utilize all methods of ResultSet, inside any number of nested elements (as long as they are of type ResultSet) to do a find or find all. My BS4 version - 4.9.1, Python version - 3.8.1
其他回答
具体到BeautifulSoup 3:
soup.findAll('div',
{'class': lambda x: x
and 'stylelistrow' in x.split()
}
)
会找到所有这些:
<div class="stylelistrow">
<div class="stylelistrow button">
<div class="button stylelistrow">
你可以使用BS3优化你的搜索，只找到那些给定类的div:
mydivs = soup.find_all("div", {"class": "stylelistrow"})
这招对我很管用:
for div in mydivs:
try:
clazz = div["class"]
except KeyError:
clazz = ""
if (clazz == "stylelistrow"):
print div
下面的方法对我很有效
a_tag = soup.find_all("div",class_='full tabpublist')
从文档中可以看到:
从Beautiful Soup 4.1.2开始，你可以使用关键字参数class_通过CSS类进行搜索:
soup.find_all("a", class_="sister")
在这种情况下是:
soup.find_all("div", class_="stylelistrow")
它还适用于:
soup.find_all("div", class_="stylelistrowone stylelistrowtwo")
