Python 边做边学 8.4 工具类--HTML解析工具(HtmlSoupUtil)

媳妇给我买衣服,我说:”之前我都是两件衬衫过夏天的~”
她没有说话,用眼神表达了鄙视…

原文连接:http://blog.csdn.net/tomorrow13210073213/article/details/77370291

基础工具

java里有“jsoup”解析html;python里有“Beautiful Soup”;如何寻找节点,如何获得节点属性/内容,用法大同小异;关于“Beautiful Soup”的具体用法不再详述,参考如下:
http://cuiqingcai.com/1319.html
https://www.crummy.com/software/BeautifulSoup/bs4/doc/index.zh.html


进一步封装

为了使用方便,基于“Beautiful Soup”进行了进一步封装,使用更方便;封装之前,先确定我们需要哪几个方法:
1. 通过ID获取元素;
2. 通过class获取元素;
3. 通过name获取元素;
4. 通过标签名获取元素
5. 获取元素内部文本;


Talk is cheap. Show me the code

# 通过标签名和class获取第一个元素
def get_one_by_class(soup, ele_name, class_name):
    if soup is None:
        return None
    eles = soup.find_all(ele_name, {"class": class_name}, limit=1)
    if eles is None or len(eles) == 0:
        return None
    return eles[0]

# 通过标签名和class获取所有元素
def get_by_class(soup, ele_name, class_name):
    if soup is None:
        return None
    eles = soup.find_all(ele_name, {"class": class_name})
    if eles is None or len(eles) == 0:
        return None
    return eles

# 通过标签名和id获取第一个元素
def get_one_by_id(soup, ele_name, id_name):
    if soup is None:
        return None
    eles = soup.find_all(ele_name, {"id": id_name}, limit=1)
    if eles is None or len(eles) == 0:
        return None
    return eles[0]

# 通过标签名和id获取所有元素
def get_by_id(soup, ele_name, id_name):
    if soup is None:
        return None
    eles = soup.find_all(ele_name, {"id": id_name})
    if eles is None or len(eles) == 0:
        return None
    return eles

# 通过标签名和name获取第一个元素
def get_one_by_name(soup, ele_name, name):
    if soup is None:
        return None
    eles = soup.find_all(ele_name, {"name": name}, limit=1)
    if eles is None or len(eles) == 0:
        return None
    return eles[0]

# 通过标签名和name获取所有元素
def get_by_name(soup, ele_name, name):
    if soup is None:
        return None
    eles = soup.find_all(ele_name, {"name": name})
    if eles is None or len(eles) == 0:
        return None
    return eles

# 通过标签名获取第一个元素
def get_one_by_tag(soup, ele_name):
    if soup is None:
        return None
    eles = soup.find_all(ele_name, limit=1)
    if eles is None or len(eles) == 0:
        return None
    return eles[0]

# 通过标签名获取所有元素
def get_by_tag(soup, ele_name):
    if soup is None:
        return None
    eles = soup.find_all(ele_name)
    if eles is None or len(eles) == 0:
        return None
    return eles

# 获取元素属性
def get_ele_attr(ele, attr_name):
    if ele is None:
        return None
    atts = ele.get(attr_name)
    if atts is None or len(atts) == 0:
        return None
    return atts

# 获取元素内部文本
def get_ele_txt(ele):
    if ele is None:
        return None
    txt = ele.get_text()
    if txt is None or len(txt) == 0:
        return None
    return txt

以上就是我们用到的解析html的工具类,需求相对比较简单;

以上内容仅供练习,学习使用;

  • 0
    点赞
  • 2
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值