python中抓取小米应用商城xpath实例

本文展示了如何使用Python通过XPath从小米应用商城抓取APP信息,包括APP的名称和下载链接。通过解析页面源码,获取到多个热门应用的详细详情,并列出了一部分抓取到的应用实例。
摘要由CSDN通过智能技术生成

 页面源码:






  
  
  





<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
<title>手机游戏应用商店_软件商店app下载-小米应用商店</title>
<meta name="description" content='小米应用商店是由小米推出的手机软件商店合集,致力于成为全面、优质的手机游戏应用商店,在这里用户可以找到最新最好玩的手机app和游戏应用,并提供软件商店app下载,最新最好玩的应用和游戏尽在小米应用商店' />
<meta name="keywords" content='手机应用商店,游戏应用商店,app商店下载,手机软件商店,软件商店app,小米应用商店,小米市场' />
<link rel="stylesheet" href="/assets/css/style.min.c04c1b95.css"/>
<link rel="shortcut icon" href="https://www.mi.com/favicon.ico">
<script type="text/javascript" src="https://static-verify.sec.xiaomi.com/v2/js/v.js"></script>
<script src="/assets/js/sea.js"></script>
<script>
var rEnv = "pro";
var rKey = "c3ac4b9db2c84bc5a06c195bca5eabff";
// seajs 的简单配置
seajs.config({
  alias: {
    "jquery": "ext/jquery-3.4.1.min"
  }
})
</script>

    <script>
        // https://tongji.baidu.com/sc-web/30600511/home/site/getjs?siteId=15064227
        var _hmt = _hmt || [];
        (function() {
            var hm = document.createElement("script");
            hm.src = "https://hm.baidu.com/hm.js?765fefc2c357bae3970cea72e714811b";
            var s = document.getElementsByTagName("script")[0];
            s.parentNode.insertBefore(hm, s);
        })();
    </script>


</head>
<body>
<!DOCTYPE html>
<div class="header">
    <div class="container">
      <h1><a class="logo" href="/">小米应用商店</a></h1>
      <div class="login">
        <ul>
          
            
              <li><a href="https://account.xiaomi.com/pass/register" target="_blank">注册</a></li>
              <li>|</li>
              <li><a href="/login?referer=https%3A%2F%2Fapp.mi.com%2F" id="J_Nologin">登录</a></li>
            
            
          
        </ul>
      </div>
      <div class="site-tab">
        
          <span class="sitetab-mobile sitetab-mobile-active">手机应用</span><a href="/?type=pad" class="sitetab-pad">平板应用</a>
        
        
      </div> 
    </div>
</div>
<div class="menu">
  <div class="container">
    <div class="menu-con">
      <ul>
        <li><a href="/">首页</a></li>
        
        
          <li><a href="/subjectList">专题</a></li>
        
<!--         
          <li><a href="/appDownload" target="_blank">客户端</a></li>
         -->
        <li><a href="https://dev.mi.com/console/" target="_blank">开发者</a></li>
        <li><a href="https://game.xiaomi.com/" target="_blank">游戏中心</a></li>
      </ul>
    </div>
    <div class="search-form">
      <form method="get" onsubmit="return false" id="search" class="searchForm">
        <input id="keyWord" type="text" name="keywords" class="keyword" placeholder="搜索应用或游戏" value="" autocomplete="off"/>
        <button id="searchSubmit" type="submit" value="搜索"><i class="icon-search"></i></button>
      </form>
    </div>
  </div>
</div>

<div class="slide-float" style="position:fixed;bottom:325px;right:30px;width:120px;height:120px;z-index:1100;"><img src="/get_qrcode_image" alt="小米游戏中心二维码" width="120" height="120"></div>
<div class="slide-float" style="position:fixed;bottom:265px;right:10px;width:160px;height:229px;z-index:1000;"><img src="/assets/img/game-frame.5aad92a5.png" alt="小米游戏中心" width="160" height="229"></div>

<div class="slide-float" style="position:fixed;bottom:40px;right:10px;width:160px;height:218px;z-index:1000;"><img src="/assets/img/wx-qrcode.a358dd6b.png" alt="小米应用商店" width='160' height='218'></div>

<div class="main index-page">
  <div class="container cf">
    <!-- main-con begin -->
    <div class="main-con">
      
        
          
        

<div class="slide" id="slide">
  
    
    
    <a href="/subject/169660" class="slide-mod"><img src="http://t3.market.xiaomi.com/thumbnail/jpeg/l750/AppStore/08dc7f461e6574d970405c15f2fe26de22ba6c9e4" alt="谁动了我的奶酪?" width="750" height="220"></a>
  
    
    
    <a href="/subject/169449" class="slide-mod"><img src="http://t3.market.xiaomi.com/thumbnail/jpeg/l750/AppStore/01d0753ba603691e181c670f5adb40a825f423298" alt="金米奖" width="750" height="220"></a>
  
    
    
    <a href="/subject/169810" class="slide-mod"><img src="http://t5.market.mi-img.com/thumbnail/jpeg/l750/AppStore/0109858b6e98c9ca662d285311d5cf73ef04033a3" alt="重磅新游推荐" width="750" height="220"></a>
  
    
    
    <a href="/subject/169617" class="slide-mod"><img src="http://t2.market.mi-img.com/thumbnail/jpeg/l750/AppStore/08636408ad50fc7396a2dcac92ac1b18b6842ddbc" alt="和僵尸来一场正面对决吧" width="750" height="220"></a>
  
</div>
      

      
        <div class="applist-wrap">
        <div class="main-h">
          <a class="more" href="/allFeaturedList">查看全部</a></a>
          <h3>精品推荐</h3>
        </div>
        <ul class="applist">
          
            
          







  
  
    
  
  <li>
    <a href="/details?id=com.tencent.tmgp.jx3m"><img data-src="http://file.market.xiaomi.com/thumbnail/PNG/l62/AppStore/00f187f15f123499c949ea1913899d3ae4f49a5f9" src="http://resource.xiaomi.net/miuimarket/app/lazyload.gif" alt="剑网3:指尖江湖" width="72" height="72"></a>
    <h5>
      <a href="/details?id=com.tencent.tmgp.jx3m">剑网3:指尖江湖</a>
    </h5>
    <p class="app-desc">
      <a href="/category/19">网游RPG</a>
    </p>
  </li>

  
    
  
  
  <li>
    <a href="/details?id=cn.youth.news"><img data-src="http://file.market.xiaomi.com/thumbnail/PNG/l62/AppStore/0b9383baf0fcc465d93fc81d7c9f2c7d657399462" src="http://resource.xiaomi.net/miuimarket/app/lazyload.gif" alt="中青看点" width="72" height="72"></a>
    <h5>
      <a href="/details?id=cn.youth.news">中青看点</a>
    </h5>
    <p class="app-desc">
      <a href="/category/11">新闻资讯</a>
    </p>
  </li>

  
  
    
  
  <li>
    <a href="/details?id=com.shandagames.legendofhonour.mi"><img data-src="http://file.market.xiaomi.com/thumbnail/PNG/l62/AppStore/0903c421fa2b60a2b35f269433933a80bfc410cd1" src="http://resource.xiaomi.net/miuimarket/app/lazyload.gif" alt="光明勇士" width="72" height="72"></a>
    <h5>
      <a href="/details?id=com.shandagames.legendofhonour.mi">光明勇士</a>
    </h5>
    <p class="app-desc">
      <a href="/category/19">网游RPG</a>
    </p>
  </li>

  
  
    
  
  <li>
    <a href="/details?id=com.taiyouxi.ifsanguo.mi"><img data-src="http://file.market.xiaomi.com/thumbnail/PNG/l62/AppStore/07117a545401a4b4283ae28f045f7999e76e714ac" src="http://resource.xiaomi.net/miuimarket/app/lazyload.gif" alt="极无双" width="72" height="72"></a>
    <h5>
      <a href="/details?id=com.taiyouxi.ifsanguo.mi">极无双</a>
    </h5>
    <p class="app-desc">
      <a href="/category/19">网游RPG</a>
    </p>
  </li>

  
    
  
  
  <li>
    <a href="/details?id=com.qts.customer"><img data-src="http://file.market.xiaomi.com/thumbnail/PNG/l62/AppStore/00138ed3dc49d4435aaf399c2d7bba38bf5aaa4ba" src="http://resource.xiaomi.net/miuimarket/app/lazyload.gif" alt="青团社兼职-海量同城日结兼职。" width="72" height="72"></a>
    <h5>
      <a href="/details?id=com.qts.customer">青团社兼职-海量同城日结兼职。</a>
    </h5>
    <p class="app-desc">
      <a href="/category/10">效率办公</a>
    </p>
  </li>

  
  
    
  
  <li>
    <a href="/details?id=com.tencent.hyrzol"><img data-src="http://file.market.xiaomi.com/thumbnail/PNG/l62/AppStore/0016fa4714a37459325e41306be403b5b533e29a4" src="http://resource.xiaomi.net/miuimarket/app/lazyload.gif" alt="火影忍者:忍者新世代" width="72" height="72"></a>
    <h5>
      <a href="/details?id=com.tencent.hyrzol">火影忍者:忍者新世代</a>
    </h5>
    <p class="app-desc">
      <a href="/category/19">网游RPG</a>
    </p>
  </li>

  
    
  
  
  <li>
    <a href="/details?id=com.mintmuse.miramusic"><img data-src="http://file.market.xiaomi.com/thumbnail/PNG/l62/AppStore/0acb349251e6644fd6169bb466dd1c32b40412cc5" src="http://resource.xiaomi.net/miuimarket/app/lazyload.gif" alt="迷鹿吉他钢琴尤克-吉他尤克里里" width
  • 18
    点赞
  • 23
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值