获取网页链接,比正则表达式更灵活更大众化.

最新推荐文章于 2023-03-02 10:25:35 发布

智者知已应修善业

最新推荐文章于 2023-03-02 10:25:35 发布

阅读量348

点赞数

本文链接：https://blog.csdn.net/xianfajushi/article/details/83818270

版权

今天终于写好了不用正则表达式获取网页内需要的链接信息,比正则表达式更灵活,更大众化,通常正则表达式是写死的,正则表达式也不为普通使用者所熟知和使用,而我设计完成的方法,采用普通字符串,可以任意添加,灵活性强,且为大众所熟知.

下面用实例说明,下面是获取网址文件:

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=GB2312">
<title>中药材名称大全 - 中药查询</title>
<meta name="Keywords" content="中药材,药材,中药名,中药名称,药材名称" />
<meta name="Description" content="常用的中药材名称，冷门的中药材名称，你都可以在这里找到，你还可以按分类来寻找你需要的中药材，按中草药药用部位、拼音首字母及功效等，点击还可以查看药材图片..." />
<link href="http://www.zhongyoo.com/img/css/39base.css" rel="stylesheet" type="text/css">
<link href="http://www.zhongyoo.com/img/css/jbk_nav12_2.css" rel="stylesheet" type="text/css">
<link href="http://www.zhongyoo.com/img/css/jbk_style.css" rel="stylesheet" type="text/css">
<link href="http://www.zhongyoo.com/img/css/index.css" type="text/css" rel="stylesheet">
<link href="/img/css/on_new.css" type="text/css" rel="stylesheet">
<script language="javascript" type="text/javascript" src="http://www.zhongyoo.com/img/js/toptongji.js"></script>
<base target="_blank" />
</head>
.........
<div class="copyrightbox">
<div> <span> 本站所有内容均是来源于互联网、正规药学专著、杂志及文摘，内容如果有错误之处，也恳请批评指正。您如果转载本站内容请注明来源地址。</span> </div> <script>show_view_02();</script>
</div>
<div class="bottominfo" id="bottominfo" style="padding-top:10px;">
<hr style="width:970px;color:#bbb;" size="1">
<a href="http://www.zhongyoo.com/" title="中药">中药</a> | <a href="http://www.zhongyoo.com/sitemap.html" rel="nofollow">网站地图</a> | <a href="http://www.zhongyoo.com/name/" title="中药材名称大全">中药材名称大全</a> | <a href="javascript:myhomepage()" name="homepage" target="_self" rel="nofollow">设为首页</a> | <a href="javascript:addfavorite()" target="_self" rel="nofollow">加入收藏</a> | <a href="http://www.zhongyoo.com/adpage.html" rel="nofollow">广告合作</a><br>
Copyright &#169; 2016　www.zhongyoo.com All Rights Reserved.　中药查询 京ICP备13004469号-1 <script language="javascript" type="text/javascript" src="http://www.zhongyoo.com/img/js/tongji.js"></script></div>
<script type="text/javascript" id='speedup_test' src="https://idm-su.baidu.com/su.js"></script>
</body>
</html>

需要获取"<a href="", """, "<option value='", "'>"之间网址信息:

<!DOCTYPE html PUBLIC 
-//W3C//DTD XHTML 1.0 Transitional//EN
 
http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd
>
<html xmlns=
http://www.w3.org/1999/xhtml
>
<head>
<meta http-equiv=
Content-Type
 content=
text/html; charset=GB2312
>
<title>中药材名称大全 - 中药查询</title>
<meta name=
Keywords
 content=
中药材,药材,中药名,中药名称,药材名称
 />
<meta name=
.........<div class=
new_zt_navi
>
http://www.zhongyoo.com/name/dengzhanxixin_1942.html
 title=
灯盏细辛
>灯盏细辛</a>|

http://www.zhongyoo.com/name/tujingpi_744.html
 title=
土荆皮
>土荆皮</a>|

http://www.zhongyoo.com/name/hailong_1763.html
 title=
海龙
>海龙</a>|

http://www.zhongyoo.com/name/langdu_3606.html
 title=
狼毒
>狼毒</a>|

http://www.zhongyoo.com/name/tufuling_90.html
 title=
土茯苓
>土茯苓</a>|

http://www.zhongyoo.com/name/anyeyou_4.html
 title=
桉叶油
>桉叶油</a>|

http://www.zhongyoo.com/name/dianqiecao_938.html
 title=
颠茄草
>颠茄草</a>|

http://www.zhongyoo.com/name/bailanhua_1284.html
 title=
白兰花
>白兰花</a>|

http://www.zhongyoo.com/name/muhudie_214.html
 title=
木蝴蝶
>木蝴蝶</a>|

http://www.zhongyoo.com/name/wumei_899.html
 title=
乌梅
>乌梅</a>|

http://www.zhongyoo.com/name/tianma_232.html
 title=
天麻
>天麻</a>|

http://www.zhongyoo.com/name/chixiaodou_31.html
 title=
赤小豆
>赤小豆</a>|

http://www.zhongyoo.com/name/yuzhouloulu_722.html
 title=
禹州漏芦
>禹州漏芦</a>|

http://www.zhongyoo.com/name/mingdangcan_915.html
 title=
明党参
>明党参</a>|

http://www.zhongyoo.com/name/mujinpi_5961.html
 title=
木槿皮
>木槿皮</a>|

http://www.zhongyoo.com/name/meiguihua_1125.html
 title=
玫瑰花
>玫瑰花</a>|

http://www.zhongyoo.com/name/chunpi_668.html
 title=
椿皮
>椿皮</a>|

http://www.zhongyoo.com/name/chansu_1856.html
 title=
蟾酥
>蟾酥</a>|

http://www.zhongyoo.com/name/anxixiang_147.html
 title=
安息香
>安息香</a>|

/name/rencan_797.html
 title=
人参
>人参</a></div>
.........>加入收藏</a> | 
http://www.zhongyoo.com/adpage.html
 rel=
nofollow
>广告合作</a><br>
Copyright &#169; 2016　www.zhongyoo.com All Rights Reserved.　中药查询 京ICP备13004469号-1 <script language=
javascript
 type=
text/javascript
 src=
http://www.zhongyoo.com/img/js/tongji.js
></script></div>
<script type=
text/javascript
 id='speedup_test' src=
https://idm-su.baidu.com/su.js
></script>
</body>
</html>

保留包含"http:", "page_"字符串的信息:

http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd
http://www.w3.org/1999/xhtml
http://www.zhongyoo.com/img/css/39base.css
http://www.zhongyoo.com/img/css/jbk_nav12_2.css
http://www.zhongyoo.com/img/css/jbk_style.css
http://www.zhongyoo.com/img/css/index.css
http://www.zhongyoo.com/img/js/toptongji.js
http://www.zhongyoo.com/
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/fangji/
http://www.zhongyoo.com/pianfang/
http://www.zhongyoo.com/tupian/
http://www.zhongyoo.com/yangsheng/
http://www.zhongyoo.com/jianding/
http://www.zhongyoo.com/tiquwu/
http://www.zhongyoo.com/zhongchengyao/
http://www.zhongyoo.com/paozhi/
http://www.zhongyoo.com/chuanshuo/
http://www.zhongyoo.com/xw/
http://www.zhongyoo.com/yaoshan/
http://www.zhongyoo.com/zhongzhi/
http://www.zhongyoo.com/wenda/
http://www.zhongyoo.com/yaojiu/
http://www.zhongyoo.com/name/dengzhanxixin_1942.html
http://www.zhongyoo.com/name/tujingpi_744.html
http://www.zhongyoo.com/name/hailong_1763.html
http://www.zhongyoo.com/name/langdu_3606.html
http://www.zhongyoo.com/name/tufuling_90.html
http://www.zhongyoo.com/name/anyeyou_4.html
http://www.zhongyoo.com/name/dianqiecao_938.html
http://www.zhongyoo.com/name/bailanhua_1284.html
http://www.zhongyoo.com/name/muhudie_214.html
http://www.zhongyoo.com/name/wumei_899.html
http://www.zhongyoo.com/name/tianma_232.html
http://www.zhongyoo.com/name/chixiaodou_31.html
http://www.zhongyoo.com/name/yuzhouloulu_722.html
http://www.zhongyoo.com/name/mingdangcan_915.html
http://www.zhongyoo.com/name/mujinpi_5961.html
http://www.zhongyoo.com/name/meiguihua_1125.html
http://www.zhongyoo.com/name/chunpi_668.html
http://www.zhongyoo.com/name/chansu_1856.html
http://www.zhongyoo.com/name/anxixiang_147.html
http://www.zhongyoo.com/
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/fangji/
http://www.zhongyoo.com/pianfang/
http://www.zhongyoo.com/tupian/
http://www.zhongyoo.com/jianding/
http://www.zhongyoo.com/yangsheng/
http://www.zhongyoo.com/zhongchengyao/
http://www.zhongyoo.com/xw/
http://www.zhongyoo.com/paozhi/
http://www.zhongyoo.com/zhongzhi/
http://www.zhongyoo.com/meirong/
http://www.zhongyoo.com/chuanshuo/
http://www.zhongyoo.com/yaojiu/
http://www.zhongyoo.com/pianfang/yangwei/
http://www.zhongyoo.com/shuji/
http://www.zhongyoo.com/gx/
http://www.zhongyoo.com/guijing/
http://www.zhongyoo.com/pinyin/
http://www.zhongyoo.com/yx/
http://www.zhongyoo.com/yw/
http://www.zhongyoo.com/bw/
http://www.zhongyoo.com/sousuo/
http://www.zhongyoo.com/gx/jiebiaoyao/
http://www.zhongyoo.com/gx/qingreyao/
http://www.zhongyoo.com/gx/qufengshiyao/
http://www.zhongyoo.com/gx/xiexiayao/
http://www.zhongyoo.com/gx/lishuishenshiyao/
http://www.zhongyoo.com/gx/zhixueyao/
http://www.zhongyoo.com/gx/huoxuehuayuyao/
http://www.zhongyoo.com/gx/huatanzhikepingchuanyao/
http://www.zhongyoo.com/gx/anshenyao/
http://www.zhongyoo.com/gx/pingganxifengyao/
http://www.zhongyoo.com/gx/buxuyao/
http://www.zhongyoo.com/gx/shouseyao/
http://www.zhongyoo.com/gx/yongtuyao/
http://www.zhongyoo.com/gx/shachongzhiyangyao/
http://www.zhongyoo.com/gx/badushengjiyao/
http://www.zhongyoo.com/gx/huashiyao/
http://www.zhongyoo.com/gx/quchongyao/
http://www.zhongyoo.com/gx/xiaoshiyao/
http://www.zhongyoo.com/gx/wenliyao/
http://www.zhongyoo.com/gx/kaiqiaoyao/
http://www.zhongyoo.com/gx/liqiyao/
]}};with(document)0[(getElementsByTagName('head')[0]||body).appendChild(createElement('script')).src='http://bdimg.share.baidu.com/static/api/js/share.js?v=89860593.js?cdnversion='+~(-new Date()/36e5)];</script></div></span></div>
.........
page_2.html
page_3.html
page_4.html
page_5.html
page_6.html
page_7.html
page_8.html
page_9.html
page_10.html
page_11.html
page_12.html
page_13.html
page_14.html
page_15.html
page_16.html
page_17.html
page_18.html
page_19.html
page_20.html
page_21.html
page_22.html
page_23.html
page_24.html
page_25.html
page_26.html
page_27.html
page_28.html
page_29.html
page_30.html
page_31.html
page_32.html
page_33.html
page_34.html
page_35.html
page_36.html
page_37.html
page_38.html
page_39.html
page_40.html
page_41.html
page_42.html

移出包含"img", "<a href=", "</option>", ".dtd", "www.w3.org"不需要的信息:

http://www.zhongyoo.com/
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/fangji/
http://www.zhongyoo.com/pianfang/
http://www.zhongyoo.com/tupian/
http://www.zhongyoo.com/yangsheng/
http://www.zhongyoo.com/jianding/
http://www.zhongyoo.com/tiquwu/
http://www.zhongyoo.com/zhongchengyao/
http://www.zhongyoo.com/paozhi/
http://www.zhongyoo.com/chuanshuo/
http://www.zhongyoo.com/xw/
http://www.zhongyoo.com/yaoshan/
http://www.zhongyoo.com/zhongzhi/
http://www.zhongyoo.com/wenda/
http://www.zhongyoo.com/yaojiu/
http://www.zhongyoo.com/name/dengzhanxixin_1942.html
http://www.zhongyoo.com/name/tujingpi_744.html
http://www.zhongyoo.com/name/hailong_1763.html
http://www.zhongyoo.com/name/langdu_3606.html
http://www.zhongyoo.com/name/tufuling_90.html
http://www.zhongyoo.com/name/anyeyou_4.html
http://www.zhongyoo.com/name/dianqiecao_938.html
http://www.zhongyoo.com/name/bailanhua_1284.html
http://www.zhongyoo.com/name/muhudie_214.html
http://www.zhongyoo.com/name/wumei_899.html
http://www.zhongyoo.com/name/tianma_232.html
http://www.zhongyoo.com/name/chixiaodou_31.html
http://www.zhongyoo.com/name/yuzhouloulu_722.html
http://www.zhongyoo.com/name/mingdangcan_915.html
http://www.zhongyoo.com/name/mujinpi_5961.html
http://www.zhongyoo.com/name/meiguihua_1125.html
http://www.zhongyoo.com/name/chunpi_668.html
http://www.zhongyoo.com/name/chansu_1856.html
http://www.zhongyoo.com/name/anxixiang_147.html
http://www.zhongyoo.com/
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/fangji/
http://www.zhongyoo.com/pianfang/
http://www.zhongyoo.com/tupian/
http://www.zhongyoo.com/jianding/
http://www.zhongyoo.com/yangsheng/
http://www.zhongyoo.com/zhongchengyao/
http://www.zhongyoo.com/xw/
http://www.zhongyoo.com/paozhi/
http://www.zhongyoo.com/zhongzhi/
http://www.zhongyoo.com/meirong/
http://www.zhongyoo.com/chuanshuo/
http://www.zhongyoo.com/yaojiu/
http://www.zhongyoo.com/pianfang/yangwei/
http://www.zhongyoo.com/shuji/
http://www.zhongyoo.com/gx/
http://www.zhongyoo.com/guijing/
http://www.zhongyoo.com/pinyin/
http://www.zhongyoo.com/yx/
http://www.zhongyoo.com/yw/
http://www.zhongyoo.com/bw/
http://www.zhongyoo.com/sousuo/
http://www.zhongyoo.com/gx/jiebiaoyao/
http://www.zhongyoo.com/gx/qingreyao/
http://www.zhongyoo.com/gx/qufengshiyao/
http://www.zhongyoo.com/gx/xiexiayao/
http://www.zhongyoo.com/gx/lishuishenshiyao/
http://www.zhongyoo.com/gx/zhixueyao/
http://www.zhongyoo.com/gx/huoxuehuayuyao/
http://www.zhongyoo.com/gx/huatanzhikepingchuanyao/
http://www.zhongyoo.com/gx/anshenyao/
http://www.zhongyoo.com/gx/pingganxifengyao/
http://www.zhongyoo.com/gx/buxuyao/
http://www.zhongyoo.com/gx/shouseyao/
http://www.zhongyoo.com/gx/yongtuyao/
http://www.zhongyoo.com/gx/shachongzhiyangyao/
http://www.zhongyoo.com/gx/badushengjiyao/
http://www.zhongyoo.com/gx/huashiyao/
http://www.zhongyoo.com/gx/quchongyao/
http://www.zhongyoo.com/gx/xiaoshiyao/
http://www.zhongyoo.com/gx/wenliyao/
http://www.zhongyoo.com/gx/kaiqiaoyao/
http://www.zhongyoo.com/gx/liqiyao/
http://www.zhongyoo.com/name/duzhong_182.html
http://www.zhongyoo.com/name/hongcan_12445.html
http://www.zhongyoo.com/name/shudihuang_3106.html
http://www.zhongyoo.com/name/binglang_26.html
http://www.zhongyoo.com/name/zhihuangchi_6352.html
http://www.zhongyoo.com/name/banxia_984.html
http://www.zhongyoo.com/name/zhigancao_3267.html
http://www.zhongyoo.com/name/tiannanxing_718.html
http://www.zhongyoo.com/name/zheshi_3493.html
http://www.zhongyoo.com/name/qingmengshi_2132.html
http://www.zhongyoo.com/name/cishi_1846.html
http://www.zhongyoo.com/name/huashi_3279.html
http://www.zhongyoo.com/name/hupo_1506.html
http://www.zhongyoo.com/name/liuhuang_1443.html
http://www.zhongyoo.com/name/xionghuang_1665.html
http://www.zhongyoo.com/name/yuyuliang_1452.html
http://www.zhongyoo.com/name/zhongrushi_2139.html
http://www.zhongyoo.com/name/luganshi_2138.html
http://www.zhongyoo.com/name/huaruishi_2136.html
http://www.zhongyoo.com/name/yangqishi_1470.html
http://www.zhongyoo.com/
http://www.zhongyoo.com/sitemap.html
http://www.zhongyoo.com/name/
http://www.zhongyoo.com/adpage.html
page_2.html
page_3.html
page_4.html
page_5.html
page_6.html
page_7.html
page_8.html
page_9.html
page_10.html
page_11.html
page_12.html
page_13.html
page_14.html
page_15.html
page_16.html
page_17.html
page_18.html
page_19.html
page_20.html
page_21.html
page_22.html
page_23.html
page_24.html
page_25.html
page_26.html
page_27.html
page_28.html
page_29.html
page_30.html
page_31.html
page_32.html
page_33.html
page_34.html
page_35.html
page_36.html
page_37.html
page_38.html
page_39.html
page_40.html
page_41.html
page_42.html

之上已经获得了想要的链接信息,1.分割数据;2.保留数据;3.移出数据;分三步完成,且三步都使用字符串,字符串直接从该文件中复制获取任意需要的数量,这样的方法,比正则表达式更大众化和灵活.

实现代码中应用了固定数组连接函数:

        string[] 获取网址集合(string 数据, string[] 多字符分割, string[] 移出筛选, string[] 保留筛选)
        {
            string[] 保留集合 = new string[] {  };
            
            foreach (string 选 in 保留筛选) 保留集合 = 保留集合.Concat(数据.Split(多字符分割, StringSplitOptions.RemoveEmptyEntries).Where(值 => 值.Contains(选))).ToArray();
            
            foreach (string 选 in 移出筛选) 保留集合 = 保留集合.Where(值 => !值.Contains(选)).ToArray();
            
            return 保留集合.Distinct().ToArray();
        }

智者知已应修善业

关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
0
评论
获取网页链接,比正则表达式更灵活更大众化.

今天终于写好了不用正则表达式获取网页内需要的链接信息,比正则表达式更灵活,更大众化,通常正则表达式是写死的,正则表达式也不为普通使用者所熟知和使用,而我设计完成的方法,采用普通字符串,可以任意添加,灵活性强,且为大众所熟知.下面用实例说明,下面是获取网址文件:&lt;!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"...
复制链接

扫一扫