根据Url地址得到网页的html源码,截取网站信息的核心程序

27 篇文章 0 订阅

  /// <summary>
        /// 根据Url地址得到网页的html源码
        /// </summary>
        /// <param name="Url">URL地址</param>
        /// <returns></returns>
        public static string GetWebContent(string Url)
        {
            string strResult = "";
            try
            {
                HttpWebRequest request = (HttpWebRequest)WebRequest.Create(Url);
                //声明一个HttpWebRequest请求
                request.Timeout = 30000;
                //设置连接超时时间
                request.Headers.Set("Pragma", "no-cache");
                HttpWebResponse response = (HttpWebResponse)request.GetResponse();
                Stream streamReceive = response.GetResponseStream();
                Encoding encoding = Encoding.GetEncoding("GB2312");
                StreamReader streamReader = new StreamReader(streamReceive, encoding);
                strResult = streamReader.ReadToEnd();
            }
            catch
            {
                ;
            }
            return strResult;
        }

        /// <summary>
        /// 获取页面内容
        /// </summary>
        /// <param name="url">URL地址</param>
        /// <param name="temp1">内容开始段</param>
        /// <param name="temp2">内容结束段</param>
        /// <returns></returns>
        public static string gethtml(string url, string temp1, string temp2)
        {
            string temp = null;
            try
            {
                //获取内容

                string strWebContent = GetWebContent(url);

                strWebContent = strWebContent.Replace("&lt;", "<");
                strWebContent = strWebContent.Replace("&gt;", ">");

                //取出和数据有关的那段源码
                int startstr, stopstr;
                startstr = strWebContent.IndexOf(temp1, 0, strWebContent.Length) + temp1.Length;
                stopstr = strWebContent.IndexOf(temp2, startstr);
                temp = strWebContent.Substring(startstr, stopstr - startstr);
            }
            catch
            {
            }
            return temp;
        }

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值