.net如何获取网页内容

最新推荐文章于 2023-05-05 15:04:53 发布

love__coder

最新推荐文章于 2023-05-05 15:04:53 发布

阅读量3.4k

点赞数

CC 4.0 BY-SA版权

分类专栏： .Net C# 文章标签： .net encoding string null stream url

本文链接：https://blog.csdn.net/love__coder/article/details/6589556

C# 同时被 2 个专栏收录

30 篇文章

订阅专栏

.Net

17 篇文章

订阅专栏

.net中如何获取网页内容，下面给出C#版本的函数，关键代码如下：

1、引入namespace

using System.Net;
using System.IO;
using System.Text;

2、函数代码：

        /// <summary>
        /// 返回URL内容,带POST数据提交
        /// </summary>
        /// <param name="url"></param>
        /// <param name="data"></param>
        /// <param name="method">GET/POST(默认)</param>
        /// <param name="dataEncoding">编码方式(默认utf-8)</param>
        /// <param name="timeout">超时时间（以毫秒为单位）</param>
        /// <returns></returns>
        public static string HttpRequest(string url, string data, string method, string dataEncoding, int timeout)
        {
            string res = string.Empty;
            if (string.IsNullOrEmpty(dataEncoding)) dataEncoding = "utf-8";
            Encoding encoding = Encoding.GetEncoding(dataEncoding);

            //请求
            WebRequest webRequest = null;
            Stream postStream = null;

            //响应
            WebResponse webResponse = null;
            StreamReader streamReader = null;

            try
            {
                if (method == "GET")
                {
                    url = url + '?' + data;
                }
                //请求
                webRequest = WebRequest.Create(url);
                webRequest.Method = string.IsNullOrEmpty(method) ? "POST" : method;
                webRequest.Timeout = timeout;

                if (method == "POST")
                {
                    byte[] postData = encoding.GetBytes(data);
                    webRequest.ContentLength = postData.Length;
                    postStream = webRequest.GetRequestStream();
                    postStream.Write(postData, 0, postData.Length);
                }
                //响应
                webResponse = webRequest.GetResponse();
                streamReader = new StreamReader(webResponse.GetResponseStream(), encoding);
                res = streamReader.ReadToEnd();
            }
            catch (WebException ex)
            {
                using (HttpWebResponse response = (HttpWebResponse)ex.Response)
                {
                    using (Stream responseStream = response.GetResponseStream())
                    {
                        res = new StreamReader(responseStream).ReadToEnd();
                    }
                }
            }
            catch (Exception)
            {
            }
            finally
            {
                if (postStream != null)
                {
                    postStream.Close();
                }
                if (streamReader != null)
                {
                    streamReader.Close();
                }
                if (webResponse != null)
                {
                    webResponse.Close();
                }
            }
            return res;
        }

3、调用示例：