WebClient Utility

最新推荐文章于 2024-03-26 15:00:24 发布

yimeng_1985

最新推荐文章于 2024-03-26 15:00:24 发布

阅读量774

点赞数

分类专栏：工作备忘

本文链接：https://blog.csdn.net/yimeng_1985/article/details/8752621

版权

本文详细介绍了在Spring框架中如何有效地使用WebClient进行HTTP请求，包括构建请求、设置超时、处理响应以及错误处理等关键操作。通过实例代码演示了WebClient的灵活性和强大功能，适合希望提升WebClient使用技巧的开发者阅读。

摘要由CSDN通过智能技术生成

using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using System.Net;
using HtmlAgilityPack;
using System.Text.RegularExpressions;
using System.IO;

namespace Transport
{
    /// <summary>
    /// Operations for web page,like getting page source, downloading files
    /// </summary>
    public class WebClientUtil
    {
        /// <summary>
        /// Get page source and then load the page soure as Html document 
        /// </summary>
        /// <param name="uri">Website url</param>
        /// <param name="timeout">Timeout waiting for a response from server, in seconds.</param>
        /// <returns>HtmlDocument</returns>
        public static HtmlDocument GetHtmlDocument(string uri, int timeout)
        {
            HtmlDocument doc = new HtmlDocument();
            doc.LoadHtml(GetPageSource(uri, timeout));
            return doc;
        }


        /// <summary>
        /// Get page source and then load the page soure as Html document 
        /// </summary>
        /// <param name="uri">Website url</param>
        /// <param name="timeout">Timeout waiting for a response from server, in seconds.</param>
        /// <param name="postData">post data </param>
        /// <returns>HtmlDocument</returns>
        public static HtmlDocument GetHtmlDocument(string uri, int timeout, string postData)
        {
            HtmlDocument doc = new HtmlDocument();
            String pageSource = GetDynamicPageSource(uri, timeout, postData);
            if (!String.IsNullOrEmpty(pageSource))
                doc.LoadHtml(pageSource);
            else
                return null;
            return doc;
        }

        /// <summary>
        /// Get page source and then load the page soure as Html document 
        /// </summary>
        /// <param name="uri">Website url</param>
        /// <param name="timeout">Timeout waiting for a response from server, in seconds.</param>
        /// <param name="postData">post data </param>
        /// <param name="encoding">If can't get encoding type from page source, will use this encoding to encode the page source.</param>
        /// <returns>HtmlDocumnet</returns>
        public static HtmlDocument GetHtmlDocument(string uri, int timeout, string postData, Encoding encoding)
        {
            HtmlDocument doc = new HtmlDocument();
            String pageSource = GetPageSource(null, uri, timeout, postData, encoding);
            if (!String.IsNullOrEmpty(pageSource))
                doc.LoadHtml(pageSource);
            else
                return null;
            return doc;
        }

        public static void DownloadFile(string uri, int timeout, string targetFilePath)
        {
            DownloadFile(null