HtmlAgilityPack使用

 

http://stackoverflow.com/questions/5876825/htmlagilitypack-and-timeouts-on-load

http://stackoverflow.com/questions/12468497/how-can-i-add-a-webrequest-to-set-timeout-when-loading-a-url-to-document-in-html

stackoverflow是个好网站，什么问题都能搜，多多利用

针对加载超时、网页编码问题，总结以上三个网址，可以先用 HttpWebRequest 获取一遍，设置相关属性，然后再加载操作

String Data = GetURLData(url); HtmlAgilityPack.HtmlDocument doc = new HtmlAgilityPack.HtmlDocument(); doc.LoadHtml(Data); public static string GetURLData(string URL) { try { HttpWebRequest request = (HttpWebRequest)HttpWebRequest.Create(URL); request.UserAgent = "Omurcek"; request.Timeout = 4000; WebResponse response = request.GetResponse(); Stream stream = response.GetResponseStream(); StreamReader reader = new StreamReader(stream); return reader.ReadToEnd(); } catch (Exception ex ) { LogYaz("Receive DATA Error : " + URL + ex.ToString()); return ""; } }