C#彻底解决Web Browser 跨域读取Iframes内容

 

用C# winform的控件web browser 读取网页内容,分析一下数据,做一些采集工作。

如果是同一个域名下面还是好办的,基本上用HtmlAgilityPack就完全可以解决问题。

但是现在遇到跨域问题,比如我需要打开页面上存在的广告联盟的地址,进行保存。

这就是牵扯到跨域。

一般的错误是:拒绝访问。

"Access is denied. (Exception from HRESULT: 0x80070005 (E_ACCESSDENIED))"。

因为你没有在这个网站去修改另一个网站数据的权利。

怎么办?很困恼吧。现在就告诉大家一个好办法。

直接上代码了。

工具类,大家保存成一个类。需要引用mshtml

image

using System;

using System.Runtime.InteropServices;

using System.Windows.Forms;

using mshtml;

namespace WebBrowserTest

{

    // This is the COM IServiceProvider interface, not System.IServiceProvider .Net interface!

    [ComImport(), ComVisible(true), Guid("6D5140C1-7436-11CE-8034-00AA006009FA"),

    InterfaceTypeAttribute(ComInterfaceType.InterfaceIsIUnknown)]

    public interface IServiceProvider

    {

        [return: MarshalAs(UnmanagedType.I4)]

        [PreserveSig]

        int QueryService(ref Guid guidService, ref Guid riid, [MarshalAs(UnmanagedType.Interface)] out object ppvObject);

    }

    public enum OLECMDF

    {

        OLECMDF_DEFHIDEONCTXTMENU = 0x20,

        OLECMDF_ENABLED = 2,

        OLECMDF_INVISIBLE = 0x10,

        OLECMDF_LATCHED = 4,

        OLECMDF_NINCHED = 8,

        OLECMDF_SUPPORTED = 1

    }

    public enum OLECMDID

    {

        OLECMDID_PAGESETUP = 8,

        OLECMDID_PRINT = 6,

        OLECMDID_PRINTPREVIEW = 7,

        OLECMDID_PROPERTIES = 10,

        OLECMDID_SAVEAS = 4

    }

    public enum OLECMDEXECOPT

    {

        OLECMDEXECOPT_DODEFAULT,

        OLECMDEXECOPT_PROMPTUSER,

        OLECMDEXECOPT_DONTPROMPTUSER,

        OLECMDEXECOPT_SHOWHELP

    }

    [ComImport, Guid("D30C1661-CDAF-11d0-8A3E-00C04FC9E26E"), TypeLibType(TypeLibTypeFlags.FOleAutomation | TypeLibTypeFlags.FDual | TypeLibTypeFlags.FHidden)]

    public interface IWebBrowser2

    {

        [DispId(100)]

        void GoBack();

        [DispId(0x65)]

        void GoForward();

        [DispId(0x66)]

        void GoHome();

        [DispId(0x67)]

        void GoSearch();

        [DispId(0x68)]

        void Navigate([In] string Url, [In] ref object flags, [In] ref object targetFrameName, [In] ref object postData, [In] ref object headers);

        [DispId(-550)]

        void Refresh();

        [DispId(0x69)]

        void Refresh2([In] ref object level);

        [DispId(0x6a)]

        void Stop();

        [DispId(200)]

        object Application { [return: MarshalAs(UnmanagedType.IDispatch)] get; }

        [DispId(0xc9)]

        object Parent { [return: MarshalAs(UnmanagedType.IDispatch)] get; }

        [DispId(0xca)]

        object Container { [return: MarshalAs(UnmanagedType.IDispatch)] get; }

        [DispId(0xcb)]

        object Document { [return: MarshalAs(UnmanagedType.IDispatch)] get; }

        [DispId(0xcc)]

        bool TopLevelContainer { get; }

        [DispId(0xcd)]

        string Type { get; }

        [DispId(0xce)]

        int Left { get; set; }

        [DispId(0xcf)]

        int Top { get; set; }

        [DispId(0xd0)]

        int Width { get; set; }

        [DispId(0xd1)]

        int Height { get; set; }

        [DispId(210)]

        string LocationName { get; }

        [DispId(0xd3)]

        string LocationURL { get; }

        [DispId(0xd4)]

        bool Busy { get; }

        [DispId(300)]

        void Quit();

        [DispId(0x12d)]

        void ClientToWindow(out int pcx, out int pcy);

        [DispId(0x12e)]

        void PutProperty([In] string property, [In] object vtValue);

        [DispId(0x12f)]

        object GetProperty([In] string property);

        [DispId(0)]

        string Name { get; }

        [DispId(-515)]

        int HWND { get; }

        [DispId(400)]

        string FullName { get; }

        [DispId(0x191)]

        string Path { get; }

        [DispId(0x192)]

        bool Visible { get; set; }

        [DispId(0x193)]

        bool StatusBar { get; set; }

        [DispId(0x194)]

        string StatusText { get; set; }

        [DispId(0x195)]

        int ToolBar { get; set; }

        [DispId(0x196)]

        bool MenuBar { get; set; }

        [DispId(0x197)]

        bool FullScreen { get; set; }

        [DispId(500)]

        void Navigate2([In] ref object URL, [In] ref object flags, [In] ref object targetFrameName, [In] ref object postData, [In] ref object headers);

        [DispId(0x1f5)]

        OLECMDF QueryStatusWB([In] OLECMDID cmdID);

        [DispId(0x1f6)]

        void ExecWB([In] OLECMDID cmdID, [In] OLECMDEXECOPT cmdexecopt, ref object pvaIn, IntPtr pvaOut);

        [DispId(0x1f7)]

        void ShowBrowserBar([In] ref object pvaClsid, [In] ref object pvarShow, [In] ref object pvarSize);

        [DispId(-525)]

        WebBrowserReadyState ReadyState { get; }

        [DispId(550)]

        bool Offline { get; set; }

        [DispId(0x227)]

        bool Silent { get; set; }

        [DispId(0x228)]

        bool RegisterAsBrowser { get; set; }

        [DispId(0x229)]

        bool RegisterAsDropTarget { get; set; }

        [DispId(0x22a)]

        bool TheaterMode { get; set; }

        [DispId(0x22b)]

        bool AddressBar { get; set; }

        [DispId(0x22c)]

        bool Resizable { get; set; }

    }

    class CorssDomainHelper

    {

        private static Guid IID_IWebBrowserApp = new Guid("0002DF05-0000-0000-C000-000000000046");

        private static Guid IID_IWebBrowser2 = new Guid("D30C1661-CDAF-11D0-8A3E-00C04FC9E26E");

        // Utility for IE cross domain access

        // Returns null in case of failure.

        public static IHTMLDocument3 GetDocumentFromWindow(IHTMLWindow2 htmlWindow)

        {

            if (htmlWindow == null)

            {

                return null;

            }

            // First try the usual way to get the document.

            try

            {

                IHTMLDocument2 doc = htmlWindow.document;

                return (IHTMLDocument3)doc;

            }

            catch (COMException comEx)

            {

                // I think COMException won't be ever fired but just to be sure ...

            }

            catch (UnauthorizedAccessException)

            {

            }

            catch (Exception ex)

            {

                return null;

            }

            // At this point the error was E_ACCESSDENIED because the frame contains a document from another domain.

            // IE tries to prevent a cross frame scripting security issue.

            try

            {

                // Convert IHTMLWindow2 to IWebBrowser2 using IServiceProvider.

                IServiceProvider sp = (IServiceProvider)htmlWindow;

                // Use IServiceProvider.QueryService to get IWebBrowser2 object.

                Object brws = null;

                sp.QueryService(ref IID_IWebBrowserApp, ref IID_IWebBrowser2, out brws);

                // Get the document from IWebBrowser2.

                IWebBrowser2 browser = (IWebBrowser2)(brws);

                return (IHTMLDocument3)browser.Document;

            }

            catch (Exception ex)

            {

                Console.WriteLine(ex);

            }

            return null;

        }

    }

}

使用的时候方法是这样的:

    HTMLDocument doc = (HTMLDocument)Browser.Document.DomDocument;

               

                for (int i = 0; i < Browser.Document.Window.Frames.Count; i++)

                {                   

                        IHTMLDocument3 baiduDoc = CorssDomainHelper.GetDocumentFromWindow(Browser.Document.Window.Frames[i].DomWindow

                            as IHTMLWindow2);

                        if (baiduDoc!=null && baiduDoc.documentElement!=null && baiduDoc.documentElement.document != null)

                        {

                        IHTMLElementCollection linkss = ((HTMLDocument)(baiduDoc.documentElement.document)).links;

                        foreach (mshtml.IHTMLElement element in linkss)

                        {

                            //加入你的代码就可以了。

                        }

                }

测试完全可以解决webbrowser 跨域访问iframe的问题。

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
1、为ScriptManager添加脚本引用,不从ScriptResource.axd中加载MicrosoftAjax.js脚本,而是直接加载 <asp:ScriptManager ID="ScriptManager1" runat="server" EnablePageMethods="true"> <Scripts> <asp:ScriptReference Name="MicrosoftAjax.js" ScriptMode="auto" Path="~/ScriptLibrary/System.Web.Extensions/1.0.61025.0/MicrosoftAjax.js" /> </Scripts> </asp:ScriptManager> 2、修改MicrosoftAjax.debug.js 删除 switch(Sys.Browser.agent) { case Sys.Browser.InternetExplorer:与 case Sys.Browser.Safari: 之间的脚本,替换为如下脚本: Sys.UI.DomElement.getLocation = function(element) { if (element.self || element.nodeType === 9) return new Sys.UI.Point(0,0); var clientRect = element.getBoundingClientRect(); if (!clientRect) { return new Sys.UI.Point(0,0); } var ownerDocument = element.document.documentElement; var offsetX = clientRect.left - 2 + ownerDocument.scrollLeft, offsetY = clientRect.top - 2 + ownerDocument.scrollTop; try { var f = element.ownerDocument.parentWindow.frameElement || null; if (f) { var offset = 2 - (f.frameBorder || 1) * 2; offsetX += offset; offsetY += offset; } } catch(ex) { } return new Sys.UI.Point(offsetX, offsetY); } break; 3、修改MicrosoftAjax.js 删除 switch(Sys.Browser.agent){case Sys.Browser.InternetExplorer:与 case Sys.Browser.Safari: 之间的脚本,替换为如下脚本: Sys.UI.DomElement.getLocation=function(a){if(a.self||a.nodeType===9)return new Sys.UI.Point(0,0);var b=a.getBoundingClientRect();if(!b)return new Sys.UI.Point(0,0);var c=a.document.documentElement,d=b.left-2+c.scrollLeft,e=b.top-2+c.scrollTop;try{var g=a.ownerDocument.parentWindow.frameElement||null;if(g){var f=2-(g.frameBorder||1)*2;d+=f;e+=f}}catch(h){}return new Sys.UI.Point(d,e)};break;
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值