豆瓣电影排行榜爬虫

最新推荐文章于 2023-11-01 22:40:55 发布
最新推荐文章于 2023-11-01 22:40:55 发布
阅读量4.1k 收藏
点赞数
分类专栏： .NET Winform/WPF 爬虫 文章标签： 排行榜 豆瓣 爬虫

Model层

DBModel.cs代码:

  public class DBModel
    {
        public int r { get; set; }
        public Res res { get; set; }
        public Status status { get; set; }
    }

    public class Res
    {
        public string TYPE { get; set; }
        public int comment_count { get; set; }
        public int id { get; set; }
        public int kind { get; set; }
        public string kind_cn { get; set; }
        public string kind_str { get; set; }
        public int page_id { get; set; }
        public Payload payload { get; set; }
        public int status { get; set; }
        public Subject subject { get; set; }
        public Subject1[] subjects { get; set; }
        public User user { get; set; }
    }

    public class Payload
    {
        public string background_color { get; set; }
        public string background_img { get; set; }
        public string description { get; set; }
        public string has_barrage { get; set; }
        public string left { get; set; }
        public string mobile_background_img { get; set; }
        public string subject_ids { get; set; }
        public string title { get; set; }
        public string user_id { get; set; }
    }

    public class Subject
    {
        public string cover { get; set; }
        public string[] directors { get; set; }
        public string id { get; set; }
        public bool is_released { get; set; }
        public string m_url { get; set; }
        public string orig_title { get; set; }
        public float rating { get; set; }
        public int rating_count { get; set; }
        public string title { get; set; }
        public string type { get; set; }
        public string url { get; set; }
    }

    public class User
    {
        public string avatar { get; set; }
        public string id { get; set; }
        public string name { get; set; }
        public string url { get; set; }
    }

    public class Subject1
    {
        public string cover { get; set; }
        public string id { get; set; }
        public bool is_released { get; set; }
        public string m_url { get; set; }
        public string orig_title { get; set; }
        public float rating { get; set; }
        public int rating_count { get; set; }
        public string title { get; set; }
        public string type { get; set; }
        public string url { get; set; }
    }

    public class Status
    {
        public int code { get; set; }
    }

IDModel类:

 public class IDModel
    {
        public string downURL { get; set; }
        public string headImg { get; set; }
        public string inforMessage { get; set; }
    }

ShowModel.cs类文件:

public class Rootobject
    {
        public int count { get; set; }
        public int start { get; set; }
        public int total { get; set; }
        public Subjects[] subjects { get; set; }
        public string title { get; set; }
    }

    public class Subjects
    {
        public Rating rating { get; set; }
        public string[] genres { get; set; }
        public string title { get; set; }
        public Cast[] casts { get; set; }
        public int collect_count { get; set; }
        public string original_title { get; set; }
        public string subtype { get; set; }
        public Director[] directors { get; set; }
        public string year { get; set; }
        public Images images { get; set; }
        public string alt { get; set; }
        public string id { get; set; }
    }

    public class Rating
    {
        public int max { get; set; }
        public float average { get; set; }
        public string stars { get; set; }
        public int min { get; set; }
    }

    public class Images
    {
        public string small { get; set; }
        public string large { get; set; }
        public string medium { get; set; }
    }

    public class Cast
    {
        public string alt { get; set; }
        public Avatars avatars { get; set; }
        public string name { get; set; }
        public string id { get; set; }
    }

    public class Avatars
    {
        public string small { get; set; }
        public string large { get; set; }
        public string medium { get; set; }
    }

    public class Director
    {
        public string alt { get; set; }
        public Avatars1 avatars { get; set; }
        public string name { get; set; }
        public string id { get; set; }
    }

    public class Avatars1
    {
        public string small { get; set; }
        public string large { get; set; }
        public string medium { get; set; }
    }

Utility文件夹:

DBInfo.cs代码:

  public class DBInfo
    {
        private static readonly Cache cache = HttpRuntime.Cache;

        /// <summary>
        ///     2016评分最高电影
        /// </summary>
        /// <returns></returns>
        public static DBModel GetMovieInforListByCache(string key, int i)
        {
            if (cache[key] != null)
            {
                return cache[key] as DBModel;
            }
            DBModel model = GetMovieInfor("https://movie.douban.com/ithil_j/activity/movie_annual2016/widget/" + i);
            if (model == null)
                return null;
            cache.Insert(key, model, null, DateTime.Now.AddDays(1), TimeSpan.Zero);
            ;
            return model;
        }

        public static DBModel GetMovieInfor(string url)
        {
            DBModel model = null;
            string html = HtmlHelper.LoadPageContent(url);
            if (!string.IsNullOrEmpty(html))
            {
                var Serializer = new JavaScriptSerializer();
                model = Serializer.Deserialize<DBModel>(html);
            }
            return model;
        }
    }

HtmlHelper.cs代码:

 public class HtmlHelper
    {
        //豆瓣
        public static string DBYear = ConfigurationManager.AppSettings["DBYear"];
        public static string DBOrder = ConfigurationManager.AppSettings["DBOrder"];
        public static string Showing = ConfigurationManager.AppSettings["Showing"];
        public static string Coming = ConfigurationManager.AppSettings["Coming"];
        public static string Top = ConfigurationManager.AppSettings["Top"];
        //id97
        public static string idSeach = ConfigurationManager.AppSettings["idSeach"];
        public static string downloadUrl = ConfigurationManager.AppSettings["DownloadUrl"];
        //五杀
        public static string wsSearchUrl = ConfigurationManager.AppSettings["wsSearch"];
        public static string wsDownloadUrl = ConfigurationManager.AppSettings["wsDownloadUrl"];

        public static string DownloadHtml(string url)
        {
            return DownloadHtml(url, Encoding.UTF8);
        }

        public static string DyDownloadHtml(string url)
        {
            return DownloadHtml(url, Encoding.Default);
        }

        /// <summary>
        ///     下载html
        /// </summary>
        /// <param name="url">下载路径</param>
        /// <param name="encode">编码</param>
        /// <returns></returns>
        public static string DownloadHtml(string url, Encoding encoding)
        {
            string html = String.Empty;
            try
            {
                var request = WebRequest.Create(url) as HttpWebRequest; //模拟请求
                request.Timeout = 60*1000; //设置60s的超时
                request.ContentType = "text/html; charset=utf-8";
                //发起请求
                using (var response = request.GetResponse() as HttpWebResponse)
                {
                    if (response.StatusCode == HttpStatusCode.OK)
                    {
                        try
                        {
                            var sr = new StreamReader(response.GetResponseStream(), encoding);
                            html = sr.ReadToEnd(); //读取数据
                            sr.Close();
                        }
                        catch (Exception ex)
                        {
                            html = null;
                        }
                    }
                }
            }
            catch (Exception ex)
            {
                html = null;
            }
            return html;
        }

        /// <summary>
        ///     从指定的URL下载页面内容(使用WebClient)
        /// </summary>
        /// <param name="url"></param>
        /// <returns></returns>
        public static string LoadPageContent(string url)
        {
            var wc = new WebClient();
            wc.Credentials = CredentialCache.DefaultCredentials;
            byte[] pageData = wc.DownloadData(url);
            return (Encoding.GetEncoding("utf-8").GetString(pageData));
        }
    }

ID97Crewl.cs：

    public class ID97Crewl
    {
        public static IDModel GetMovieInforMode(string movieName)
        {
            IDModel model = null;
            //搜索页提取
            string html = HtmlHelper.DownloadHtml(HtmlHelper.idSeach + movieName);
            if (!string.IsNullOrEmpty(html))
            {
                model = new IDModel();
                var doc = new HtmlDocument();
                doc.LoadHtml(html); ///html/body/div[7]/div[1]/div/div[1]/a/img
                string xPath = "/html/body/div/div[1]/div/div[1]/a";
                HtmlNode node = doc.DocumentNode.SelectSingleNode(xPath);
                if (node != null)
                {
                    string movieUrl = node.Attributes["href"].Value;
                    string movieId = movieUrl.Substring(movieUrl.LastIndexOf('/') + 1).Replace(".html", "");
                        //获取电影编号18094
                    string resquestUrl = HtmlHelper.downloadUrl + movieId;
                    string inforHtml = HtmlHelper.DownloadHtml(resquestUrl);
                    if (inforHtml != null)
                    {
                        var inforDoc = new HtmlDocument();
                        inforDoc.LoadHtml(inforHtml); //  //*[@id="normalDown"]/div/table
                        string downPath = "//*[@id='normalDown']/div/table";
                        HtmlNode downNode = inforDoc.DocumentNode.SelectSingleNode(downPath);
                        if (downNode != null)
                        {
                            var thirdDoc = new HtmlDocument();
                            thirdDoc.LoadHtml(downNode.InnerHtml);
                            string aPath = "//a";
                            HtmlNodeCollection aNode = thirdDoc.DocumentNode.SelectNodes(aPath);
                            string downInfor = String.Empty;
                            if (aNode != null)
                            {
                                foreach (HtmlNode nodes in aNode)
                                {
                                    if (nodes.Attributes["href"].Value.IndexOf("http://pan.baidu.com/") >= 0 ||
                                        nodes.Attributes["href"].Value.IndexOf("https://pan.baidu.com/s/") >= 0)
                                    {
                                        downInfor += nodes.Attributes["title"].Value + "\n百度云盘地址：" +
                                                     nodes.Attributes["href"].Value + "\n";
                                    }
                                    else if (nodes.Attributes["href"].Value.IndexOf("ed2k://|file") >= 0)
                                    {
                                        downInfor += "电驴：" + nodes.Attributes["href"].Value + "\n";
                                    }
                                    else if (nodes.Attributes["href"].Value.IndexOf("magnet:?xt=urn:") >= 0)
                                    {
                                        downInfor += "磁力：" + nodes.Attributes["href"].Value + "\n";
                                    }
                                }
                            }
                            model.downURL = downInfor;
                        }
                    }
                } //html/body/div[7]/div[1]/div/div[1]/a/img
                string imgPath = "/html/body/div/div[1]/div/div[1]/a/img";
                HtmlNode imgNode = doc.DocumentNode.SelectSingleNode(imgPath);
                if (imgNode != null)
                {
                    model.headImg = imgNode.Attributes["src"].Value;
                }
                string infoPath = "/html/body/div/div[1]/div/div[2]/div/p[2]";
                HtmlNode infoNode = doc.DocumentNode.SelectSingleNode(infoPath);
                if (infoNode != null)
                {
                    model.inforMessage = infoNode.InnerText;
                }
                else
                {
                    infoPath = "/html/body/div[7]/div[1]/div/div[2]/div/p[2]";
                    infoNode = doc.DocumentNode.SelectSingleNode(infoPath);
                    if (infoNode != null)
                    {
                        model.inforMessage = infoNode.InnerText;
                    }
                }
            }
            return model;
        }
    }

ShowimgCrewl.cs:

   public class ShowimgCrewl
    {
        private static readonly Cache cache = HttpRuntime.Cache;

        /// <summary>
        ///     正在上映
        /// </summary>
        /// <returns></returns>
        public static Rootobject GetShowingMovieInforListByCache()
        {
            string key = "SHOWING_LIST";
            if (cache[key] != null)
            {
                return cache[key] as Rootobject;
            }
            Rootobject model = GetMovieInfor(HtmlHelper.Showing);
            if (model == null)
                return null;
            cache.Insert(key, model, null, DateTime.Now.AddDays(1), TimeSpan.Zero);
            ;
            return model;
        }

        /// <summary>
        ///     即将上映
        /// </summary>
        /// <returns></returns>
        public static Rootobject GetComingMovieInforListByCache()
        {
            string key = "COMING_LIST";
            if (cache[key] != null)
            {
                return cache[key] as Rootobject;
            }
            Rootobject model = GetMovieInfor(HtmlHelper.Coming);
            if (model == null)
                return null;
            cache.Insert(key, model, null, DateTime.Now.AddDays(1), TimeSpan.Zero);
            ;
            return model;
        }

        /// <summary>
        ///     Top250
        /// </summary>
        /// <returns></returns>
        public static Rootobject GetTopMovieInforListByCache()
        {
            string key = "TOP_LIST";
            if (cache[key] != null)
            {
                return cache[key] as Rootobject;
            }
            Rootobject model = GetMovieInfor(HtmlHelper.Top);
            if (model == null)
                return null;
            cache.Insert(key, model, null, DateTime.Now.AddDays(1), TimeSpan.Zero);
            ;
            return model;
        }

        public static Rootobject GetMovieInfor(string url)
        {
            Rootobject model = null;
            string html = HtmlHelper.LoadPageContent(url);
            if (!string.IsNullOrEmpty(html))
            {
                var Serializer = new JavaScriptSerializer();
                model = Serializer.Deserialize<Rootobject>(html);
            }
            return model;
        }
    }

WXCrewl.cs代码:

 public class WXCrewl
    {
        public static IDModel GetMovieInfor(string movieName)
        {
            IDModel model = null;
            string searchUrl = HtmlHelper.wsSearchUrl + movieName;
            string html = HtmlHelper.DownloadHtml(searchUrl);
            if (!string.IsNullOrEmpty(html))
            {
                var doc = new HtmlDocument();
                doc.LoadHtml(html);
                string wsMoviePath = "/html/body/div[3]/div[2]/ul/li[1]/a";
                HtmlNode htmlnode = doc.DocumentNode.SelectSingleNode(wsMoviePath);
                if (htmlnode != null)
                {
                    string apathUrl = htmlnode.Attributes["href"].Value;
                    string resourceUrl = HtmlHelper.wsDownloadUrl + apathUrl;
                    string resourceHtml = HtmlHelper.DownloadHtml(resourceUrl);
                    if (!string.IsNullOrEmpty(resourceHtml))
                    {
                        var resourceDoc = new HtmlDocument();
                        resourceDoc.LoadHtml(resourceHtml);
                        model = new IDModel();
                        //收看地址          //*[@id="jisuayun"]/div/ul/li[1]/a  //*[@id="wuxingyun"]/div/ul/li/a
                        string lookPath = "//*[@id='wuxingyun']/div/ul/li/a";
                        HtmlNode linkNode = resourceDoc.DocumentNode.SelectSingleNode(lookPath);
                        if (linkNode != null)
                        {
                            model.downURL = HtmlHelper.wsDownloadUrl + linkNode.Attributes["href"].Value;
                        }
                        else
                        {
                            lookPath = "//*[@id='jisuayun']/div/ul/li[1]/a";
                            linkNode = resourceDoc.DocumentNode.SelectSingleNode(lookPath);
                            if (linkNode != null)
                            {
                                model.downURL = HtmlHelper.wsDownloadUrl + linkNode.Attributes["href"].Value;
                            }
                            else
                            {
                                lookPath = "//*[@id='mgtv']/div/ul/li/a";
                                linkNode = resourceDoc.DocumentNode.SelectSingleNode(lookPath);
                                if (linkNode != null)
                                {
                                    model.downURL = HtmlHelper.wsDownloadUrl + linkNode.Attributes["href"].Value;
                                }
                            }
                        }
                        //图片地址
                        string imagePath = "/html/body/div[3]/div[3]/div[4]/div[1]/img";
                        HtmlNode imageNode = resourceDoc.DocumentNode.SelectSingleNode(imagePath);
                        if (imageNode != null)
                        {
                            if (imageNode.Attributes.Contains("data-original"))
                                model.headImg = imageNode.Attributes["data-original"].Value;
                            else if (imageNode.Attributes.Contains("original"))
                                model.headImg = imageNode.Attributes["original"].Value;
                            else if (imageNode.Attributes.Contains("src"))
                                model.headImg = imageNode.Attributes["src"].Value;
                        }
                        //简介
                        string inforPath = "/html/body/div[3]/div[3]/div[4]/div[2]/div[2]/dl[2]/dd/p";
                        HtmlNode inforNode = resourceDoc.DocumentNode.SelectSingleNode(inforPath);
                        if (inforNode != null)
                        {
                            model.inforMessage = "简介：" + inforNode.InnerHtml;
                        }
                    }
                }
            }
            return model;
        }
    }

App.config

<?xml version="1.0" encoding="utf-8"?>

<configuration>
  <startup>
    <supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.5" />
  </startup>
  <appSettings>
    <!--豆瓣评分-->
    <add key="DBOrder" value="https://movie.douban.com/annual2016/?source=navigation#15" />
    <add key="DBYear" value="https://movie.douban.com/ithil_j/activity/movie_annual2016" />
    <!--id97-->
    <add key="idSeach" value="http://www.181bt.com/search?q=" />
    <add key="DownloadUrl" value="http://www.181bt.com/videos/resList/" />
    <!--五杀电影抓取地址-->
    <add key="wsSearch" value="http://wap.lol5s.com/index.php?m=vod-search-wd-" />
    <add key="wsDownloadUrl" value="http://wap.lol5s.com" />
    <!--豆瓣接口-->
    <add key="Showing" value="https://api.douban.com/v2/movie/in_theaters" /> <!--正在上映-->
    <add key="Coming" value="https://api.douban.com/v2/movie/coming_soon" /><!--即将上映-->
    <add key="Top" value="https://api.douban.com/v2/movie/top250" />  <!--top250-->
  </appSettings>
</configuration>

Form1.cs代码:

using System;
using System.Diagnostics;
using System.Windows.Forms;
using CCWin;
using CCWin.SkinControl;

namespace MovieDemo
{
    public partial class Form1 : CCSkinMain 
    {
        //观看地址
        private static string gkUrl = string.Empty;

        public Form1()
        {
            InitializeComponent();
            cmb_type.SelectedIndex = 0;
            com_orderby.SelectedIndex = 0;
            pic_img.ImageLocation = "http://ojtdqq2ha.bkt.clouddn.com/16b0b3789293bd7ba4e280a228546ef3.jpg";
            pic_img.SizeMode = PictureBoxSizeMode.StretchImage; //是图片的大小适应控件PictureBox的大小  
        }

        /// <summary>
        ///  2016信息
        /// </summary>
        /// <param name="sender"></param>
        /// <param name="e"></param>
        private void cmb_type_SelectedIndexChanged(object sender, EventArgs e)
        {
            switch (cmb_type.SelectedIndex)
            {
                case 1:
                    GetMovieList("DBHY_LIST", 1);
                    break;
                case 2:
                    GetMovieList("DBWY_LIST", 2);
                    break;
                case 3:
                    GetMovieList("DBZSGZY_LIST", 4);
                    break;
                case 4:
                    GetMovieList("DBZSGZFY_LIST", 5);
                    break;
                case 5:
                    GetMovieList("DBDLDL_LIST", 7);
                    break;
                case 6:
                    GetMovieList("DBLMJP_LIST", 8);
                    break;
                case 7:
                    GetMovieList("DBHG_LIST", 10);
                    break;
                case 8:
                    GetMovieList("DBWRB_LIST", 11);
                    break;
                case 9:
                    GetMovieList("DBOZ_LIST", 12);
                    break;
                case 10:
                    GetMovieList("DBTXL_LIST", 13);
                    break;
                case 11:
                    GetMovieList("DBXJ_LIST", 15);
                    break;
                case 12:
                    GetMovieList("DBAQ_LIST", 16);
                    break;
                case 13:
                    GetMovieList("DBKH_LIST", 17);
                    break;
                case 14:
                    GetMovieList("DBKB_LIST", 18);
                    break;
                case 15:
                    GetMovieList("DBDH_LIST", 20);
                    break;
                case 16:
                    GetMovieList("DBJLP_LIST", 21);
                    break;
                case 17:
                    GetMovieList("DBDP_LIST", 22);
                    break;
                case 18:
                    GetMovieList("DBDLDSJ_LIST", 24);
                    break;
                case 19:
                    GetMovieList("DBYMJ_LIST", 25);
                    break;
                case 20:
                    GetMovieList("DBYMJF_LIST", 26);
                    break;
                case 21:
                    GetMovieList("DBHJ_LIST", 28);
                    break;
                case 22:
                    GetMovieList("DBRJ_LIST", 29);
                    break;
                case 23:
                    GetMovieList("DBQITJ_LIST", 30);
                    break;
                case 24:
                    GetMovieList("DBDHJJ_LIST", 34);
                    break;
                case 25:
                    GetMovieList("DBJLJJ_LIST", 35);
                    break;
                case 26:
                    GetMovieList("DB1YRM_LIST", 41);
                    break;
                case 27:
                    GetMovieList("DB2yrm_LIST", 42);
                    break;
                case 28:
                    GetMovieList("DB3YRM_LIST", 43);
                    break;
                case 29:
                    GetMovieList("DB4YRM_LIST", 45);
                    break;
                case 30:
                    GetMovieList("DB5YRM_LIST", 46);
                    break;
                case 31:
                    GetMovieList("DB6YRM_LIST", 47);
                    break;
                case 32:
                    GetMovieList("DB7YRM_LIST", 49);
                    break;
                case 33:
                    GetMovieList("DB8YRM_LIST", 50);
                    break;
                case 34:
                    GetMovieList("DB9YRM_LIST", 51);
                    break;
                case 35:
                    GetMovieList("DB10YRM_LIST", 53);
                    break;
                case 36:
                    GetMovieList("DB11YRM_LIST", 54);
                    break;
                case 37:
                    GetMovieList("DB12YRM_LIST", 55);
                    break;
                case 38:
                    GetMovieList("DB10ZN_LIST", 57);
                    break;
                case 39:
                    GetMovieList("DB20ZN_LIST", 58);
                    break;
                case 40:
                    GetMovieList("DB30ZN_LIST", 59);
                    break;
                case 41:
                    GetMovieList("DBqdhy_LIST", 68);
                    break;
                case 42:
                    GetMovieList("DBqdwy_LIST", 69);
                    break;
                case 43:
                    GetMovieList("DBbj_LIST", 70);
                    break;
                default:
                    break;
            }
        }

        private void GetMovieList(string key, int i)
        {
            DBModel model = DBInfo.GetMovieInforListByCache(key, i);
            if (model != null)
            {
                lisb_movie.Items.Clear();
                foreach (Subject1 item in model.res.subjects)
                {
                    SkinListBoxItem skinListBoxItem = new SkinListBoxItem();
                    skinListBoxItem.Text = item.title + "-" + item.rating + "分";
                    lisb_movie.Items.Add(skinListBoxItem);
                }
            }
        }

        private void lisb_movie_SelectedIndexChanged(object sender, EventArgs e)
        {
            //电影名
            string movieName = lisb_movie.SelectedItem.ToString().Split('-')[0];
            GetMovieInfo(movieName.TrimEnd('。'));
        }

        /// <summary>
        ///     查找电影
        /// </summary>
        /// <param name="movieName"></param>
        public void GetMovieInfo(string movieName)
        {
            txt_name.Text = movieName;
            rtb_xping.Text = "";
            pic_img.ImageLocation = "http://ojtdqq2ha.bkt.clouddn.com/16b0b3789293bd7ba4e280a228546ef3.jpg";
            gkUrl = "";
            btn_search.Enabled = false;
            //try
            //{
            IDModel movieInfo = ID97Crewl.GetMovieInforMode(movieName);
            IDModel wxMovie = WXCrewl.GetMovieInfor(movieName);
            if (movieInfo != null && movieInfo.downURL != null)
            {
                rtb_messagebox.Text = movieInfo.downURL;
                rtb_xping.Text = movieInfo.inforMessage;
                pic_img.ImageLocation = movieInfo.headImg;
                if (wxMovie != null && wxMovie.downURL != null)
                {
                    gkUrl = wxMovie.downURL;
                }
            }
            else
            {
                if (wxMovie != null && wxMovie.downURL != null)
                {
                    rtb_messagebox.Text = "无下载资源，点击在线观看！";
                    rtb_xping.Text = wxMovie.inforMessage;
                    pic_img.ImageLocation = wxMovie.headImg;
                    gkUrl = wxMovie.downURL;
                }
                else
                {
                    rtb_xping.Text = "";
                    pic_img.ImageLocation = "http://ojtdqq2ha.bkt.clouddn.com/16b0b3789293bd7ba4e280a228546ef3.jpg";
                    gkUrl = "";
                    rtb_messagebox.Text = "暂无资源！";
                }
            }
            //}
            //catch (Exception)
            //{ 
            //    throw;
            //}

            btn_search.Enabled = true;
        }

        /// <summary>
        ///     点击搜索
        /// </summary>
        /// <param name="sender"></param>
        /// <param name="e"></param>
        private void btn_search_Click(object sender, EventArgs e)
        {
            rtb_messagebox.Text = "";
            if (txt_name.Text.Trim() == "")
            {
                btn_search.Enabled = true;
                rtb_messagebox.Text = "请输入要查找的电影名称！";
                return;
            }
            GetMovieInfo(txt_name.Text.Trim());
        }

        /// <summary>
        ///     点击观看
        /// </summary>
        /// <param name="sender"></param>
        /// <param name="e"></param>
        private void btn_look_Click(object sender, EventArgs e)
        {
            if (!string.IsNullOrEmpty(gkUrl))
            {
                //调用IE浏览器    
                //System.Diagnostics.Process.Start("iexplore.exe", "http://blog.csdn.net/testcs_dn");

                var process = new Process();

                process.StartInfo.FileName = "firefox.exe"; //IE浏览器，可以更换

                process.StartInfo.Arguments = gkUrl;

                process.Start();
            }
            else
            {
                MessageBox.Show("暂无播放资源，可以尝试复制下载资源到迅雷，边看边下！");
            }
        }

        private void com_orderby_SelectedIndexChanged(object sender, EventArgs e)
        {
            switch (com_orderby.SelectedIndex)
            {
                case 1:
                    ShowShowing();
                    break;
                case 2:
                    ShowComing();
                    break;
                case 3:
                    ShowTop();
                    break;
            }
        }

        /// <summary>
        ///     展示正在上影
        /// </summary>
        public void ShowShowing()
        {
            Rootobject model = ShowimgCrewl.GetShowingMovieInforListByCache();
            if (model != null)
            {
                lisb_orderby.Items.Clear();
                foreach (Subjects item in model.subjects)
                {
                    SkinListBoxItem skinListBoxItem = new SkinListBoxItem();
                    skinListBoxItem.Text = item.title + "-" + item.rating + "分";
                    lisb_orderby.Items.Add(skinListBoxItem);
                }
            }
        }

        /// <summary>
        ///     即将上映
        /// </summary>
        public void ShowComing()
        {
            Rootobject model = ShowimgCrewl.GetComingMovieInforListByCache();
            if (model != null)
            {
                lisb_orderby.Items.Clear();

                foreach (Subjects item in model.subjects)
                {
                    SkinListBoxItem skinListBoxItem = new SkinListBoxItem();
                    skinListBoxItem.Text = item.title + "-" + item.rating.average + "分";
                    lisb_orderby.Items.Add(skinListBoxItem);
                }
            }
        }

        /// <summary>
        ///     Top250
        /// </summary>
        public void ShowTop()
        {
            Rootobject model = ShowimgCrewl.GetTopMovieInforListByCache();
            if (model != null)
            {
                lisb_orderby.Items.Clear();
                foreach (Subjects item in model.subjects)
                {
                    SkinListBoxItem skinListBoxItem = new SkinListBoxItem();
                    skinListBoxItem.Text = item.title + "-" + item.rating.average + "分";
                    lisb_orderby.Items.Add(skinListBoxItem);
                }
            }
        }

        private void lisb_orderby_SelectedIndexChanged(object sender, EventArgs e)
        {
            //电影名
            string movieName = lisb_orderby.SelectedItem.ToString().Split('-')[0];
            GetMovieInfo(movieName.TrimEnd('。'));
        }
    }
}

运行结果如图:

这里写图片描述

.NET跨平台
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
豆瓣电影排行爬虫
06-05
初学python爬虫小练-------爬取豆瓣排行榜上的电影，并分类存储到excel表
豆瓣电影爬虫
Mr_WHITE2的博客
04-14 966
python豆瓣电影爬虫 爬取网址：https://movie.douban.com/tag/#/?sort=U&range=0,10&tags=美国 我们爬取的内容为文本，爬取前我们需要进行网页的分析 如图所示：我们可以看到我们的主要爬取数据存储在响应的其中一个页面中 具体怎么查看和分析目前不做介绍了。 # coding=utf-8 from parse import pars...
【python】爬取豆瓣电影排行榜TOP250存储到CSV文件中【附源码】
热门推荐
m0_73367097的博客
11-01 1万+
设置了请求头部信息，以模拟浏览器的请求，函数返回响应数据的JSON格式内容。# 反爬 填写headers请求头Win64;# 防止出现乱码使用csv库的DictWriter类，创建一个CSV写入对象，并指定列名为"title"、"star"、"quote"和"url"。然后，逐行写入电影信息到CSV文件中。# 定义一个空的列表# 创建一个字典 像列表中存储数据[{电影一},{电影二}......]
爬虫-豆瓣电影
m0_46247241的博客
06-16 575
最近在B站上系统的跟着学做了个Python爬虫项目，记录一下新知识！
豆瓣排行榜小爬虫
jungle8884的博客
12-03 522
import requests from lxml import etree # 1. 将目标网站的信息抓取下来 headers = { 'User-Agent': "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 " ...
爬虫 爬取豆瓣电影排行榜.zip
01-22
"爬虫 爬取豆瓣电影排行榜.zip"这个文件显然包含了编写好的Python爬虫代码，用于抓取豆瓣电影网站上的电影排行榜信息。在这个压缩包中，主要的文件是名为"douban_movie.py"的Python脚本。 爬虫技术的核心在于模拟...
通过Python爬虫自建豆瓣电影API.zip
最新发布
02-27
通过Python爬虫自建豆瓣电影API.zip 项目简介 在开发微信小程序「影库MDb」时，使用了豆瓣api来获取电影信息，后来由于豆瓣apikey失效了，小程序就无法正常访问，而个人主体貌似无法申请官方apikey，所以自己抽时间...
豆瓣电影python爬虫程序
11-20
通过使用网络爬虫技术，该程序可以自动从豆瓣电影网页中抓取电影的名称、评分、演员、导演等信息，然后将这些数据存储或进一步处理，例如制作数据可视化或建立电影推荐系统。 该爬虫程序使用了Python中的一些常见...
Python爬虫程序源代码爬取豆瓣TOP250排行榜数据电影名称评分导演演员等信息
12-21
使用场景及目标： 可以在数据分析、电影推荐系统等场景中使用，用户可以利用爬取的数据进行统计分析、可视化展示、推荐算法等工作，从而深入了解豆瓣电影排行榜的特点和趋势。其他说明： 该爬虫具有可配置性，用户...
豆瓣电影排行榜爬取
qq_38765321的博客
07-19 914
#请求页已经能够得到数据，但是自己整理下感觉会更好些 import requests, json def main(page): url = 'https://movie.douban.com/j/chart/top_list?type=11&amp;interval_id=100%3A90&amp;action=&amp;start=' + str(page) + '&amp;limit=...
豆瓣电影爬虫数据(整理后)
11-05
豆瓣电影数据，经过详细的整理，可以将excel文件直接导入到sqlserver中，亲测可用
爬取豆瓣电影排行榜
weixin_45877051的博客
04-02 380
运用到的库有： time库 requests库 bs4库 不懂的可以在下方留言交流 #!D:\Anaconda\Python 3.7.0 # -*- coding: utf-8 -*- # @author:LiuQing import requests from bs4 import BeautifulSoup import time time.perf_counter() def get_...
爬虫实例之豆瓣电影排行榜
dragongreenfire的博客
03-03 260
from bs4 import BeautifulSoup from lxml import html import xml import requests #不加头部直接爬取的话，返回值为空 headers = {'User-Agent':'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.66 Safari/537.36'} url = "https://movie
【Python爬虫】批量爬取豆瓣电影排行Top250
Remote Sensing迷途小书童
09-22 2526
今天给大家分享下我刚开始接触Python时学习的爬虫程序，代码部分很简单，不过当时刚开始学习时还是走了不少弯路的。这个爬虫程序应该是很多书里面的入门练手程序，主要就是去豆瓣爬取电影评分排行前250。
爬虫项目之豆瓣电影排行榜前10页
前景
01-20 3954
豆瓣电影排行榜前十页数据抓取（详细分析讲解）
python爬取豆瓣电影排行榜_python爬取豆瓣电影排行榜
weixin_36076701的博客
02-10 909
# -*- coding: utf-8 -*-import pandasimport numpy as npimport pandas as pdfrom pandas import Series,DataFramefrom bs4 import BeautifulSoupimport requestsimport timeurls=['https://movie.douban.com/top25...
豆瓣电影：TOP250榜单爬虫
weixin_52360620的博客
10-17 1402
#导包 import requests from bs4 import BeautifulSoup import pandas as pd 第一步：下载所有页面（共10个）的HTML 【1】构造分页数字列表page_indexs 【2】构造函数download_all_htmls，下载所有列表页面的HTML 1、先添加请求头headers（爬取的网站有反爬虫机制，要向服务器发出爬虫请求，需要添加请求头headers。不然响应状态是418，正常情况应该是200。） 2、利用for循环取到页面列表中.
豆瓣电影网络爬虫
只想静静学习
12-21 3906
对于一个电影的爬取，首先要找到网站的 User-Agent 。用户代理，告诉豆瓣服务器，我们是什么类型的机器，浏览器等信息 用来伪装。然后做好爬虫软件的规划。 第一、获取数据 获取数据后，我们还需要进行数据解析 然后对于爬取的数据存储。我们可以使用excel进行存储 还可以使用数据库存储 最后你就将获取一个豆瓣电影前250部电影的信息 ...
Python实现的豆瓣电影数据爬虫设计与分析
"这篇毕业论文主要探讨了基于Python的豆瓣电影数据爬虫的设计与实现，适合专科和本科毕业生作为毕业论文参考。论文涵盖了Python基础知识、网络爬虫原理和技术、爬虫设计与实现以及数据存储与处理等内容。通过爬取...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值