python爬取流媒体_SpiderX允许你通过使用python scrapy框架在互联网上抓取可用的链接来产生流媒体电影...

SpiderX Native

SpiderX allows you to stream movies by scraping links available on the internet using the python scrapy framework.

Note: I made this project to learn react native, web scraping and a new frontend framework (in this case, vuejs). I will not use this to stream pirated movies or distribute the apks to anyone.

How It Works

The user searches will be first sent to firestore, if those searches are not present in firestore then the python scraper will be called.

Once the scraper scrapes the data, the scraped data will be sent to firstore.

The app uses firebase real-time updates to update the UI.

UI

Authentication

auth.png

Home, Search, Imdb

home_search_imdb.png

Favorites, Search Result, Movie Info

favorites_search_result_movie_details.png

Running Locally

This app is built with expo, so you need to install the expo cli package globally in your system.

npm i -g expo-cli

You also need to setup a firebase project and the url to your python scraper (I am using heroku for hosting the scraper)

Create a .env file at the root of the project that looks like this:

# the url to your python scraper

SPIDERX_HEROKU=

# firebase web configuration (you need to first create a firebase project)

APIKEY=

AUTHDOMAIN=

DATABASEURL=

PROJECTID=

STORAGEBUCKET=

MESSAGESENDERID=

APPID=

MEASUREMENTID=

Then clone this repo, install the dependencies and run expo start

git clone https://github.com/manikandanraji/spiderx-native

cd spiderx-native

npm i

expo start

Web

I also built a web interface using vuejs, if you are interested here's the repo

酷抓6是在原网址抓取器5.0的基础上全新升级、强势推出的。提供嗅探下载一条龙服务。可以在线抓取正在访问的所有网络资源并提供下载,比如图片、Flash、音乐、视频等。独有的完整HTTP请求包和响应包抓取分析功能,打造的就是超强的防盗链下载功能和精准的真实文件类型自动识别功能。独有的疑难网址下载功能,真正将所有网络资源一网打尽。 完全支持所有flv视频网站的下载、所有DJ网站、铃声网站的铃声下载,包括QQ音乐,QQ空间背景音乐的下载。酷抓的口号是:只要你能看到的,你能听到的,我都可以下载下来。 支持Windows2000/XP局域网、拨号上网、无线上网等所有网络形式。 更新历史: 2010-06-14 酷抓6.8.193.0614 终结版 ----------------------------------------- +增加RTMP/RTMPE流录制功能 *全新的RTMP解析引擎 ----------------------------------------- +Add function of recording RTMP/RTMPE stream *New engine of RMTP analysis ----------------------------------------- 2010-05-29 刀锋下载5.0.322.0529 ----------------------------------------- *修正了下载某些RTMP流时出错的问题 ----------------------------------------- *Fix some tiny problems when downloading RTMP streams ----------------------------------------- 2010-05-23 ----------------------------------------- 酷抓6.5.175.0523 刀锋下载5.0.315.0523 +增加对RTMPE协议的抓取和下载 +增加对RTMP码率切换抓取的支持 +改进退出时保存提示的体验 *修正了某些HTTP完整请求头抓取格式错误的BUG ----------------------------------------- CooJah 6.5.175.0523 Blader 5.0.315.0523 +Support RTMPE sniffing and downloading +Support RTMP stream bitrates switching sniffing +Optimize exit prompting *Correct format errors for some HTTP headers ----------------------------------------- 2010-02-28 ----------------------------------------- 刀锋下载4.6.251.0228 +刀锋下载支持下载电视直播类型rtmp协议 ----------------------------------------- Blader 4.6.251.0228 +Blader supports live tv rtmp download ----------------------------------------- 2010-01-17 ----------------------------------------- 酷抓6.1.128.0116 刀锋下载4.5.241.0116 +刀锋下载增加最小化至系统托盘和悬浮窗功能 *更正软件中相关错误链接 ----------------------------------------- CooJah 6.1.128.0116 Blader 4.5.241.0116 +Tray icon support for Blader when minimizing and floating window to show downloading status *correct some dead links ----------------------------------------- 2010-01-04 ----------------------------------------- 酷抓6.1.124.0104 刀锋下载4.5.168.0104 *修复一处酷抓对mmsh协议的网址分类错误的问题 +酷抓+刀锋配合支持mmsh下载 ----------------------------------------
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值