简单易懂!推荐给自学python的小项目实战!

最近有挺多朋友都在自学Python,学着在网上采集一些数据,以前都是用火车头采集的,感觉很不灵活,于是他们就花了一些时间学下python,来找我推荐一些类似的小项目练练手,我就写了几个小项目,给他们。


一个是抖音去水印


另外一个是爬取B站上的视频弹幕,用结巴分词,再用词云生成一张图片

请忽略变量命名 变量命名随便取的

1.抖音去水印

import requests
import re
import json
 
 
def download_page(url, pc=True):
    if pc == True:
        ua = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.106 Safari/537.36'
    else:
        ua = 'Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/604.1.38 (KHTML, like Gecko) Version/11.0 Mobile/15A372 Safari/604.1'
    headers = {
        'User-Agent': ua
    }
    res = requests.get(url, headers=headers)
    return res
 
 
if __name__ == '__main__':
    # https://v.douyin.com/JyPHShN/
    url = input('输入抖音视频地址:')
    # 获取真实地址
    res1 = download_page(url)
    patten = re.compile('/video/(.*?)/')
    # https://www.iesdouyin.com/share/video/6881151874846723339/?region=CN&mid=6881152095287479053&u_code=imbie9bd&titleType=title×tamp=1602169029&app=aweme&utm_campaign=client_share&utm_medium=ios&tt_from=copy&utm_source=copy
    # /vodeo/ 后面那串数字就是item_ids号 6881151874846723339 通过正则获取
    item_ids = (patten.findall(res1.url))[0]
 
    # 获取视频相关数据
    res2 = download_page(f'https://www.iesdouyin.com/web/api/v2/aweme/iteminfo/?item_ids={item_ids}')
    res2_text = json.loads(res2.text)
    info = res2_text['item_list'][0]
    old_addr = info['video']['play_addr']['url_list'][0]
    new_addr = old_addr.replace('playwm', 'play')
    # 通过手机UA获取无水印视频地址
    res3 = download_page(new_addr, False)
    new_addr = res3.url
    douyin_info = {
        'aweme_id': info['aweme_id'],
        'title': info['desc'],
        'cover': info['video']['cover']['url_list'][0],
        'play_addr': new_addr
    }
    print(douyin_info)

2.爬取弹幕

import requests
import json
import re
 
 
# 下载页面
def download_page(url):
    headers = {
        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.106 Safari/537.36'
    }
    res = requests.get(url, headers=headers)
    return res
 
 
# 根据dvid获取cid
def get_cid(dvid):
    '''
    获取cid
    :param dvid: https://api.bilibili.com/x/player/pagelist?bvid=BV1KK4y1h76a&jsonp=jsonp
    :return: cid
    '''
    url = f'https://api.bilibili.com/x/player/pagelist?bvid={dvid}&jsonp=jsonp'
    res = download_page(url)
    return json.loads(res.text)['data'][0]['cid']
 
 
# 根据cid请求弹幕
def get_msg(cid):
    '''
    :param cid: https://api.bilibili.com/x/v1/dm/list.so?oid=241955049
    :return:
    '''
    url = f'https://api.bilibili.com/x/v1/dm/list.so?oid={cid}'
    res = download_page(url)
    res.xml = res.content.decode('utf-8')
    patten = re.compile('<d.*?>(.*?)</d>')
    dan_mu_list = patten.findall(res.xml)
    return dan_mu_list
 
 
# 保存弹幕到txt文件
def save_to_file(dan_mu_list, filename):
    with open(filename, mode='w', encoding='utf-8') as f:
        for i in dan_mu_list:
            f.write(i)
            f.write('\n')
 
 
# 爬取弹幕主程序
def main(dvid):
    cid = get_cid(dvid)
    dan_mu_list = get_msg(cid)
    save_to_file(dan_mu_list, f'{dvid}.txt')
 
 
if __name__ == '__main__':
    # dvid = 'BV1aE411d7Rp'
    dvid = input('输入B站视频后缀:')
    main(dvid)
    print('弹幕爬取成功')

然后把这些代码数据词云生成图片

import jieba
import wordcloud
 
 
# 读取弹幕文件
def rand_file(filename):
    with open(filename, mode='r', encoding='utf-8') as f:
        dan_mu = f.read()
        return dan_mu
 
 
# 结巴分词 生成词云
def jieba_cut(str, imgname):
    cut_list = jieba.lcut(str)
    word = ' '.join(cut_list)
    w = wordcloud.WordCloud(font_path='msyh.ttc', background_color='white', width=600, height=400)
    w.generate(word)
    w.to_file(f'{imgname}.png')
 
 
if __name__ == '__main__':
    # dvid = 'BV1aE411d7Rp'
    dvid = input('输入B站视频后缀:')
    str = rand_file(f'{dvid}.txt')
    jieba_cut(str, dvid)
    print('词云图生成完毕')

 注意:如果你是打算找python高薪工作的话。我建议你多写点真实的企业项目积累经验。不然工作都找不到,当然很多人没进过企业,怎么会存在项目经验呢? 所以你得多找找企业项目实战多练习下撒。如果你很懒不想找,也可以进我的Python交流圈:1156465813。群文件里面有我之前在做开发写过的一些真实企业项目案例。你可以拿去学习,不懂都可以在裙里找我,有空会耐心给你解答下。

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值