手把手教你：基于python+Django的英文数据分析与可视化系统

置顶大雾的小屋

于 2023-11-28 17:17:47 发布

阅读量631

点赞数 10

分类专栏： python项目文章标签： python django 数据分析自然语言处理 pycharm echarts 人工智能

本文链接：https://blog.csdn.net/weixin_43486940/article/details/134667799

版权

python项目专栏收录该内容

18 篇文章 70 订阅

订阅专栏

系列文章

一、项目简介

本文主要介绍的基于Python和Django框架构建的英文数据分析与可视化系统。

该系统使用的是英语四六级考试相关文章、题目、答案，并对各种文本进行分析，包括且不限于以下关键技术：

实现了对英文文本数据的处理，包括词频统计、情感分析等，并将分析结果以图表形式进行展示。通过这个系统，用户可以便捷地进行英文数据的分析和可视化。

完整代码在最下方，想要先看源码的同学可以移步本文最下方进行下载。

博主也参考过文本分类相关模型的文章，但大多是理论大于方法。很多同学肯定对原理不需要过多了解，只需要搭建出一个可视化系统即可。

也正是因为我发现网上大多的帖子只是针对原理进行介绍，功能实现的相对很少。

如果您有以上想法，那就找对地方了！

不多废话，直接进入正题！

二、系统功能

1、数据导入

支持多种格式的英文文本数据导入，如.txt, .csv, .json等。

2、数据清洗

提供数据清洗功能，包括去除停用词、标点符号、数字等。

3、词频统计

统计文本中单词的频率，并以词云图、条形图等形式展示。

4、情感分析

基于NLP技术对文本进行情感分析，判断文本的积极、消极或中性情绪。

5、可视化

采用多种图表进行数据可视化，如折线图、饼图、散点图等。

6、用户交互

提供友好的用户界面，方便用户进行操作和交互。

三.界面简介

系统完成后界面如下：

1、首页

首页：提供了三个模块：Materials、Business Intelligence、User Management
分别为：1、CET的题目信息查询。2、数据分析与可视化。3、用户注册与登录

2、题库界面

页面二：可以查看CET的2016年-2020年的题目和答案，用于自行练习。

在这里插入图片描述

页面三：答题界面

3、数据分析可视化界面

页面四：题目及答案的数据分析及词频统计界面
单词长度统计

在这里插入图片描述

高频单词统计

4、用户管理界面

用户注册

在这里插入图片描述

用户登录

在这里插入图片描述

四、界面架构

整个系统架构以及功能模块不复杂，可以参考下图：

在这里插入图片描述

五、代码功能介绍

1、依赖环境

本项目使用的是pycharm的python编译环境，如不清楚如何使用的同学可以参考csdn上其他博主的基础教程，这里就不进行赘述。

后端：Python, Django, NLTK（自然语言处理工具包）

前端：HTML, CSS, JavaScript, Bootstrap, jQuery

数据库：MySQL

可视化库：Matplotlib, Pyecharts, WordCloud

2、创建数据库

创建mysql数据库，并写入相关数据

import mysql.connector
import pandas as pd


class DbCreate:
    def __init__(self):
        self.my_db = mysql.connector.connect(
            host="localhost",
            user="root",
            passwd="123456",
            auth_plugin='mysql_native_password'
        )

    def create_database(self, database_name):
        """
        创建database
        database_name:数据库名
        """
        # 实例化
        db_cursor = self.my_db.cursor()
        try:
            sql = "CREATE DATABASE " + database_name + ";"
            db_cursor.execute(sql)
            # 提交
            self.my_db.commit()
        except Exception as e:
            print("create_database 失败，错误信息：", str(e))
        else:
            print("create_database 成功......")

    def drop_database(self, database_name):
        """
        删除database
        database_name:数据库名
        """
        # 实例化
        db_cursor = self.my_db.cursor()
        try:
            sql = "DROP DATABASE " + database_name + ";"
            db_cursor.execute(sql)
            # 提交
            self.my_db.commit()
        except Exception as e:
            print("drop_database 失败，错误信息：", str(e))
        else:
            print("drop_database 成功......")


class DbConnect:
    def __init__(self, dbname):
        self.my_db = mysql.connector.connect(
            host="localhost",
            user="root",
            passwd="123456",
            auth_plugin='mysql_native_password',
            database=dbname
        )

    def insert_user(self, email, name, password):
        """
        创建用户
        """
        my_cursor = self.my_db.cursor()
        try:
            sql = "INSERT INTO user (email,name,password) VALUES (%s, %s, %s);"
            val = (email, name, password)
            # 执行
            my_cursor.execute(sql, val)
            # 提交
            self.my_db.commit()
        except Exception as e:
            print("insert_user 失败，错误信息：", str(e))
        else:
            print('insert_user 成功......')

    def create_tb_user(self):
        """
        创建user表
        """
        my_cursor = self.my_db.cursor()
        try:
            # 用户表建表语句
            sql = "CREATE TABLE user (id INT AUTO_INCREMENT PRIMARY KEY, email VARCHAR(255), name VARCHAR(255)" \
                  ", password VARCHAR(255));"
            my_cursor.execute(sql)
            # 提交
            self.my_db.commit()
        except Exception as e:
            print("create_tb_user 失败，错误信息：", str(e))
        else:
            print('create_tb_user 成功......')
        # 创建管理员
        print("创建管理员......")
        self.insert_user("email@163.com", "test", "123456")

    def create_tb_cet(self):
        """
        创建题库表
        """
        my_cursor = self.my_db.cursor()
        try:
            # 用户表建表语句
            sql = "CREATE TABLE exam (id INT AUTO_INCREMENT PRIMARY KEY, 编号 VARCHAR(255),级别 VARCHAR(255)" \
                  ", 年份 VARCHAR(255),月份 VARCHAR(255),套数 VARCHAR(255),题型 VARCHAR(255),内容 TEXT," \
                  "选项 TEXT,答案 TEXT ,翻译 TEXT );"
            my_cursor.execute(sql)
            # 提交
            self.my_db.commit()
        except Exception as e:
            print("create_tb_cet 失败，错误信息：", str(e))
        else:
            print('create_tb_cet 成功......')

    def insert_exam(self, nbr, level, year, month, t_nbr, tx, text, choose, answer, translation):
        """
        执行单个插入题库信息
        """

        my_cursor = self.my_db.cursor()
        try:
            sql = "INSERT INTO exam (编号,级别,年份,月份,套数,题型,内容,选项,答案,翻译) VALUES " \
                  "(%s, %s, %s, %s, %s, %s, %s, %s, %s, %s);"
            val = (nbr, level, year, month, t_nbr, tx, text, choose, answer, translation)
            # 执行
            my_cursor.execute(sql, val)
            # 提交
            self.my_db.commit()
        except Exception as e:
            print("insert_user 失败，错误信息：", str(e))

    def insert_exam_all(self):
        """
        读取Excel信息，插入所有题库
        """
        data_exam = pd.read_excel("data/data_exam.xlsx", engine='openpyxl')
        print("读取题库信息成功，开始更新题库信息至数据库......")
        for i in range(len(data_exam)):
            try:
                self.insert_exam(
                    str(data_exam['编号'][i]),
                    str(data_exam['级别'][i]),
                    str(data_exam['年份'][i]),
                    str(data_exam['月份'][i]),
                    str(data_exam['套数'][i]),
                    str(data_exam['题型'][i]),
                    str(data_exam['内容'][i]),
                    str(data_exam['选项'][i]),
                    str(data_exam['答案'][i]),
                    str(data_exam['翻译'][i])
                )
            except Exception as e:
                print("insert_exam_all 执行异常，错误信息如下：", e)
            else:
                print("第", i + 1, "条题库信息插入成功......")
        print("完成题库信息导入.......")

    def create_tb_text(self):
        """
        创建文章表
        """
        my_cursor = self.my_db.cursor()
        try:
            # 用户表建表语句
            sql = "CREATE TABLE text (id INT AUTO_INCREMENT PRIMARY KEY,  级别 VARCHAR(255)" \
                  ", 年份 VARCHAR(255),月份 VARCHAR(255),套数 VARCHAR(255),题型 VARCHAR(255),内容 TEXT)"
            my_cursor.execute(sql)
            # 提交
            self.my_db.commit()
        except Exception as e:
            print("create_tb_text 失败，错误信息：", str(e))
        else:
            print('create_tb_text 成功......')

    def insert_text(self, level, year, month, t_nbr, tx, text):
        """
        执行单个插入文章信息
        """
        my_cursor = self.my_db.cursor()
        try:
            sql = "INSERT INTO text (级别,年份,月份,套数,题型,内容) VALUES " \
                  "(%s, %s, %s, %s, %s, %s);"
            val = (level, year, month, t_nbr, tx, text)
            # 执行
            my_cursor.execute(sql, val)
            # 提交
            self.my_db.commit()
        except Exception as e:
            print("insert_text 失败，错误信息：", str(e))

    def insert_text_all(self):
        """
        读取Excel信息，插入所有文章
        """
        data_exam = pd.read_excel("data/data_text.xlsx", engine='openpyxl')
        print("读取题库信息成功，开始更新题库信息至数据库......")
        for i in range(len(data_exam)):
            try:
                self.insert_text(
                    str(data_exam['级别'][i]),
                    str(data_exam['年份'][i]),
                    str(data_exam['月份'][i]),
                    str(data_exam['套数'][i]),
                    str(data_exam['题型'][i]),
                    str(data_exam['内容'][i])
                )
            except Exception as e:
                print("insert_text_all 执行异常，错误信息如下：", e)
            else:
                print("第", i + 1, "条题库信息插入成功......")
        print("完成题库信息导入.......")


if __name__ == '__main__':
    # 建库名
    db_name = 'exam'

    # # 建库
    # my_db_create = DbCreate()
    # # my_db_create.drop_database('english')
    # my_db_create.drop_database(db_name)
    # my_db_create.create_database(db_name)

    # mysql创建连接
    my_db_connect = DbConnect(db_name)

    # # 创建user表
    # my_db_connect.create_tb_user()
    # # 创建题库表
    # my_db_connect.create_tb_cet()
    # # 插入题库信息
    # my_db_connect.insert_exam_all()

    # 创建文章表
    my_db_connect.create_tb_text()
    # 插入题库信息
    my_db_connect.insert_text_all()

3、数据分析模块

from collections import Counter
import mysql.connector
import pandas as pd
from pyecharts.charts import Bar
from pyecharts import options as opts
from pyecharts.charts import Pie


class DbConnect:
    def __init__(self):
        self.my_db = mysql.connector.connect(
            host="localhost",
            user="root",
            passwd="123456",
            auth_plugin='mysql_native_password',
            database='exam'
        )

    def select_text_len(self):
        """
        获取文章内容、年度、AB
        """
        text_result = {}
        try:
            my_cursor = self.my_db.cursor()
            print("连接数据库成功，开始读取数据......")
            sql = "SELECT 内容,年份 FROM text WHERE 题型 = 'A' AND 级别=4"
            my_cursor.execute(sql)
            result = my_cursor.fetchall()
            text_4_a = []
            text_year = []
            # 获取4级文章和年度
            for i in range(len(result)):
                text_4_a.append(result[i][0])
                text_year.append(result[i][1])

            sql = "SELECT 内容 FROM text WHERE 题型 = 'A' AND 级别=6"
            my_cursor.execute(sql)
            result = my_cursor.fetchall()
            text_6_a = []
            # 获取6级文章
            for i in range(len(result)):
                text_6_a.append(result[i][0])

            sql = "SELECT 内容 FROM text WHERE 题型 = 'B' AND 级别=4"
            my_cursor.execute(sql)
            result = my_cursor.fetchall()
            text_4_b = []
            # 获取B卷4级文章
            for i in range(len(result)):
                text_4_b.append(result[i][0])

            sql = "SELECT 内容 FROM text WHERE 题型 = 'B' AND 级别=6"
            my_cursor.execute(sql)
            result = my_cursor.fetchall()
            text_6_b = []
            # 获取B卷6级文章
            for i in range(len(result)):
                text_6_b.append(result[i][0])
            text_result = {
                'year': text_year,
                '4_a': text_4_a,
                '4_b': text_4_b,
                '6_a': text_6_a,
                '6_b': text_6_b
            }
        except Exception as e:
            msg = "查询失败，错误信息：", str(e)
            print(msg)

        return text_result


def deal_length(my_l):
    """
    处理文章长度
    """
    result = []
    for text in my_l:
        result.append(len(text.split(" ")))
    return result


def show_length():
    """
    展示A、B文章长度
    """
    my_dbc = DbConnect()
    result = my_dbc.select_text_len()
    year = result['year']
    text_4a = result['4_a']
    text_4b = result['4_b']
    text_6a = result['6_a']
    text_6b = result['6_b']
    # 处理文章长度
    text_4a_l = deal_length(text_4a)
    text_4b_l = deal_length(text_4b)
    text_6a_l = deal_length(text_6a)
    text_6b_l = deal_length(text_6b)
    # 生成4级网页
    print("开始生成网页......")
    bar = Bar(init_opts=opts.InitOpts(width="800px", height="400px", page_title="img_view",
                                      ))
    # 展示cet4的文章长度
    bar.add_xaxis(year)
    bar.add_yaxis("CET4 A Length", text_4a_l)
    bar.add_yaxis("CET4 B Length", text_4b_l)
    bar.set_global_opts(title_opts=opts.TitleOpts(title="CET4", subtitle="Statistical"))
    bar.render("./templates/bi_show_cet4l.html")
    print("生成成功，请见目录：/templates/bi_show_cet4l.html ......")
    # 生成6级网页
    bar = Bar(init_opts=opts.InitOpts(width="800px", height="400px", page_title="img_view",
                                      ))
    # 展示cet6的文章长度
    bar.add_xaxis(year)
    bar.add_yaxis("CET6 A Length", text_6a_l)
    bar.add_yaxis("CET6 B Length", text_6b_l)
    bar.set_global_opts(title_opts=opts.TitleOpts(title="CET6", subtitle="Statistical"))
    bar.render("./templates/bi_show_cet6l.html")
    print("生成成功，请见目录：/templates/bi_show_cet6l.html ......")


def read_stop_txt(rootdir):
    """
    读取停用词表
    """
    lines = []
    with open(rootdir, 'r', encoding="utf-8") as file_to_read:
        while True:
            line = file_to_read.readline()
            if not line:
                break
            line = line.strip('\n').strip(' ')
            lines.append(line)
    return lines


def words_clean(data):
    """数据清洗"""
    lines = []
    for word in data:
        word = word.replace("\n", '').replace("\\u", '').replace("\\", '').replace("_", '') \
            .replace("—", '').replace("-", '').replace("?", '').replace("[", '').replace("]", '') \
            .replace(".", '').replace("“", '').replace(",", '').replace("$", '').replace(";", '') \
            .replace("(", '').replace(")", '').replace("\"", '').replace(":", '').replace("”", '')
        # if word.isalpha():
        #     lines.append(word)
        # else:
        #     print(word)
        lines.append(word)
    return lines


def show_words_length():
    """
    展示A、B文章单词长度占比
    """
    my_dbc = DbConnect()
    result = my_dbc.select_text_len()
    list_4_a = result['4_a']
    list_4_b = result['4_b']
    list_6_a = result['6_a']
    list_6_b = result['6_b']
    # 合并文章,处理分词
    text_4_a = words_clean(' '.join(list_4_a).split(" "))
    text_4_b = words_clean(' '.join(list_4_b).split(" "))
    text_6_a = words_clean(' '.join(list_6_a).split(" "))
    text_6_b = words_clean(' '.join(list_6_b).split(" "))

    len_4a = [len(word) for word in text_4_a if word != '']
    len_4b = [len(word) for word in text_4_b if word != '']
    len_6a = [len(word) for word in text_6_a if word != '']
    len_6b = [len(word) for word in text_6_b if word != '']
    # 获取单词长度
    c_4a = Counter(len_4a).most_common(12)
    c_4b = Counter(len_4b).most_common(12)
    c_6a = Counter(len_6a).most_common(12)
    c_6b = Counter(len_6b).most_common(12)

    # 设置主标题与副标题，标题设置居中，设置宽度
    w = "700px"
    h = "600px"
    center = [400, 300]
    pos_left = 200
    # 生成4级网页
    pie = Pie(init_opts=opts.InitOpts(width=w, height=h, page_title="img_view",
                                      ))
    # 加入数据，上方的colums选项取消显示
    # 文章A
    pie.add("words length", c_4a, center=center)
    pie.set_global_opts(title_opts=opts.TitleOpts(title="CET4-A", subtitle="words length statistical")
                        , legend_opts=opts.LegendOpts(pos_left=pos_left)
                        )
    pie.render("./templates/bi_show_cet4pa.html")
    print("生成成功，请见目录：/templates/bi_show_cet4pa.html ......")
    # 文章B
    pie = Pie(init_opts=opts.InitOpts(width=w, height=h, page_title="img_view",
                                      ))
    # 加入数据，上方的colums选项取消显示
    pie.add("words length", c_4b, center=center)
    pie.set_global_opts(title_opts=opts.TitleOpts(title="CET4-B", subtitle="words length statistical")
                        , legend_opts=opts.LegendOpts(pos_left=pos_left)
                        )
    pie.render("./templates/bi_show_cet4pb.html")
    print("生成成功，请见目录：/templates/bi_show_cet4pb.html ......")

    # 生成6级网页
    # 设置主标题与副标题，标题设置居中，设置宽度
    # 文章A
    pie = Pie(init_opts=opts.InitOpts(width=w, height=h, page_title="img_view",
                                      ))
    # 加入数据，上方的colums选项取消显示
    pie.add("words length", c_6a, center=center)
    pie.set_global_opts(title_opts=opts.TitleOpts(title="CET6-A", subtitle="words length statistical"),
                        legend_opts=opts.LegendOpts(pos_left=pos_left))
    pie.render("./templates/bi_show_cet6pa.html")
    print("生成成功，请见目录：/templates/bi_show_cet6pa.html ......")
    # 文章B
    pie = Pie(init_opts=opts.InitOpts(width=w, height=h, page_title="img_view",
                                      ))
    # 加入数据，上方的colums选项取消显示
    pie.add("words length", c_6b, center=center)
    pie.set_global_opts(title_opts=opts.TitleOpts(title="CET6-B", subtitle="words length statistical"),
                        legend_opts=opts.LegendOpts(pos_left=pos_left))
    pie.render("./templates/bi_show_cet6pb.html")
    print("生成成功，请见目录：/templates/bi_show_cet6pb.html ......")


def show_words(top=20):
    """
    展示A、B文章Top关键词
    """
    my_dbc = DbConnect()
    result = my_dbc.select_text_len()
    list_4 = result['4_a'] + result['4_b']
    list_6 = result['6_a'] + result['6_b']
    # 合并文章,处理分词
    text_4 = words_clean(' '.join(list_4).split(" "))
    text_6 = words_clean(' '.join(list_6).split(" "))
    # 去停用词
    stop_words = read_stop_txt('./data/stopwords.txt')
    stop_4 = [word for word in text_4 if word not in stop_words and word != '']
    stop_6 = [word for word in text_6 if word not in stop_words and word != '']

    # 获取关键词
    c_4 = Counter(stop_4).most_common(top)
    c_4.reverse()
    show_x = list(dict(c_4).keys())
    show_y = list(dict(c_4).values())

    # 生成4级网页
    print("开始生成网页......")
    bar = Bar(init_opts=opts.InitOpts(width="800px", height="700px", page_title="img_view",
                                      ))
    # 展示cet4的高频词
    bar.add_xaxis(show_x)
    bar.add_yaxis("Frequency of high frequency words", show_y, itemstyle_opts=opts.ItemStyleOpts(color='#8f4b2e'))
    bar.reversal_axis()
    bar.set_global_opts(title_opts=opts.TitleOpts(title="CET4", subtitle="Statistical"))
    bar.set_series_opts(label_opts=opts.LabelOpts(position="right"))
    bar.render("./templates/bi_show_cet4f.html")
    print("生成成功，请见目录：/templates/bi_show_cet4f.html ......")

    # 生成6级网页
    c_6 = Counter(stop_6).most_common(top)
    c_6.reverse()
    show_x = list(dict(c_6).keys())
    show_y = list(dict(c_6).values())
    bar = Bar(init_opts=opts.InitOpts(width="800px", height="700px", page_title="img_view",
                                      ))
    # 展示cet6的高频词
    bar.add_xaxis(show_x)
    bar.add_yaxis("Frequency of high frequency words", show_y, itemstyle_opts=opts.ItemStyleOpts(color='#2a5caa'))
    bar.reversal_axis()
    bar.set_global_opts(title_opts=opts.TitleOpts(title="CET6", subtitle="Statistical"))
    bar.set_series_opts(label_opts=opts.LabelOpts(position="right"))
    bar.render("./templates/bi_show_cet6f.html")
    print("生成成功，请见目录：/templates/bi_show_cet6f.html ......")


if __name__ == '__main__':
    show_words_length()
    show_words()
    show_length()

4、用户管理模块

用户注册

def do_signup(request):
    email = request.POST['email']
    name = request.POST['name']
    password1 = request.POST['password1']
    password2 = request.POST['password2']
    if email == '' or name == '' or password1 == '' or password2 == '':
        context = {
            "text": "Input error, please complete all forms above!"
        }
    elif password1 != password2:
        context = {
            "text": "Operation error. The passwords you entered twice are inconsistent!"
        }
    else:
        import app.db_model as db_model
        db_c = db_model.DbConnect()
        msg = db_c.insert_user(email, name, password1)
        context = {
            "text": msg
        }
    return render(request, 'user_signup_result.html', context)

用户登录

def user_login(request):
    """
    访问登录界面
    """
    rep = render(request, 'user_login.html', {})
    return rep


def get_ans(request):
    """
    登录界面跳转
    """
    import app.db_model as db_model

    try:
        # if user_name is None or password is None:
        user_name = request.POST["user_name"]
        password = request.POST["password"]
    except KeyError:
        # 无登录信息
        try:
            # 是否已登录，已登录直接返回主页
            user_name = json.loads(request.COOKIES.get('user_name'))
            password = json.loads(request.COOKIES.get('password'))
            # user_name = request.COOKIES.get('user_name')
            # password = request.COOKIES.get('password')
            print(user_name, password)
        except TypeError:
            context = {
                "state": "1",
                "text": "Login status has expired, please login again!"
            }
            return render(request, 'user_error.html', context)

    # print("获取的用户名和密码：", user_name, ';', password)
    if password is "" or user_name is "":
        context = {
            "state": "1",
            "text": "The entered content is empty, please re-enter the login information!"
        }
        return render(request, 'user_error.html', context)
    else:
        db_c = db_model.DbConnect()
        login_msg = db_c.user_login(user_name, password)
        if login_msg['state'] == 0:
            context = {
                "state": login_msg['state'],
                "text": "The user name does not exist, please enter the correct user name!"
            }
            return render(request, 'user_error.html', context)
        if login_msg['state'] == -1:
            context = {
                "state": login_msg['state'],
                "text": login_msg['msg']
            }
            return render(request, 'user_error.html', context)
        elif login_msg['state'] == 2:
            context = {
                "state": login_msg['state'],
                "text": "Wrong password, please enter the correct password!"
            }
            return render(request, 'user_error.html', context)
        else:
            """登录成功，设置cookie"""
            rep = render(request, 'user_home.html', login_msg)
            '''字符转换'''
            user_name = json.dumps(user_name)
            password = json.dumps(password)
            ''' max_age 设置过期时间，单位是秒 '''
            rep.set_cookie('user_name', str(user_name), max_age=1200)
            rep.set_cookie('password', str(password), max_age=1200)
            return rep

5、Django展示界面构建

由于展示界面代码较多，这里就不一一进行展示，感兴趣的同学可以在文章下方找到完整代码下载地址。

这里就附上加载较为关键的前端代码。
展示数据分析结果页面：

{% extends 'base_user.html' %}
{% block content %}
{% load static %}
<div class="container">
    <!--<img id="home_img" class="img-thumbnail" src="{% static 'img/home_img.jpg' %}">-->
    <div id="carouselExampleIndicators" class="carousel slide" data-ride="carousel">
        <ol class="carousel-indicators">
            <li data-target="#carouselExampleIndicators" data-slide-to="0" class="active"></li>
            <li data-target="#carouselExampleIndicators" data-slide-to="1"></li>
            <li data-target="#carouselExampleIndicators" data-slide-to="2"></li>
        </ol>
        <div class="carousel-inner" id="home_carousel">
            <div class="carousel-item active">
                <img src="{% static 'img/bi_img1.jpg' %}" class="d-block w-100" alt="home_img1">
            </div>
            <div class="carousel-item">
                <img src="{% static 'img/bi_img2.jpg' %}" class="d-block w-100" alt="home_img2">
            </div>
            <div class="carousel-item">
                <img src="{% static 'img/bi_img3.jpg' %}" class="d-block w-100" alt="home_img3">
            </div>
        </div>
        <button class="carousel-control-prev" type="button" data-target="#carouselExampleIndicators" data-slide="prev">
            <span class="carousel-control-prev-icon" aria-hidden="true"></span>
            <span class="sr-only">Previous</span>
        </button>
        <button class="carousel-control-next" type="button" data-target="#carouselExampleIndicators" data-slide="next">
            <span class="carousel-control-next-icon" aria-hidden="true"></span>
            <span class="sr-only">Next</span>
        </button>
    </div>
</div>

<div class="container">
    <div class="jumbotron">
        <div class="row">
            <div class="col-md-12">
                <div class="card text-left">
                    <h4 class="card-header">Articles Length Analysis</h4>
                    <div class="card-body">
                        <div class="tab-content">
                            <p class="card-title">Length analysis of reading comprehension articles over the years</p>
                            <hr class="my-4">
                            <div id="img_l_cet4">
                                <iframe src="l_show_cet4" width="100%" height="450" scrolling="no" frameborder="0"
                                        οnlοad="changeFrameHeight()"></iframe>
                            </div>
                            <hr class="my-4">
                            <div id="img_l_cet6">
                                <iframe src="l_show_cet6" width="100%" height="450" scrolling="no" frameborder="0"
                                        οnlοad="changeFrameHeight()"></iframe>
                            </div>
                        </div>
                    </div>
                </div>
            </div>
        </div>
        <br>
        <div class="row">
            <div class="col-md-12">
                <div class="card text-left">
                    <h4 class="card-header">CET4: Word Length Analysis</h4>
                    <div class="card-body">
                        <div class="tab-content">
                            <p class="card-title">Analysis of word length in reading comprehension articles</p>
                            <hr class="my-4">


                            <div id="img_p_cet4a">
                                <iframe src="p_show_cet4a" width="100%" height="650" scrolling="no"
                                        frameborder="0"
                                        οnlοad="changeFrameHeight()"></iframe>
                            </div>

                            <hr class="my-4">
                            <div id="img_p_cet4b">
                                <iframe src="p_show_cet4b" width="100%" height="650" scrolling="no"
                                        frameborder="0"
                                        οnlοad="changeFrameHeight()"></iframe>
                            </div>


                        </div>
                    </div>
                </div>
            </div>
        </div>
        <br>
        <div class="row">
            <div class="col-md-12">
                <div class="card text-left">
                    <h4 class="card-header">CET6: Word Length Analysis</h4>
                    <div class="card-body">
                        <div class="tab-content">
                            <p class="card-title">Analysis of word length in reading comprehension articles</p>
                            <hr class="my-4">


                            <div id="img_p_cet6a">
                                <iframe src="p_show_cet6a" width="100%" height="650" scrolling="no"
                                        frameborder="0"
                                        οnlοad="changeFrameHeight()"></iframe>
                            </div>

                            <hr class="my-4">
                            <div id="img_p_cet6b">
                                <iframe src="p_show_cet6b" width="100%" height="650" scrolling="no"
                                        frameborder="0"
                                        οnlοad="changeFrameHeight()"></iframe>
                            </div>


                        </div>
                    </div>
                </div>
            </div>
        </div>
        <br>
        <div class="row">
            <div class="col-md-12">
                <div class="card text-left">
                    <h4 class="card-header">High frequency words</h4>
                    <div class="card-body">
                        <div class="tab-content">
                            <p class="card-title">High frequency words and their frequency in reading comprehension A
                                and reading comprehension B</p>
                            <hr class="my-4">
                            <div id="img_f_cet4">
                                <iframe src="f_show_cet4" width="100%" height="750" scrolling="no" frameborder="0"
                                        οnlοad="changeFrameHeight()"></iframe>
                            </div>
                            <hr class="my-4">
                            <div id="img_f_cet6">
                                <iframe src="f_show_cet6" width="100%" height="750" scrolling="no" frameborder="0"
                                        οnlοad="changeFrameHeight()"></iframe>
                            </div>
                        </div>
                    </div>
                </div>
            </div>
        </div>


    </div>
</div>
{% endblock %}

展示词频统计：


<!DOCTYPE html>
<html>
<head>
    <meta charset="UTF-8">
    <title>img_view</title>
            <script type="text/javascript" src="https://assets.pyecharts.org/assets/echarts.min.js"></script>

</head>
<body>
    <div id="52278b250e324ef4b6962156dc3c3ce8" class="chart-container" style="width:800px; height:700px;"></div>
    <script>
        var chart_52278b250e324ef4b6962156dc3c3ce8 = echarts.init(
            document.getElementById('52278b250e324ef4b6962156dc3c3ce8'), 'white', {renderer: 'canvas'});
        var option_52278b250e324ef4b6962156dc3c3ce8 = {
    "animation": true,
    "animationThreshold": 2000,
    "animationDuration": 1000,
    "animationEasing": "cubicOut",
    "animationDelay": 0,
    "animationDurationUpdate": 300,
    "animationEasingUpdate": "cubicOut",
    "animationDelayUpdate": 0,
    "color": [
        "#c23531",
        "#2f4554",
        "#61a0a8",
        "#d48265",
        "#749f83",
        "#ca8622",
        "#bda29a",
        "#6e7074",
        "#546570",
        "#c4ccd3",
        "#f05b72",
        "#ef5b9c",
        "#f47920",
        "#905a3d",
        "#fab27b",
        "#2a5caa",
        "#444693",
        "#726930",
        "#b2d235",
        "#6d8346",
        "#ac6767",
        "#1d953f",
        "#6950a1",
        "#918597"
    ],
    "series": [
        {
            "type": "bar",
            "name": "Frequency of high frequency words",
            "legendHoverLink": true,
            "data": [
                9,
                9,
                9,
                10,
                10,
                10,
                11,
                11,
                12,
                12,
                12,
                14,
                18,
                18,
                19,
                19,
                20,
                21,
                26,
                28
            ],
            "showBackground": false,
            "barMinHeight": 0,
            "barCategoryGap": "20%",
            "barGap": "30%",
            "large": false,
            "largeThreshold": 400,
            "seriesLayoutBy": "column",
            "datasetIndex": 0,
            "clip": true,
            "zlevel": 0,
            "z": 2,
            "label": {
                "show": true,
                "position": "right",
                "margin": 8
            },
            "itemStyle": {
                "color": "#2a5caa"
            },
            "rippleEffect": {
                "show": true,
                "brushType": "stroke",
                "scale": 2.5,
                "period": 4
            }
        }
    ],
    "legend": [
        {
            "data": [
                "Frequency of high frequency words"
            ],
            "selected": {
                "Frequency of high frequency words": true
            },
            "show": true,
            "padding": 5,
            "itemGap": 10,
            "itemWidth": 25,
            "itemHeight": 14
        }
    ],
    "tooltip": {
        "show": true,
        "trigger": "item",
        "triggerOn": "mousemove|click",
        "axisPointer": {
            "type": "line"
        },
        "showContent": true,
        "alwaysShowContent": false,
        "showDelay": 0,
        "hideDelay": 100,
        "textStyle": {
            "fontSize": 14
        },
        "borderWidth": 0,
        "padding": 5
    },
    "xAxis": [
        {
            "show": true,
            "scale": false,
            "nameLocation": "end",
            "nameGap": 15,
            "gridIndex": 0,
            "inverse": false,
            "offset": 0,
            "splitNumber": 5,
            "minInterval": 0,
            "splitLine": {
                "show": false,
                "lineStyle": {
                    "show": true,
                    "width": 1,
                    "opacity": 1,
                    "curveness": 0,
                    "type": "solid"
                }
            }
        }
    ],
    "yAxis": [
        {
            "show": true,
            "scale": false,
            "nameLocation": "end",
            "nameGap": 15,
            "gridIndex": 0,
            "inverse": false,
            "offset": 0,
            "splitNumber": 5,
            "minInterval": 0,
            "splitLine": {
                "show": false,
                "lineStyle": {
                    "show": true,
                    "width": 1,
                    "opacity": 1,
                    "curveness": 0,
                    "type": "solid"
                }
            },
            "data": [
                "So",
                "learning",
                "research",
                "photos",
                "screen",
                "make",
                "children",
                "percent",
                "social",
                "devices",
                "year",
                "found",
                "online",
                "data",
                "people",
                "years",
                "parents",
                "technology",
                "wellbeing",
                "time"
            ]
        }
    ],
    "title": [
        {
            "text": "CET6",
            "subtext": "Statistical",
            "padding": 5,
            "itemGap": 10
        }
    ]
};
        chart_52278b250e324ef4b6962156dc3c3ce8.setOption(option_52278b250e324ef4b6962156dc3c3ce8);
    </script>
</body>
</html>

六、代码下载地址

由于项目代码量和数据集较大，感兴趣的同学可以直接下载代码，使用过程中如遇到任何问题可以在评论区进行评论，我都会一一解答。

代码下载：

代码分享：基于python+Django的英文数据分析与可视化系统

大雾的小屋

关注

10
点赞
踩
10

收藏

觉得还不错? 一键收藏
打赏
0
评论
手把手教你：基于python+Django的英文数据分析与可视化系统

本文主要介绍的基于Python和Django框架构建的英文数据分析与可视化系统。该系统使用的是英语四六级考试相关文章、题目、答案，并对各种文本进行分析，包括且不限于以下关键技术：实现了对英文文本数据的处理，包括词频统计、情感分析等，并将分析结果以图表形式进行展示。通过这个系统，用户可以便捷地进行英文数据的分析和可视化。完整代码在最下方，想要先看源码的同学可以移步本文最下方进行下载。博主也参考过文本分类相关模型的文章，但大多是理论大于方法。很多同学肯定对原理不需要过多了解，只需要搭建出一个可视化系统即可。也正
复制链接

扫一扫