YYGH-12-下载中心

下载中心

基于SpringCloud的预约挂号系统 - 小岚 (zhaodapiaoliang.top)

承接上一篇说的,把这个系统进一步完善增加一个下载中心的功能

这是我

1.前端两个页面,一个是订单下载(负责控制下载)另一个是下载中心(展示下载下来的url)

2.建立一个yygh_oss的mysql库,里面建立一个download表,字段有id,医院id,医院名称,开始日期,结束日期,文件url,status （这个status,0为还没有下载,1为已经下载,2为下载失败）

3.在order模块设置一个根据医院和开始结束时间的接口,建立一个feign方便oss调用。

4.oss模块建立一个接口,当条件下载模块请求这个接口的时候,oss向download_status添加一条记录status设置为0

5.在oss模块的业务层中建立一个服务,当收到task模块的请求之后,就会查询status为0的,并根据这个调用order模块的接口得到订单数据

6.利用task模块每一分钟发送一次请求,oss模块收到请求之后,

7.oss模块将这些数据,利用EasyExcel变为一个xlsx文件,并利用Java.util.zip包中的ZipOutputStream 实现文件的压缩

8.oss将压缩后的文件上传到七牛云oss之上,得到文件url,并在download表中更新数据byid

9.前端下载中心可以通过请求获取下载中心的数据。

前端页面

这是现在系统的页面

src/router/index.js

{
  path: '/download',
  component: Layout,
  redirect: '/download',
  name: 'BasesInfo',
  meta: { title: '查询下载', icon: 'table' },
  alwaysShow: true,
  children: [
    {
      path: 'index',
      name: '查询日报',
      component: () => import('@/views/download/index'),
      meta: { title: '查询日报' }
    },
    {
      path: 'center',
      name: '下载中心',
      component: () => import('@/views/download/center'),
      meta: { title: '下载中心' }
    }
  ]
},

src/views/download/center.vue

<template>
  <div class="app-container">
    <!--查询表单-->
    <el-form :inline="true" class="demo-form-inline">
      <el-form-item>
        <el-input v-model="searchObj.keyword" placeholder="医院名称"/>
      </el-form-item>

      <el-form-item label="创建时间">
        <el-date-picker
          v-model="searchObj.createTimeBegin"
          type="datetime"
          placeholder="选择开始时间"
          value-format="yyyy-MM-dd HH:mm:ss"
          default-time="00:00:00"
        />
      </el-form-item>
      至
      <el-form-item>
        <el-date-picker
          v-model="searchObj.createTimeEnd"
          type="datetime"
          placeholder="选择截止时间"
          value-format="yyyy-MM-dd HH:mm:ss"
          default-time="00:00:00"
        />
      </el-form-item>

      <el-button type="primary" icon="el-icon-search" @click="fetchData()">查询</el-button>
      <el-button type="default" @click="resetData()">清空</el-button>
    </el-form>

    <!-- 列表 -->
    <el-table
      v-loading="listLoading"
      :data="list"
      stripe
      style="width: 100%">

      <el-table-column
        label="序号"
        width="70"
        align="center">
        <template slot-scope="scope">
          {{ (page - 1) * limit + scope.$index + 1 }}
        </template>
      </el-table-column>

      <el-table-column prop="hosname" label="医院名称"/>
      <el-table-column prop="downloadDateBegin" label="下载开始时间"/>
      <el-table-column prop="downloadDateEnd" label="下载结束时间"/>
      <el-table-column prop="fileUrl" label="文件连接">
        <template slot-scope="scope">
          <a link :href="scope.row.fileUrl" target="_blank">
            <el-button type="primary" size="mini">下载文件</el-button>
          </a>
        </template>
      </el-table-column>
      <el-table-column :formatter="Formatter" prop="status" label="下载状态"/>
    </el-table>

    <!-- 分页组件 -->
    <el-pagination
      :current-page="page"
      :total="total"
      :page-size="limit"
      :page-sizes="[5, 10, 20, 30, 40, 50, 100]"
      style="padding: 30px 0; text-align: center;"
      layout="sizes, prev, pager, next, jumper, ->, total, slot"
      @current-change="fetchData"
      @size-change="changeSize"
    />
  </div>
</template>
<script>

import downloadApi from '@/api/download'

export default {
  // 定义数据
  data() {
    return {
      listLoading: true, // 数据是否正在加载
      list: null, // banner列表
      total: 0, // 数据库中的总记录数
      page: 1, // 默认页码
      limit: 10, // 每页记录数
      searchObj: {} // 查询表单对象
    }
  },
  // 当页面加载时获取数据
  created() {
    this.fetchData()
  },
  methods: {
    Formatter(row) {
      if (row.status === 0) {
        return '没有上传'
      } else if (row.status === 1) {
        return '上传成功'
      } else if (row.status === 2) {
        return '上传失败'
      }
    },
    // 调用api层获取数据库中的数据
    fetchData(page = 1) {
      console.log('翻页。。。' + page)
      // 异步获取远程数据（ajax）
      this.page = page
      downloadApi.getAmount(this.page, this.limit, this.searchObj).then(
        response => {
          this.list = response.data.records
          this.total = response.data.total
          // 数据加载并绑定成功
          this.listLoading = false
        }
      )
    },
    // 当页码发生改变的时候
    changeSize(size) {
      console.log(size)
      this.limit = size
      this.fetchData(1)
    },
    // 重置查询表单
    resetData() {
      console.log('重置查询表单')
      this.searchObj = {}
      this.fetchData()
    }
  }
}
</script>

src/views/download/index.vue

<template>
  <div class="app-container">
    <!--表单-->
    <el-form :inline="true" class="demo-form-inline">
      <el-form-item>
        <el-input v-model="searchObj.hosname" placeholder="点击输入医院名称"/>
      </el-form-item>

      <el-form-item>
        <el-date-picker
          v-model="searchObj.downloadDateBegin"
          type="date"
          placeholder="选择开始日期"
          value-format="yyyy-MM-dd"/>
      </el-form-item>
      <el-form-item>
        <el-date-picker
          v-model="searchObj.downloadDateEnd"
          type="date"
          placeholder="选择截止日期"
          value-format="yyyy-MM-dd"/>
      </el-form-item>
      <el-button
        :disabled="btnDisabled"
        type="primary"
        icon="el-icon-search"
        @click="showChart()">下载</el-button>
    </el-form>

  </div>
</template>

<script>

import downloadApi from '@/api/download'

export default {

  data() {
    return {
      searchObj: {
        hosname: '',
        downloadDateBegin: '',
        downloadDateEnd: ''
      },
      btnDisabled: false,
      chart: null,
      title: '',
      xData: [], // x轴数据
      yData: [] // y轴数据
    }
  },

  methods: {
    showChart() {
      downloadApi.postDownload(this.searchObj)
    }
  }
}
</script>

src/api/download.js

import request from '@/utils/request'

const api_name = '/admin/oss'

export default {

  postDownload(searchObj) {
    return request({
      url: `${api_name}/postDownload`,
      method: 'post',
      params: searchObj
    })
  },
  getAmount(page, limit, searchObj) {
    return request({
      url: `${api_name}/${page}/${limit}`,
      method: 'get',
      params: searchObj
    })
  }
}

后端代码

Model模块

后端代码主要就写在oss模块

前端参数映射类

@Data
public class DownloadCountQueryVo {
   
   @ApiModelProperty(value = "医院编号")
   private String hoscode;

   @ApiModelProperty(value = "医院名称")
   private String hosname;

   @ApiModelProperty(value = "安排日期")
   private String reserveDateBegin;
   private String reserveDateEnd;

}

数据库脚本

CREATE TABLE `yygh_oss`.`Untitled`  (
  `id` int(16) UNSIGNED NOT NULL AUTO_INCREMENT,
  `hoscode` varchar(30) CHARACTER SET utf8 COLLATE utf8_general_ci NOT NULL,
  `hosname` varchar(100) CHARACTER SET utf8 COLLATE utf8_general_ci NULL DEFAULT NULL COMMENT '医院名称',
  `download_date_begin` datetime NULL DEFAULT NULL,
  `download_date_end` datetime NULL DEFAULT NULL,
  `file_url` varchar(255) CHARACTER SET utf8 COLLATE utf8_general_ci NULL DEFAULT NULL,
  `status` tinyint(3) NULL DEFAULT NULL COMMENT '0为还没有上传,1为上传成功,2为上传失败',
  `create_time` timestamp NULL DEFAULT NULL COMMENT '创建时间',
  `update_time` timestamp NULL DEFAULT NULL COMMENT '更新时间',
  `is_deleted` tinyint(3) NULL DEFAULT NULL COMMENT '逻辑删除(1:已删除，0:未删除)',
  PRIMARY KEY (`id`) USING BTREE
) ENGINE = InnoDB AUTO_INCREMENT = 3 CHARACTER SET = latin1 COLLATE = latin1_swedish_ci ROW_FORMAT = Dynamic;

model/src/main/java/com/example/yygh/model/oss/Download.java

@Data
@TableName("download")
public class Download extends BaseEntity {

    private String hoscode;

    @JsonFormat(pattern = "yyyy-MM-dd HH:mm:ss")
    private Date downloadDateBegin;

    @JsonFormat(pattern = "yyyy-MM-dd HH:mm:ss")
    private Date downloadDateEnd;


    private String fileUrl;
    //0为还没有上传,1为上传成功,2为上传失败

    private Integer status;

}

添加一个带有easyexcel注解的映射类

@Data
public class OrderVo {

    @ExcelProperty(index = 0, value = "医院编号")
    private String hoscode;

    @ExcelProperty(index = 1, value = "医院名称")
    private String hosname;

    @ExcelProperty(index = 2, value = "科室编号")
    private String depcode;

    @ExcelProperty(index = 3, value = "科室名称")
    private String depname;

    @ExcelProperty(index = 4, value = "医生职称")
    private String title;

    @ExcelProperty(index = 5, value = "安排日期")
    @JsonFormat(pattern = "yyyy-MM-dd")
    private Date reserveDate;

    @ExcelProperty(index = 6, value = "就诊人名称")
    private String patientName;

    @ExcelProperty(index = 7, value = "就诊人手机")
    private String patientPhone;

    @ExcelProperty(index = 8, value = "建议取号时间")
    private String fetchTime;

    @ExcelProperty(index = 9, value = "取号地点")
    private String fetchAddress;

    @ExcelProperty(index = 10, value = "医事服务费")
    private BigDecimal amount;

}

Oss模块

oss模块添加配置文件

#mysql配置信息
spring.datasource.driver-class-name=com.mysql.jdbc.Driver
spring.datasource.url=jdbc:mysql://8.142.109.15/yygh_oss?characterEncoding=utf-8&useSSL=false
spring.datasource.username=root
spring.datasource.password=123456

#rabbitmq地址
spring.rabbitmq.host=
spring.rabbitmq.port=5672
spring.rabbitmq.username=guest
spring.rabbitmq.password=guest

#redis配置信息
spring.redis.host=
spring.redis.port=6379
spring.redis.database= 6
spring.redis.timeout=1800000
spring.redis.password=123456
spring.redis.lettuce.pool.max-active=20
spring.redis.lettuce.pool.max-wait=-1
spring.redis.lettuce.pool.max-idle=5
spring.redis.lettuce.pool.min-idle=0

添加是mabatis-plus的mapper和service

@Mapper
public interface DownloadMapper extends BaseMapper<Download> {
}

@Service
@Slf4j
public class DownloadServiceImpl extends ServiceImpl<DownloadMapper, Download> implements DownloadService {

    @Autowired
    private HospitalFeignClient hospitalFeignClient;

    @Autowired
    private OrderFeignClient orderFeignClient;

    @Autowired
    private FileSerivceImpl fileSerivceImpl;

    @Override
    public void saveDownload(DownloadCountQueryVo downloadCountQueryVo) {
        try {
            Download download = new Download();
            SimpleDateFormat sdf = new SimpleDateFormat("yyyy-MM-dd");
            String hoscode = hospitalFeignClient.getHoscode(downloadCountQueryVo.getHosname());
            download.setDownloadDateBegin(sdf.parse(downloadCountQueryVo.getDownloadDateBegin()));
            download.setDownloadDateEnd(sdf.parse(downloadCountQueryVo.getDownloadDateEnd()));
            download.setHosname(downloadCountQueryVo.getHosname());
            download.setStatus(0);
            download.setHoscode(hoscode);
            download.setIsDeleted(0);
            download.setCreateTime(new Date());
            download.setUpdateTime(new Date());
            baseMapper.insert(download);
        } catch (ParseException e) {
            throw new RuntimeException(e);
        }
    }

    @Override
    public void startDownload() {
        //获取所有的states为未处理的
        QueryWrapper<Download> queryWrapper = new QueryWrapper<>();
        queryWrapper.eq("status", "0");
        List<Download> downloads = baseMapper.selectList(queryWrapper);
        for (Download download : downloads) {
            coreDownload(download);
        }
    }


    @Override
    public void upadteDownload(String fileUrl, Download download, Integer status) {
        download.setStatus(status);
        download.setFileUrl(fileUrl);
        download.setUpdateTime(new Date());
        baseMapper.updateById(download);
    }

    @Override
    public IPage<Download> selectPage(Page<Download> pageParams, DownloadCountQueryVo downloadCountQueryVo) {
        //获取条件值
        String hosname = downloadCountQueryVo.getHosname();
        String downloadDateBegin = downloadCountQueryVo.getDownloadDateBegin();
        String downloadDateEnd = downloadCountQueryVo.getDownloadDateEnd();
        //对条件值进行判断
        QueryWrapper<Download> queryWrapper = new QueryWrapper<>();
        if (!StringUtils.isEmpty(hosname)) {
            queryWrapper.eq("hosname", hosname);
        }
        if (!StringUtils.isEmpty(downloadDateBegin)) {
            queryWrapper.ge("downloadDateBegin", downloadDateBegin);
        }
        if (!StringUtils.isEmpty(downloadDateEnd)) {
            queryWrapper.le("downloadDateEnd", downloadDateEnd);
        }
        //调用mapper方法
        Page<Download> downloadPage = baseMapper.selectPage(pageParams, queryWrapper);
        return downloadPage;
    }


    public void coreDownload(Download download) {
        List<OrderInfo> orderList = orderFeignClient.getDownload(download);
        //把所有订单类转换成映射类开始下载
        List<OrderVo> orderVoList = orderList.stream().map(data -> {
            OrderVo orderVo = new OrderVo();
            BeanUtils.copyProperties(data, orderVo);
            return orderVo;
        }).collect(Collectors.toList());
        //开始写文件
        String fileName = "D:\\BaiduNetdiskDownload\\" + download.getHoscode() + "_" + download.getId() + ".xlsx";
        String file = download.getHoscode() + "_" + download.getId() + ".xlsx";

        log.info(fileName);
        EasyExcel.write(fileName, OrderVo.class).sheet().doWrite(orderVoList);
        String zipFileName = "D:\\BaiduNetdiskDownload\\" + download.getHoscode() + "_" + download.getId() + ".zip";
        String zipName = download.getHoscode() + "_" + download.getId() + ".zip";
        try {
            zip(fileName, zipFileName, file);
            String fileUrl = fileSerivceImpl.uplodad(new File(zipFileName), zipName);
            upadteDownload(fileUrl, download, 1);
        } catch (Exception e) {
            upadteDownload(null, download, 2);
        }
    }


    /**
     * 压缩
     */
    public void zip(String input, String output, String name) throws Exception {
        //要生成的压缩文件
        ZipOutputStream out = new ZipOutputStream(new FileOutputStream(output));
        //支持多个文件压缩在一起
        String[] paths = input.split("\\|");
        File[] files = new File[paths.length];
        byte[] buffer = new byte[1024];
        for (int i = 0; i < paths.length; i++) {
            files[i] = new File(paths[i]);
        }
        for (int i = 0; i < files.length; i++) {
            FileInputStream fis = new FileInputStream(files[i]);
            if (files.length == 1 && name != null) {
                out.putNextEntry(new ZipEntry(name));
            } else {
                out.putNextEntry(new ZipEntry(files[i].getName()));
            }
            int len;
            // 读入需要下载的文件的内容，打包到zip文件
            while ((len = fis.read(buffer)) > 0) {
                out.write(buffer, 0, len);
            }
            out.closeEntry();
            fis.close();
        }
        out.close();
    }
}

public interface DownloadService extends IService<Download> {
    void saveDownload(DownloadCountQueryVo downloadCountQueryVo);

    void startDownload();

    void upadteDownload(String fileUrl, Download download, Integer status);

    IPage<Download> selectPage(Page<Download> pageParams, DownloadCountQueryVo downloadCountQueryVo);
}

这个是Controller我添加了一个前端给一个测试接口,但是在真正的应用场景之下,我们是通过task模块来发送消息,oss模块接受消息,执行job的

@RestController
@RequestMapping("admin/oss")
@Slf4j
public class DownloadApiController {

    @Autowired
    private DownloadService downloadService;


    /**
     * 开启下载任务
     *
     * @param downloadCountQueryVo
     */
    @PostMapping("postDownload")
    public void postDownload(DownloadCountQueryVo downloadCountQueryVo) {
        downloadService.saveDownload(downloadCountQueryVo);
    }

    /**
     * 获取下载中心数据
     *
     * @param
     */
    @GetMapping("{page}/{limit}")
    public Result getDownload(@PathVariable Long page,
                              @PathVariable Long limit,
                              DownloadCountQueryVo downloadCountQueryVo) {
        Page<Download> pageParams = new Page<>(page, limit);
        IPage<Download> pageModel = downloadService.selectPage(pageParams, downloadCountQueryVo);
        return Result.ok(pageModel);
    }

    /**
     * 前端给一个测试接口
     */
    @GetMapping("getTest")
    public void getTest() {
        log.info("下载测试接口");
        downloadService.startDownload();
    }
}

重写了七牛云上传逻辑

public String uplodad(File file, String zipName) {
    try {
        FileInputStream fileInputStream = new FileInputStream(file);
        //构造一个带指定 Region 对象的配置类
        Configuration cfg = new Configuration(Region.region1());
        UploadManager uploadManager = new UploadManager(cfg);
        //默认不指定key的情况下，以文件内容的hash值作为文件名
        String key = null;
        Auth auth = Auth.create(qiniuyun.getAccessKey(), qiniuyun.getSecretKey());
        String upToken = auth.uploadToken(qiniuyun.getBucket());
        String uuid = UUID.randomUUID().toString().replace("-", "");
        String timeUrl = new DateTime().toString("yyyy/MM/dd");
        zipName = timeUrl + "/" + uuid + "_" + zipName;
        Response response = uploadManager.put(fileInputStream, zipName, upToken, null, null);
        //解析上传成功的结果
        DefaultPutRet putRet = new Gson().fromJson(response.bodyString(), DefaultPutRet.class);
        log.info("http://" + qiniuyun.getDomain() + "/" + putRet.key);
        return "http://" + qiniuyun.getDomain() + "/" + putRet.key;
    } catch (QiniuException ex) {
        Response r = ex.response;
        System.err.println(r.toString());
        try {
            System.err.println(r.bodyString());
        } catch (QiniuException ex2) {
            //ignore
        }
    } catch (FileNotFoundException e) {
        throw new RuntimeException(e);
    }

    return null;
}

Hosp模块

写代码的时候发现需要写一个Hosp的client客户机,根据医院名获取医院编号

@PostMapping("inner/getHoscode")
public String getHoscode(@RequestBody String hosname) {
    return hospitalSetService.getHoscode(hosname);
}

    @Override
    public String getHoscode(String hosname) {
        QueryWrapper<HospitalSet> queryWrapper = new QueryWrapper<>();
        queryWrapper.eq("hosname", hosname);
        return baseMapper.selectOne(queryWrapper).getHoscode();
    }

更新了一个Feign获取医院编号的功能

/**
 * 获取医院编号
 */
@GetMapping("/api/hosp/hospital/inner/getHoscode")
public String getHoscode(String hosname);

Order模块

由于我们oss下载的是order数据所有和hosp一样需要在feign中添加一个接口获取这些数据

@PostMapping("inner/getDownload")
public List<OrderInfo> getDownload(@RequestBody Download download) {
    List<OrderInfo> orderInfoList = orderService.getDownload(download);
    return orderInfoList;
}

/**
 * 这个方法就会获取我们需要下载的内容
 * @param download
 * @return
 */
@Override
public List<OrderInfo> getDownload(Download download) {
    QueryWrapper<OrderInfo> queryWrapper = new QueryWrapper();
    queryWrapper.eq("hoscode", download.getHoscode());
    if (!StringUtils.isEmpty(download.getDownloadDateBegin())) {
        queryWrapper.ge("create_time", download.getDownloadDateBegin());
    }
    if (!StringUtils.isEmpty(download.getDownloadDateEnd())) {
        queryWrapper.le("create_time", download.getDownloadDateEnd());
    }
    List<OrderInfo> orderInfoList = baseMapper.selectList(queryWrapper);
    return orderInfoList;
}

更新了一个Feign获取order数据的功能

/**
 * oss模块下载的数据
 * @param download
 * @return
 */
@PostMapping("/api/order/orderInfo/inner/getDownload")
public List<OrderInfo> getDownload(@RequestBody Download download);

Task模块

添加上每分钟执行一次的任务,每分钟发送一次消息来激活oss模块工作

public class ScheduledTask {

    @Autowired
    private RabbitService rabbitService;

    //每天八点执行方法,就医提醒
    //0 0 8 * * ?
    //每第30s开始执行
    @Scheduled(cron = "0 0 8 * * ?")
    public void taskPatient() {
        Date date = new Date();
        SimpleDateFormat sdf = new SimpleDateFormat("yyyy/MM/dd HH:mm");
        log.info("定时任务开始执行" + sdf.format(date));
        rabbitService.sendMessage(MqConst.EXCHANGE_DIRECT_TASK, MqConst.ROUTING_TASK_8, "startPatient");
    }

    /**
     * 定时下载任务
     */
    @Scheduled(cron = "0 */1 * * * ?")
    public void taskDownload() {
        Date date = new Date();
        SimpleDateFormat sdf = new SimpleDateFormat("yyyy/MM/dd HH:mm");
        log.info("定时任务开始执行" + sdf.format(date));
        rabbitService.sendMessage(MqConst.EXCHANGE_DIRECT_TASK, MqConst.ROUTING_TASK_7, "startDownload");
    }
}

前后端联调

跑通第一个逻辑了

现在所有的逻辑都跑通了,但是现在有一个bug就是上传的文件没有扩展名

最后再改进一下给文件名添加一个uuid

具体的功能展示在b站上有视频:https://www.bilibili.com/video/BV1wB4y1p7jk

说明

为什么要这样用mq来激活oss模块,因为一方面把所有的任务都集成到task模块这样可以方便统一管理所有任务,比如在以后我感觉一分钟太慢了,需要5秒执行一次,不至于去oss寻找到底改什么地方,提高了可维护性,另一方面通过延时队列来实现,下载中心的非异步非阻塞,提高了用户的使用1体验,io操作是非常消耗硬件资源的
通过压测软件测试,发现QPS达到1000,同时异常在2%以内