Scala编程初级实践-统计学生成绩

给定任何一个如下格式的清单(不同清单里课程数量可能不一样),要求尽可能采用函数式编程,统计出各门课程的平均成绩,最低成绩,和最高成绩;另外还需按男女同学分开,分别统计各门课程的平均成绩,最低成绩,和最高成绩。

学生的成绩清单格式如下所示,第一行为表头,各字段意思分别为学号、性别、课程名1、课程名2等,后面每一行代表一个学生的信息,各字段之间用空格隔开。

Id gender Math English Physics
301610 male 80 64 78
301611 female 65 87 58
301612 female 44 71 77

测试样例1如下:

Id gender Math English Physics
301610 male 80 64 78
301611 female 65 87 58
301612 female 44 71 77
301613 female 66 71 91
301614 female 70 71 100
301615 male 72 77 72
301616 female 73 81 75
301617 female 69 77 75
301618 male 73 61 65
301619 male 74 69 68
301620 male 76 62 76
301621 male 73 69 91
301622 male 55 69 61
301623 male 50 58 75
301624 female 63 83 93
301625 male 72 54 100
301626 male 76 66 73
301627 male 82 87 79
301628 female 62 80 54
301629 male 89 77 72

样例1的统计结果输出为:

course average min max
Math: 69.2 44.0 89.0
English: 71.7 54.0 87.0
Physics: 76.65 54.0 100.0
course average min max (males)
Math: 72.67 50.0 89.0
English: 67.75 54.0 87.0
Physics: 75.83 61.0 100.0
course average min max (females)
Math: 64.0 44.0 73.0
English: 77.63 71.0 87.0
Physics: 77.88 54.0 100.0

测试样例2如下:

Id gender Math English Physics Science
301610 male 72 39 74 93
301611 male 75 85 93 26
301612 female 85 79 91 57
301613 female 63 89 61 62
301614 male 72 63 58 64
301615 male 99 82 70 31
301616 female 100 81 63 72
301617 male 74 100 81 59
301618 female 68 72 63 100
301619 male 63 39 59 87
301620 female 84 88 48 48
301621 male 71 88 92 46
301622 male 82 49 66 78
301623 male 63 80 83 88
301624 female 86 80 56 69
301625 male 76 69 86 49
301626 male 91 59 93 51
301627 female 92 76 79 100
301628 male 79 89 78 57
301629 male 85 74 78 80

样例2的统计结果输出为:

course average min max
Math: 79.0 63.0 100.0
English: 74.05 39.0 100.0
Physics: 73.6 48.0 93.0
Science: 65.85 26.0 100.0
course average min max (males)
Math: 77.08 63.0 99.0
English: 70.46 39.0 100.0
Physics: 77.77 58.0 93.0
Science: 62.23 26.0 93.0
course average min max (females)
Math: 82.57 63.0 100.0
English: 80.71 72.0 89.0
Physics: 65.86 48.0 91.0
Science: 72.57 48.0 100.0

程序代码:

import scala.io.{BufferedSource, Source}
import java.io.{BufferedWriter, FileWriter}
import scala.collection.mutable.ArrayBuffer
object task4 {
  def main(args:Array[String]): Unit = {
    val databuffer:BufferedSource=Source.fromFile("/home/XXX/Desktop/project/src/main/scala/data_one.txt")  //导入文件内容
    val all_data=databuffer.getLines().map{_.split("\\s+")}.toList  //文件内容预处理,"\\s"是字符串正则表达式,将每行按空白字符(包括空格/制表符)分开
    val courseNames = all_data.head.drop(2) //获取第一行中的课程名
    val all_students = all_data.tail  //获取每个学生数据
    val array_sum = ArrayBuffer[Float]() 
    val array_male = ArrayBuffer[Float]()
    val array_female = ArrayBuffer[Float]()
    //存放每个学生成绩
    for (i <- 2 to courseNames.length + 1) {
      for (j <- 0 to all_students.length - 1) {
        array_sum.append(all_students(j)(i).toFloat)
      }
    }
   //存放性别为 male 学生成绩
    for (i <- 2 to courseNames.length + 1) {
      for (j <- 0 to all_students.length - 1) {
        if (all_students(j)(1) == "male")
          array_male.append(all_students(j)(i).toFloat)
      }
    }
   //存放性别为 female 学生成绩
    for (i <- 2 to courseNames.length + 1) {
      for (j <- 0 to all_students.length - 1) {
        if (all_students(j)(1) == "female")
          array_female.append(all_students(j)(i).toFloat)
      }
    }

    val data_one =ArrayBuffer[Float]()
    val data_sum = ArrayBuffer[Float]()
    val number_sum = (array_sum.length / courseNames.length)
    val data_male = ArrayBuffer[Float]()
    val number_male = (array_male.length / courseNames.length)
    val data_female = ArrayBuffer[Float]()
    val number_female = (array_female.length / courseNames.length)
    //将
    def get_data(arrays: ArrayBuffer[Float], data_one: ArrayBuffer[Float], data_two: ArrayBuffer[Float], number: Int): Unit = {
      while (!arrays.isEmpty) {
        for (i <- 0 to number - 1) {
          data_one.append(arrays(i))
        }
        arrays.trimStart(number)
        data_two.append((data_one.sum / data_one.length).formatted("%.2f").toFloat)
        data_two.append(data_one.min.formatted("%.2f").toFloat)
        data_two.append(data_one.max.formatted("%.2f").toFloat)
        data_one.trimEnd(number) 
      }
    }
    // 将结果写入文件中
    val bw=new BufferedWriter(new FileWriter("/home/XXX/Desktop/project/src/main/scala/result_one.txt"))
    get_data(array_sum, data_one, data_sum, number_sum)
    get_data(array_male, data_one, data_male, number_male)
    get_data(array_female, data_one, data_female, number_female)
    bw.write("course average min max"+"\n")
    for (i <- 0 to courseNames.length-1){
      bw.write(courseNames(i)+": ")
      for (j <- 0 to 2) {
        if(j!=2){
          bw.write(data_sum(j).toString+" ")
        }
        else{
          bw.write(data_sum(j).toString+"\n")
        }
      }
      data_sum.trimStart(3)  //去除前三个内容
    }
    bw.write("course average min max (males)" + "\n")
    for (i <- 0 to courseNames.length-1) {
      bw.write(courseNames(i) + ": ")
      for (j <- 0 to 2) {
        if (j != 2) {
          bw.write(data_male(j).toString + " ")
        }
        else {
          bw.write(data_male(j).toString + "\n")
        }
      }
      data_male.trimStart(3)
    }
    bw.write("course average min max (females)" + "\n")
    for (i <- 0 to courseNames.length - 1) {
      bw.write(courseNames(i) + ": ")
      for (j <- 0 to 2) {
        if (j != 2) {
          bw.write(data_female(j).toString + " ")
        }
        else {
          bw.write(data_female(j).toString + "\n")
        }
      }
      data_female.trimStart(3)
    }
    bw.close()
  }
}

运行结果:

在这里插入图片描述

查看结果文件内容:

在这里插入图片描述

  • 4
    点赞
  • 8
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
代码如下: ```scala import org.apache.spark.sql.SparkSession case class Student(s_id: String, s_name: String, s_sex: String, s_birthday: String, s_class: String, s_specialty: String, s_school: String, s_register_time: String) object SparkSqlDemo { def main(args: Array[String]): Unit = { // 1.创建sparkSession对象 val spark = SparkSession.builder() .appName("SparkSqlDemo") .master("local[*]") .getOrCreate() // 2.读取数据 val studentRDD = spark.sparkContext.textFile("path/to/student.txt") // 3.切分每一行 val studentInfo = studentRDD.map(_.split(",")) // 4.RDD关联Student val students = studentInfo.map(x => Student(x(0), x(1), x(2), x(3), x(4), x(5), x(6), x(7))) // 5.将RDD转换成DataFrame val studentDF = students.toDF() // 6.将DataFrame注册成表 studentDF.createOrReplaceTempView("student") // 7.操作student表,按照年龄进行降序排列 val resultDF = spark.sql("select * from student order by s_birthday desc") // 8.把结果保存在mysql表中 val props = new java.util.Properties props.setProperty("user", "username") props.setProperty("password", "password") resultDF.write.mode("overwrite").jdbc("jdbc:mysql://localhost:3306/test", "student", props) spark.stop() } } ``` 其中,需要将 `path/to/student.txt` 替换为实际的文件路径,将 `username` 和 `password` 替换为实际的 MySQL 用户名和密码,将 `jdbc:mysql://localhost:3306/test` 替换为实际的 MySQL 数据库地址和数据库名。在写入 MySQL 时,我们使用了 `overwrite` 模式,表示如果表已经存在则覆盖,这样可以保证每次运行程序都能得到相同的结果。

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值