Silver_Sword-CSDN博客

原创配置yum源

1.备份当前服务器yum.repos.d文件cp -r /etc/yum.repos.d /etc/yum.repos.d.bak2.删除yum.repos.d文件rm -r /etc/yum.repos.d/*3.重新编写yum.repos.d文件（/* */ 中是内容，只粘贴内容即可）vim /etc/yum.repos.d/media.repo/*[developme...

2020-03-03 18:52:11 150

原创 Utils：工具类十八般武艺——小试牛刀

package com.MC.utilsimport java.text.SimpleDateFormatimport java.util.regex.Patternimport scala.util.control.Breaks._import java.math.BigDecimalimport java.util.Calendarimport com.MC.enum.Da...

2018-08-28 09:21:05 185

原创 Tomcat8080被占用：解决方法

今天我使用idea运行自己写的一个Web端数据可视化的maven小项目然后测试启动Tomcat的时候忘记关了，然后就一直8080和1099正在被使用，给我气炸了。解决方法如下： 1.win键+R进入然后cmd进入dos窗口， 2.Windows dos界面查看Tomcat端口命令:netstat -ano|findstr 80803.终止To...

2018-08-15 22:05:48 1129 2

原创 Kafka报错：org.apache.flume.ChannelException: Take failed due to IO error [channel=c1]

2018-08-09 11:32:06,186 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.channel.file.LogFile$RandomReader.checkOut(LogFile.java:560)] Opening /home/bigdata/flume/data/log-2 fo...

2018-08-09 23:30:48 2326

原创 Spark-CheckPoint

import org.apache.spark.{SparkConf, SparkContext}/** * Created by MC on 2018/6/11. * CheckPoint是为RDD增加检查点而实现的容错机制 *本文介绍的是给一个Spark的WordCount程序添加检查点 */object CheckPointTest { def WordCount(...

2018-06-11 20:36:18 188

原创 Spark-Persist

import org.apache.spark.{SparkConf, SparkContext}/** * Created by MC on 2018/6/11. * 本文介绍将程序加载到内存 * */object PersisTest { def WordCount(sc : SparkContext): String ={ val start = Syste...

2018-06-11 20:35:28 405

原创 SecondSort_Java

import org.apache.spark.SparkConf;import org.apache.spark.SparkContext;import org.apache.spark.api.java.JavaPairRDD;import org.apache.spark.api.java.JavaSparkContext;import org.apache.spark.api.ja...

2018-06-06 18:41:26 195

原创 ThirdSort_scala

import org.apache.spark.rdd.RDDimport org.apache.spark.{SparkConf, SparkContext}/** * Created by MC on 2018/6/6. * 三次排序 */object SecondSort { def myThirdSort(sc : SparkContext): String ={...

2018-06-06 11:28:53 147

原创 SortByKey_scala

import org.apache.spark.rdd.RDDimport org.apache.spark.{SparkConf, SparkContext}/** * Created by MC on 2018/6/6. * 二次排序 */object SecondSort { def mySecondSort(sc : SparkContext): String ={ ...

2018-06-06 11:20:34 355

原创 scala -WordCount

import org.apache.spark.rdd.RDDimport org.apache.spark.{SparkConf, SparkContext}/** * Created by MC on 2018/6/1. */object WordCount { def main(args: Array[String]): Unit = { val conf = n...

2018-06-04 20:28:38 349

原创隐式实现购买火车票

import scala.util.Random/** * Created by MC on 2018/5/17. * desc: 卖票系统 * 普通人窗口、特殊人群窗口 * 1.特殊人群窗口：小孩、老人、老师、学生 * 2.普通人群窗口：年轻人 *///人群class SpecialPerson(name:String,age:Int){ def getName...

2018-05-17 14:23:48 179

Silver_Sword的博客