![](https://img-blog.csdnimg.cn/20201014180756913.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
spark
文章平均质量分 51
冰冷热带鱼
这个作者很懒,什么都没留下…
展开
-
KUDU学习笔记-spark-kudu
启动kuducd /etc/init.d/—启动master[hadoop@hadoop000 init.d]$ sudo ./kudu-master startStarted Kudu Master Server (kudu-master): [ OK ]—启动tserver[hadoop@hadoop000 init.d]$ sudo ./kudu-tserver startStarted Kudu Tablet Server (kudu-tserve原创 2022-01-16 10:10:42 · 1523 阅读 · 0 评论 -
Spark 学习笔记——001【spark-mysql+spark-hive】
在本地提交 spark-submit./bin/spark-submit –class test001 –master local /home/hadoop/jars/com.imooc.bigdata-2.0.jar /home/hadoop/data/84-0.txt /home/hadoop/data/result./bin/spark-submit –class test001 –master yarn –name test001 /home/hadoop/jars/com.原创 2021-12-12 19:57:57 · 1638 阅读 · 0 评论 -
流计算项目实战【KAFKA+FLUME+SPARKSTRAMING+HBASE】
1、 使用python 造数据#!/usr/bin/env python# coding: utf-8# In[1]:import randomimport time# In[2]:url_paths=[ "/class/112.html", "/class/132.html", "/class/146.html", "/class/177.html", "/class/212.html", "/class/342.html",原创 2021-01-23 14:27:44 · 238 阅读 · 0 评论 -
spark -core 统计每个省份的点击量
package rdd.builderimport org.apache.spark.{SparkConf, SparkContext}object case_sortby { def main(args: Array[String]): Unit = { //构建环境参数 val conf = new SparkConf().setAppName("guanggao_top3").setMaster("local[*]") //构建环境 val sc =原创 2020-12-13 23:55:55 · 433 阅读 · 0 评论