Hadoop
123 黑曼巴
黑曼巴
展开
-
pulsar常用命令
#创建安全认证keybin/pulsar tokens create-secret-key --output data/admin-secret.key#创建角色,生成tokenbin/pulsar tokens create --secret-key data/admin-secret.key --subject pulsaradmin################################################################################原创 2022-02-23 14:29:24 · 1149 阅读 · 0 评论 -
hadoop单机环境搭建
#配置Java环境变量export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home#配合Hadoop homeexport HADOOP_HOME=/Users/yangyijun/workspace/soft/hadoop#设置Hadoop配置文件路径export HADOOP_CONF_DIR=/Users/yangyijun/workspace/soft/hadoop/etc/hadoop原创 2022-02-19 20:25:01 · 960 阅读 · 0 评论 -
hadoop源码之DatanodeProtocol
/** * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this work for additional information * regarding copyright ownership. The ASF licenses this file * to y原创 2021-07-24 23:01:48 · 167 阅读 · 0 评论 -
编译Hadoop源码
1.参考地址https://github.com/apache/hadoop/blob/trunk/BUILDING.txtBuild instructions for Hadoop----------------------------------------------------------------------------------Requirements:* Unix System* JDK 1.8* Maven 3.3 or later* Boost 1.72 (if c原创 2021-07-24 21:44:07 · 432 阅读 · 0 评论 -
数据湖&数据仓库
待完善原创 2021-06-18 21:06:18 · 76 阅读 · 0 评论 -
hdfs federation
待完善原创 2021-06-18 21:02:15 · 70 阅读 · 0 评论 -
yarn服务监控
待完善原创 2021-06-18 21:00:31 · 198 阅读 · 0 评论 -
hdfs服务监控
待完善原创 2021-06-18 20:59:18 · 540 阅读 · 0 评论 -
Hive参数性能调优
yarn.nodemanager.resource.memory-mb 65536 --设置nodemanager分配给yarn的可用内存yarn.nodemanager.resource.cpu-vcores 40 --设置nodemanager分配给yarn的可用虚拟CPUyarn.nodemanager.vmem-pmem-ratio 2.1 --虚拟内存比例yarn.scheduler.maximum-allocation-mb 65536 .原创 2020-06-07 13:25:02 · 9033 阅读 · 1 评论 -
Hadoop平台 以Parcel包安装CDH
请参考地址:http://note.youdao.com/noteshare?id=538ef19d27a67050d041363486d01ae1原创 2020-04-19 16:38:02 · 390 阅读 · 0 评论
分享