本地搭建hadoop集群-各种报错，不断更新

20180716：

Unable to obtain hostName

java.net.UnknownHostException: hadoop100: hadoop100

解决方案：

vi /etc/hosts 查看集群对应ip 名称

192.168.77.100 master
192.168.77.101 slave1
192.168.77.102 slave2
192.168.77.103 slave3
192.168.77.104 slave4
192.168.77.105 slave5
192.168.77.106 slave6

192.168.77.107 slave7

我使用的机器是100

vi /etc/sysconfig/network 查看本机名称

我的本机名称是 hadoop100 则将 HOSTNAME改为master 即可

NETWORKING=yes

HOSTNAME=master

退出保存。

sync

reboot

在执行命令 

hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.6.jar grep test_input/ test_output 'dfs[a-z.]+

发现可以正常执行，不报错了。

 

20170803

关于hive 

This command is not allowed on an ACID table XXX with a non-ACID 
transaction manager.failed command select * from tb

解决方案

Configuration

Minimally, these configuration parameters must be set appropriately to turn on transaction support in Hive:

Client Side

• hive.support.concurrency – true
• hive.enforce.bucketing – true (Not required as of Hive 2.0)
• hive.exec.dynamic.partition.mode – nonstrict
• hive.txn.manager – org.apache.hadoop.hive.ql.lockmgr.DbTxnManager

Server Side (Metastore)

• hive.compactor.initiator.on – true (See table below for more details)
• hive.compactor.worker.threads – a positive number on at least one instance of the Thrift metastore service

The following sections list all of the configuration parameters that affect Hive transactions and compaction.  Also see Limitations above and Table Properties below.

参考：https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions