cdh4.2.1参数设置

0、linux内核参数

vm.swappiness

cat /proc/sys/vm/swappiness

默认是60，推荐修改成0

sysctl -w vm.swappiness=0 

1、mapreduce

Shuffle Handler

for yarn：

mapreduce.shuffle.manage.os.cache 默认开启的，true

mapreduce.shuffle.readahead.bytes 默认是4M

for mr1：

mapred.tasktracker.shuffle.fadvise 默认开启的，true

 mapred.tasktracker.shuffle.readahead.bytes 默认是4M

IFile Reader

mapreduce.ifile.readahead  默认开启的，true

mapreduce.ifile.readahead.bytes 默认是4M

Send a heartbeat as soon as a task finishes

mapreduce.tasktracker.outofband.heartbeat 设置成true，默认是false

Reduce the interval for JobClient status reports on single node systems

<property>
    <name>jobclient.progress.monitor.poll.interval</name>
    <value>10</value>
</property>

Tune the JobTracker heartbeat interval

<property>
    <name>mapreduce.jobtracker.heartbeat.interval.min</name>
    <value>10</value>
</property>

Start MapReduce JVMs immediately

<property>
    <name>mapred.reduce.slowstart.completed.maps</name>
    <value>0</value>
</property>

2、hdfs

Improve Performance for Local Reads

<property>
    <name>dfs.client.read.shortcircuit</name>
    <value>true</value>
</property>
<property>
    <name>dfs.domain.socket.path</name>
    <value>/var/run/hadoop-hdfs/dn._PORT</value>
</property>