presto集群部署

presto集群规划
train01:调度节点
train01~train04:worker节点


train01~train04:
1. 下载presto-server-0.100.tar.gz之各个服务器节点的/opt
2. tar zxvf presto-server-0.100.tar.gz
3. cd presto-server-0.100
mkdir etc
cd etc
节点既作为coordinator，也作为worker
brain01
vi config.properties 
coordinator=true
node-scheduler.include-coordinator=true
http-server.http.port=8080
task.max-memory=1GB
discovery-server.enabled=true
discovery.uri=http://10.10.0.144:8080


仅仅作为worker：
train02~train04
vi config.properties
coordinator=false
http-server.http.port=8080
query.max-memory=1GB
discovery.uri=http://10.10.0.144:8080


vi node.properties
node.environment=production
node.id=ffffffff-ffff-ffff-ffff-ffffffffff01~04
node.data-dir=/var/presto/data


mkdir -p /var/presto/data


vi jvm.config
-server
-Xmx16G
-XX:+UseConcMarkSweepGC
-XX:+ExplicitGCInvokesConcurrent
-XX:+CMSClassUnloadingEnabled
-XX:+AggressiveOpts
-XX:+HeapDumpOnOutOfMemoryError
-XX:OnOutOfMemoryError=kill -9 %p
-XX:ReservedCodeCacheSize=150M


vi log.properties
com.facebook.presto=DEBUG


mkdir catalog #即 etc/catalog
cd catalog
vi jmx.properties
connector.name=jmx
vi hive.properties
connector.name=hive-cdh5
hive.metastore.uri=thrift://10.10.0.144:9083
hive.config.resources=/etc/hadoop/conf/core-site.xml, /etc/hadoop/conf/hdfs-site.xml
hive.allow-drop-table=true


启动presto集群
bin/launcher start


wget https://repo1.maven.org/maven2/com/facebook/presto/presto-cli/0.100/presto-cli-0.100-executable.jar
mv presto-cli-0.100-executable.jar presto
chmod 755 presto.jar
./presto --server 10.10.0.144:8080 --catalog hive --schema default