Distributed
文章平均质量分 66
magic_dreamer
这个作者很懒,什么都没留下…
展开
-
hadoop(1)Quick Guide to Hadoop on Ubuntu
hadoop(1)Quick Guide to Hadoop on UbuntuThe Apache Hadoop software library scale up from single servers to thousands of machines, each offering local computation and storage.Subprojects:Hado...原创 2012-06-09 15:29:55 · 298 阅读 · 0 评论 -
hadoop(2)The version hadoop 0.23.0 on Ubuntu
hadoop(2)The version hadoop 0.23.0 on Ubuntu1. Single NodeMapreduce Tarball>mvn clean install -DskipTests>cd hadoop-mapreduce-project>mvn clean install assembly:assembly -Pnative -DskipTes...原创 2012-06-09 15:30:37 · 99 阅读 · 0 评论 -
Zookeeper(1)Introduction and Install on Win7
Zookeeper(1)Introduction and Install on Win71. OverviewZookeeper is a high-performance coordination service for distributed applications.2. Install the Zookeeper on win7I download the late...原创 2012-06-09 15:32:54 · 154 阅读 · 0 评论 -
Zookeeper(2)Solve the Problem on Redhat
Zookeeper(2)Solve the Problem on RedhatI happened to see the log message on Zookeeper/conf/zookeeper.out file.The 3 nodes are keeping try to syncnized other nodes. But they got the timeout mes...原创 2012-06-09 17:02:44 · 180 阅读 · 0 评论 -
Kafka(1)Install on Redhat and Try Java Client
Kafka(1)Install on Redhat and Try Java Client1. Install and Try Kafka>wget http://people.apache.org/~nehanarkhede/kafka-0.7.0-incubating/kafka-0.7.0-incubating-src.tar.gz>tar zxvf kafka-0.7.0-...原创 2012-06-18 17:45:22 · 60 阅读 · 0 评论 -
Kafka(2)Install ubuntu and Try more JAVA client
Kafka(2)Install ubuntu and Try more JAVA client1. Try to setup this on windows.download and install this filehttp://scalasbt.artifactoryonline.com/scalasbt/sbt-native-packages/org/scala-sbt/sb...原创 2012-06-18 17:45:50 · 71 阅读 · 0 评论 -
RabbitMQ(1)Install on Redhat
RabbitMQ(1)Install on RedhatFirst of all, I tried to install this software on redhat. I choose the general unix way to do that.1. Check my yum>yum --version2.0.7>python -V2.3.4upda...原创 2012-06-21 17:44:23 · 103 阅读 · 0 评论 -
RabbitMQ(2)Install RabbitMQ on win7/Ubuntu
RabbitMQ(2)Install RabbitMQ on win7/Ubuntu1. Install on Windows1.1 Install erlangdownload the windows install file here: http://www.erlang.org/download/otp_win64_R15B01.exeInstall this file ...原创 2012-06-25 09:49:47 · 78 阅读 · 0 评论 -
Comet-Jetty(3)Update the Sample
Comet-Jetty(3)Update the SampleTry the sample project cometd-demoerror message when import this to eclipse:Plugin execution not covered by lifecycle configuration:org.apache.felix:maven-buil...原创 2012-06-26 22:52:02 · 84 阅读 · 0 评论 -
RabbitMQ(4)Java Client - Hello World-Work Queue
RabbitMQ(4)Java Client - Hello World-Work QueueRabbitMQ is a message broker, accepts and forwards messages.1. RabbitMQ jargonProducing - A program that sends messages is a producer.Queue -...原创 2012-07-03 11:06:57 · 127 阅读 · 0 评论 -
RabbitMQ(5)Java Client - Publish/Subscribe
RabbitMQ(5)Java Client - Publish/SubscribeWe will deliver the messages to multiple consumers. This pattern is known as "publish/subscribe".ExchangesThe Producer will not directly contact to ...原创 2012-07-03 15:59:50 · 122 阅读 · 0 评论 -
RabbitMQ(6)Java Client - Routing
RabbitMQ(6)Java Client - RoutingBindingsA binding is a relationship between an exchange and a queue. This can be simply read as: the queue is interested in messages from this exchange.channe...原创 2012-07-05 23:01:16 · 69 阅读 · 0 评论 -
RabbitMQ(7)Java Client - Topics
RabbitMQ(7)Java Client - TopicsAlthough using the direct exchange improved our system, it still has limitations - it can't do routing based on multiple criteria.We want to subscribe to not onl...原创 2012-07-06 10:04:20 · 93 阅读 · 0 评论 -
RabbitMQ(8)Java Client - Remote Procedure Call(RPC)
RabbitMQ(8)Java Client - Remote Procedure Call(RPC)We need to run a function on a remote computer and wait for the result. This pattern is commonly known as Remote Procedure Call or RPC.Callba...原创 2012-07-09 15:17:48 · 168 阅读 · 0 评论 -
Comet-Jetty(4)Read the Source Codes and Refactor the Project
Comet-Jetty(4)Read the Source Codes and Refactor the Project1. Find resourcesInstall the source to my repository, then it is easy for me to read the source codes.>mvn -DskipTests=true source:j...原创 2012-07-09 16:46:09 · 92 阅读 · 0 评论 -
Thrift(1)Installation on win7/CentOS/Ubuntu
Thrift(1)Installation on win7/CentOS/Ubuntu1. win7download the binary file from here http://thrift.apache.org/download/http://www.fayea.com/apache-mirror/thrift/0.8.0/thrift-0.8.0.execopy ...原创 2012-07-09 22:55:51 · 62 阅读 · 0 评论 -
Thrift(2)RMI Strategy Sample
Thrift(2)RMI Strategy SampleRMI is short for remote method invocation. It is easy to use it in java world.But it is complex to go through the firewall. And the language is limited to java....原创 2012-07-10 17:41:40 · 105 阅读 · 0 评论 -
Thrift(3)IDL language/Structure and Generate Base Codes
Thrift(3)IDL language/Structure and Generate Base CodesRMI use java seserial to transfer the java object data.Thrift, same interface and implementation, but it use socket to transfer the data, a...原创 2012-07-11 16:05:03 · 211 阅读 · 0 评论 -
Thrift(4)Java Server and Client
Thrift(4)Java Server and Client1. First, I did a Implementation class for BlogService Interfacepackage com.sillycat.easytalker.plugins.thrift.business;import java.util.ArrayList;import jav...原创 2012-07-12 13:02:36 · 79 阅读 · 0 评论 -
MINA(1)Chain and Observer Basic Theory
MINA(1)Chain and Observer Basic TheoryBefore, I just demo the MINA and use spring to integrate the MINA in my web application.I learn MINA from others' blog, start from the basic design ideas....原创 2012-07-16 18:47:16 · 121 阅读 · 0 评论 -
MINA(2)Producer Consumer and Encode
MINA(2)Producer Consumer and Encode1. Producer and Consumer, Threads poolThreads Pool Examplepackage com.sillycat.easynio.plugins.mina.threadpool;public class Worker implements Runnable {...原创 2012-07-16 18:48:05 · 76 阅读 · 0 评论 -
MINA(3)Understand MINA2 and Calculate Spring Example
MINA(3)Understand MINA2 and Calculate Spring Example1. Processread in data --------> IoAcceptorwrite out data IoConnector ----------> Thread Pool(IoProcessor) --------> IoFilte...原创 2012-07-16 22:57:46 · 84 阅读 · 0 评论 -
MINA(4)JMX with Spring
MINA(4)JMX with SpringUsing JMX with Spring Bean, here is my spring bean CaculateImpl, this may be my business logic bean.package com.sillycat.easynio.plugins.jmx;public class CaculateImpl i...原创 2012-07-30 06:14:55 · 108 阅读 · 0 评论 -
Cassandra Database(1)Begin from the GettingStarted
Cassandra Database(1)Begin from the GettingStarted1. Data Model IntroductionCOLUMN name value timestamp SUPERCOLUMN name, value [ NAME1 : COLUMN1, NAME2 : COLUMN2, ...]COLUMNFAMILY RDB...原创 2013-05-17 03:32:14 · 101 阅读 · 0 评论 -
Spark(1)Introduction and Installation
Spark(1)Introduction and Installation1. Introduction1.1 MapReduce ModelMap -- read, convertReduce -- calculate4 classesRead and Convert data to key-value, Map, Reduce, Convert and outp...原创 2013-05-17 22:45:34 · 113 阅读 · 0 评论 -
Spray(10)REST API Project - DAO Layer
Spray(10)REST API Project - DAO Layer8. Prepare the DB first8.1 H2 databaseIf we want to use this database in embedded mode, we will do as follow:Add the h2*.jar to the class pathUse the J...原创 2013-05-21 02:37:44 · 124 阅读 · 0 评论 -
Spark(2)SBT and Spark Shell in Quick Start
Spark(2)SBT and Spark Shell in Quick Start1. Make SBT do the things like MVN INSTALLWhen I run the command>sudo sbt publish-localSBT will publish all the jar and other files to for example:...原创 2013-05-21 03:07:43 · 164 阅读 · 0 评论 -
Spray(1)Read Documents about Spray
Spray(1)Read Documents about SpraySpray is a suite of libraries based on Scala and Akka.Modules we are using in our project:spray-can HTTP server and client built on top of spray-IO.ht...原创 2013-01-09 00:35:53 · 154 阅读 · 0 评论 -
Spray(2)spray-can
Spray(2)spray-canPrepare the Sample codes>git clone https://github.com/spray/spray.git>cd sprayAnd we can run both the 2 examples like this:>sbt "project simple-http-client" ru...原创 2013-01-09 06:16:59 · 215 阅读 · 0 评论 -
Spray(3)spray-routing
Spray(3)spray-routingThe spray-routing module provides a high-level, very flexible routing DSL for RESTful web services. Normally I will use it either on top of a spray-can HttpServer or inside ...原创 2013-01-10 04:35:14 · 190 阅读 · 0 评论 -
Slick(1)Introduce and Documents
Slick(1)Introduce and DocumentsThe current release is Slick 0.11.2 for Scala 2.10.0-RC1.Supported database systemsNo Oracle butDerby/JavaDBH2HSQLDB/HyperSQLMicrosoft Access...原创 2013-01-10 06:46:04 · 119 阅读 · 0 评论 -
Slick(2)3 Working Types
Slick(2)3 Working Types1. Lifted EmbeddingThe name Lifted Embedding refers to the fact that you are not working with Standard Scala types, but with types that are lifted into a scala.sclick.lift...原创 2013-01-11 05:27:35 · 85 阅读 · 0 评论 -
Akka(1)Introduction
Akka(1)Introduction1. Introduction1.1 What is Akka?Design to write correct concurrent, fault-tolerant and scalable applications.Akka implements a unique hybridActorsSimple and high-lev...原创 2013-01-11 06:59:30 · 146 阅读 · 0 评论 -
Spray(4)spray-json
Spray(4)spray-jsonInstallationIt is available from the repository and based on sbt."spray repo" at "http://repo.spray.io/","io.spray" % "spray-json_2.10" ...原创 2013-01-11 12:25:12 · 345 阅读 · 0 评论 -
Akka(2)Start with first Project - First Part
Akka(2)Start with first Project - First PartUse actor to calculate the value of Pi.Create the projectInstall the Typesafe akka-scala-sbt project template first.Try to get the scala akka pr...原创 2013-01-12 03:30:31 · 169 阅读 · 0 评论 -
Akka(3)Start with first Project - Second Part
Akka(3)Start with first Project - Second PartCreating the result Listener class Listener extends Actor { // Everything is Actor def receive = { case PiApproximation(pi, duration) =>...原创 2013-01-12 04:07:52 · 84 阅读 · 0 评论 -
Using Git Flow based on Github
Using Git Flow based on Github1. Install git-flow>sudo port install git-flow2. First configuration>git flow init>git flow initWhich branch should be used for bringing forth production re...原创 2013-01-16 11:50:04 · 131 阅读 · 0 评论 -
Redis(7)Creating and Using Cluster Mode
Redis(7)Creating and Using Cluster Mode1. DocumentsCluster will not support SELECT, it only contains database 0.All the nodes use TCP bus and binary protocol to communicate. Every node connect to cl...原创 2014-05-02 05:49:36 · 111 阅读 · 0 评论 -
Couchbase(1)Introduction and Installation
Couchbase(1)Introduction and Installation1. DocumentsCouchdb + Membase = CouchbaseSmart Clientload all the node information, decide which node to connect and fetch data.vBucket - auto shardingImprovem...原创 2014-05-03 03:18:03 · 135 阅读 · 0 评论 -
RabbitMQ(10)Update Version and Cluster Configuration
RabbitMQ(10)Update Version and Cluster Configuration1. Installation and Update CheckCheck the erlang version first>erl -versionErlang (SMP,ASYNC_THREADS,HIPE) (BEAM) emulator version 5.10.4I have t...原创 2014-05-14 03:34:07 · 115 阅读 · 0 评论