1. 安装 jdk ,maven
如果有openjdk 先卸载,然后安装oracle jdk 6+
java ,maven环境变量配置
export JAVA_HOME=/usr/local/java/jdk1.8.0_111 export PATH=$JAVA_HOME/bin:$PATH export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar export MAVEN_HOME=/usr/local/maven/apache-maven-3.3.9 export PATH=$MAVEN_HOME/bin:$PATH
2. 安装zookeeper
3. 安装Storm
centOS安装ZeroMQ所需组件及工具:
yum install gcc
yum install gcc-c++
yum install make
yum install uuid-devel
yum install libuuid-devel
yum install libtool
安装zeromq以及jzmq:
下载zeromq-4.1.6
tar zxf zeromq-4.1.6.tar.gz
cd zeromq-4.1.6
./configure
make
make install
ldconfig (更新LD_LIBRARY_PATH)zeromq安装完成。
安装jzmq: (提前安装好java)
yum install git
git clone git://github.com/nathanmarz/jzmq.git
cd jzmq
./autogen.sh
./configure
make
make install
(若在make时出现错误:touch src/classdist_noinst.stamp 进入src目录,手动编译相关java代码
javac -d . org/zeromq/*.java )安装Storm:我这里安装的是最新版apache-storm-1.0.0(注意:这里是1.0.0,如果更高得版本,可能配置上有所差别)
解压缩之后,移到到/opt目录下面。在/opt/apache-storm-1.0.0/conf下配置storm.yaml文件。因为暂时在单机伪storm集群运行,所有配置如下:(集群配置后续补充上来)
######### These MUST be filled in for a storm configuration storm.zookeeper.servers: - "localhost" # - "server2" # nimbus.host: "localhost" # nimbus.seeds: ["host1", "host2", "host3"] # # storm.local.dir: "/home/smurf/storm"
接下来运行storm的一些命令:
nohup ./storm nimbus & (启动storm控制进程) nohup ./storm ui & (启动storm的ui监控界面,ui界面进程必须与控制进程在同一台机器) nohup ./storm supervisor & (启动storm的工作进程)
通过http://localhost:8080/可以直接访问Storm UI。如下图所示:
干掉nimbus相关进程:
kill `ps aux | egrep '(daemon\.nimbus)|(storm\.ui\.core)' | fgrep -v egrep | awk '{print $2}'`
干掉supervisor上所有storm进程:
kill `ps aux | fgrep storm | fgrep -v 'fgrep' | awk '{print $2}'`