CentOS 7 安装 Storm 0.9.3

    xiaoxiao2021-03-25  71

    1. 安装 jdk ,maven

    如果有openjdk 先卸载,然后安装oracle jdk 6+

    java ,maven环境变量配置

    export JAVA_HOME=/usr/local/java/jdk1.8.0_111 export PATH=$JAVA_HOME/bin:$PATH  export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar export MAVEN_HOME=/usr/local/maven/apache-maven-3.3.9 export PATH=$MAVEN_HOME/bin:$PATH

    2. 安装zookeeper

    3. 安装Storm

    centOS安装ZeroMQ所需组件及工具:

    yum install gcc

    yum install gcc-c++

    yum install make

    yum install uuid-devel

    yum install libuuid-devel

    yum install libtool

    安装zeromq以及jzmq:

    下载zeromq-4.1.6

    tar zxf zeromq-4.1.6.tar.gz

     cd zeromq-4.1.6

    ./configure

    make

    make install

    ldconfig (更新LD_LIBRARY_PATH)zeromq安装完成。

    安装jzmq: (提前安装好java)

    yum install git

     git clone git://github.com/nathanmarz/jzmq.git

    cd jzmq

    ./autogen.sh

    ./configure

    make

    make install

    (若在make时出现错误:touch src/classdist_noinst.stamp 进入src目录,手动编译相关java代码 

    javac -d . org/zeromq/*.java   )

    安装Storm:我这里安装的是最新版apache-storm-1.0.0(注意:这里是1.0.0,如果更高得版本,可能配置上有所差别)

    解压缩之后,移到到/opt目录下面。在/opt/apache-storm-1.0.0/conf下配置storm.yaml文件。因为暂时在单机伪storm集群运行,所有配置如下:(集群配置后续补充上来)

    ######### These MUST be filled in for a storm configuration storm.zookeeper.servers: - "localhost" # - "server2" # nimbus.host: "localhost" # nimbus.seeds: ["host1", "host2", "host3"] # # storm.local.dir: "/home/smurf/storm"

    接下来运行storm的一些命令:

    nohup ./storm nimbus & (启动storm控制进程) nohup ./storm ui & (启动storm的ui监控界面,ui界面进程必须与控制进程在同一台机器) nohup ./storm supervisor & (启动storm的工作进程)

    通过http://localhost:8080/可以直接访问Storm UI。如下图所示:

     干掉nimbus相关进程:

    kill `ps aux | egrep '(daemon\.nimbus)|(storm\.ui\.core)' | fgrep -v egrep | awk '{print $2}'`

    干掉supervisor上所有storm进程:

    kill `ps aux | fgrep storm | fgrep -v 'fgrep' | awk '{print $2}'`

    转载请注明原文地址: https://ju.6miu.com/read-34098.html

    最新回复(0)