165 lines
No EOL
11 KiB
HTML
165 lines
No EOL
11 KiB
HTML
<!DOCTYPE html>
|
||
<html>
|
||
<head>
|
||
<meta charset="utf-8">
|
||
<meta name="tool" content="leanote-desktop-app">
|
||
<title>Storm分布式集群安装</title>
|
||
<style>
|
||
|
||
*{font-family:"lucida grande","lucida sans unicode",lucida,helvetica,"Hiragino Sans GB","Microsoft YaHei","WenQuanYi Micro Hei",sans-serif;}
|
||
|
||
body {
|
||
margin: 0;
|
||
}
|
||
|
||
/*公用文字样式*/
|
||
h1{font-size:30px}h2{font-size:24px}h3{font-size:18px}h4{font-size:14px}
|
||
.note-container{
|
||
width:850px;
|
||
margin:auto;
|
||
padding: 10px 20px;
|
||
box-shadow: 1px 1px 10px #eee;
|
||
}
|
||
#title {
|
||
margin: 0;
|
||
}
|
||
table {
|
||
margin-bottom: 16px;
|
||
border-collapse: collapse;
|
||
}
|
||
table th, table td {
|
||
padding: 6px 13px;
|
||
border: 1px solid #ddd;
|
||
}
|
||
table th {
|
||
font-weight: bold;
|
||
}
|
||
|
||
table tr {
|
||
background-color: none;
|
||
border-top: 1px solid #ccc;
|
||
}
|
||
table tr:nth-child(2n) {
|
||
background-color: rgb(247, 247, 249);
|
||
}
|
||
.mce-item-table, .mce-item-table td, .mce-item-table th, .mce-item-table caption {
|
||
border: 1px solid #ddd;
|
||
border-collapse: collapse;
|
||
padding: 6px 13px;
|
||
}
|
||
blockquote {
|
||
border-left-width:10px;
|
||
background-color:rgba(128,128,128,0.05);
|
||
border-top-right-radius:5px;
|
||
border-bottom-right-radius:5px;
|
||
padding:15px 20px;
|
||
border-left:5px solid rgba(128,128,128,0.075);
|
||
}
|
||
blockquote p {
|
||
margin-bottom:1.1em;
|
||
font-size:1em;
|
||
line-height:1.45
|
||
}
|
||
blockquote ul:last-child,blockquote ol:last-child {
|
||
margin-bottom:0
|
||
}
|
||
pre {
|
||
padding: 18px;
|
||
background-color: #f7f7f9;
|
||
border: 1px solid #e1e1e8;
|
||
border-radius: 3px;
|
||
display: block;
|
||
}
|
||
code {
|
||
padding: 2px 4px;
|
||
font-size: 90%;
|
||
color: #c7254e;
|
||
white-space: nowrap;
|
||
background-color: #f9f2f4;
|
||
border-radius: 4px;
|
||
}
|
||
.footnote {
|
||
vertical-align: top;
|
||
position: relative;
|
||
top: -0.5em;
|
||
font-size: .8em;
|
||
}
|
||
|
||
hr {
|
||
margin:2em 0
|
||
}
|
||
img {
|
||
max-width:100%
|
||
}
|
||
pre {
|
||
word-break:break-word
|
||
}
|
||
p,pre,pre.prettyprint,blockquote {
|
||
margin:0 0 1.1em
|
||
}
|
||
hr {
|
||
margin:2em 0
|
||
}
|
||
img {
|
||
max-width:100%
|
||
}
|
||
.sequence-diagram,.flow-chart {
|
||
text-align:center;
|
||
margin-bottom:1.1em
|
||
}
|
||
.sequence-diagram text,.flow-chart text {
|
||
font-size:15px !important;
|
||
font-family:"Source Sans Pro",sans-serif !important
|
||
}
|
||
.sequence-diagram [fill="#ffffff"],.flow-chart [fill="#ffffff"] {
|
||
fill:#f6f6f6
|
||
}
|
||
.sequence-diagram [stroke="#000000"],.flow-chart [stroke="#000000"] {
|
||
stroke:#3f3f3f
|
||
}
|
||
.sequence-diagram text[stroke="#000000"],.flow-chart text[stroke="#000000"] {
|
||
stroke:none
|
||
}
|
||
.sequence-diagram [fill="#000"],.flow-chart [fill="#000"],.sequence-diagram [fill="#000000"],.flow-chart [fill="#000000"],.sequence-diagram [fill="black"],.flow-chart [fill="black"] {
|
||
fill:#3f3f3f
|
||
}
|
||
ul,ol {
|
||
margin-bottom:1.1em
|
||
}
|
||
ul ul,ol ul,ul ol,ol ol {
|
||
margin-bottom:1.1em
|
||
}
|
||
kbd {
|
||
padding:.1em .6em;
|
||
border:1px solid rgba(63,63,63,0.25);
|
||
-webkit-box-shadow:0 1px 0 rgba(63,63,63,0.25);
|
||
box-shadow:0 1px 0 rgba(63,63,63,0.25);
|
||
font-size:.7em;
|
||
font-family:sans-serif;
|
||
background-color:#fff;
|
||
color:#333;
|
||
border-radius:3px;
|
||
display:inline-block;
|
||
margin:0 .1em;
|
||
white-space:nowrap
|
||
}
|
||
.toc ul {
|
||
list-style-type:none;
|
||
margin-bottom:15px
|
||
}
|
||
</style>
|
||
<!-- 该css供自定义样式 -->
|
||
<link href="../leanote-html.css" rel="stylesheet">
|
||
</head>
|
||
|
||
<body>
|
||
|
||
<div class="note-container">
|
||
<h1 class="title" id="leanote-title">Storm分布式集群安装</h1>
|
||
<div class="content-html" id="leanote-content"><div>拓扑图</div><div><img id="__LEANOTE_D_IMG_1479696623823" src="http://192.168.56.4:9000/api/file/getImage?fileId=583260f023eeeb0f8f0000aa" alt="" data-media-type="image" data-attr-org-src-id="9257FC9BFD0E4A5488824071FF8F126F" data-attr-org-img-file="file:///C:/Users/Administrator/AppData/Local/YNote/data/hongxiutianmo@163.com/cad1958bea54422b89cbeddd058cdf1c/clipboard.png" data-mce-src="http://192.168.56.4:9000/api/file/getImage?fileId=583260f023eeeb0f8f0000aa"></div><div><div><ol><li><strong>安装<span lang="EN-US">Zookeeper</span>集群</strong></li></ol><p><span lang="EN-US">Zookeeper</span>集群安装步骤，这里不详述，在另外的文档详细说明，请参考文档</p><ol start="2"><li><strong>安装<span lang="EN-US">Storm</span>依赖</strong></li></ol><p><span lang="EN-US">Python</span>、<span lang="EN-US">zeromq</span>、<span lang="EN-US">jzmq</span></p><p>说明：</p><p><span lang="EN-US">Python</span>，在<span lang="EN-US">centos</span>系统中已经默认安装，如果在其他<span lang="EN-US">linux</span>系统中未安装，请自行安装；</p><p><span lang="EN-US">Zeromq</span>，请使用<span lang="EN-US">2.1.7</span>版本，其他版本目前没有测试过，可能会有其他问题。可以在<span lang="EN-US">wget </span><span lang="EN-US"><a href="http://download.zeromq.org/zeromq-2.1.7.tar.gz" data-mce-href="http://download.zeromq.org/zeromq-2.1.7.tar.gz">http://download.zeromq.org/zeromq-2.1.7.tar.gz</a></span>下载；</p><p><span lang="EN-US">jzmq</span>，请在<span lang="EN-US"> git clone </span><span lang="EN-US"><a href="https://github.com/nathanmarz/jzmq.git" data-mce-href="https://github.com/nathanmarz/jzmq.git">https://github.com/nathanmarz/jzmq.git</a></span>下载</p><ol start="3"><li><strong>安装<span lang="EN-US">zeromq</span></strong></li></ol><p>安装依赖<span lang="EN-US">libstdc++-devel</span></p><p>安装依赖<span lang="EN-US">gcc-c++</span></p><p>安装依赖<span lang="EN-US">libuuid-devel</span></p><p>解压缩：<span lang="EN-US">tar -zxvf zeromq-2.1.7.tar.gz</span></p><p>进入目录<span lang="EN-US">cd zeromq-2.1.7</span></p><p>检查编译环境<span lang="EN-US">./configure</span></p><p>编译<span lang="EN-US">make</span></p><p>安装<span lang="EN-US">make install</span></p><ol start="4"><li><strong>安装<span lang="EN-US">jzmq</span></strong></li></ol><p>安装依赖<span lang="EN-US">autoconf</span></p><p>安装依赖<span lang="EN-US">automake</span></p><p>安装依赖<span lang="EN-US">libtool</span></p><p>进入目录<span lang="EN-US">cd jzmq</span></p><p>自动生成<span lang="EN-US">./autogen.sh</span></p><p>检查编译环境<span lang="EN-US">./configure</span></p><p>编译<span lang="EN-US">make</span></p><p>安装<span lang="EN-US">make install</span></p><ol start="5"><li><strong>安装<span lang="EN-US">storm</span></strong></li></ol><p>下载<a><span lang="EN-US">storm wget </span></a><a href="http://apache.fayea.com/storm/apache-storm-0.9.4/apache-storm-0.9.4.tar.gz" data-mce-href="http://apache.fayea.com/storm/apache-storm-0.9.4/apache-storm-0.9.4.tar.gz"><span lang="EN-US">http://apache.fayea.com/storm/apache-storm-0.9.4/apache-storm-0.9.4.tar.gz</span></a></p><p>解压缩<span lang="EN-US">tar -zxvf apache-storm-0.9.4.tar.gz</span></p><p>重命名<span lang="EN-US">mv apache-storm-0.9.4 storm</span></p><p>修改配置文件<span lang="EN-US">vi <a>storm/conf/storm.yaml</a></span></p><p><span lang="EN-US">storm.zookeeper.servers:</span></p><p><span lang="EN-US"> </span><span lang="EN-US"> - "HadoopSlave1"</span></p><p><span lang="EN-US"> </span><span lang="EN-US">- "HadoopSlave2"</span></p><p><span lang="EN-US"> </span><span lang="EN-US">- "HadoopSlave3"</span></p><p><a><span lang="EN-US">nimbus.host: </span></a><span lang="EN-US">"HadoopMaster"</span></p><p><span lang="EN-US"> </span>说明：<span lang="EN-US">HadoopSlave1</span>、<span lang="EN-US">HadoopSlave2</span>、<span lang="EN-US">HadoopSlave3</span>分别是<span lang="EN-US">zookeeper</span>服务器的主机名。<span lang="EN-US">HadoopMaster</span>是<span lang="EN-US">storm</span>的主控节点。</p><p><span lang="EN-US"> </span>将<span lang="EN-US">storm</span>安装文件拷贝到其他<span lang="EN-US">slave</span>节点</p><p><span lang="EN-US"> </span><span lang="EN-US">scp -r storm HadoopSlave1:/usr/</span></p><p><span lang="EN-US"> scp -r storm HadoopSlave2:/usr/</span></p><p><span lang="EN-US">scp -r storm HadoopSlave3:/usr/</span></p><p><span lang="EN-US"> </span>配置环境变量<span lang="EN-US">vi /etc/profile,</span>添加如下内容：</p><p><span lang="EN-US"> </span><a><span lang="EN-US">#set storm path</span></a></p><p><span lang="EN-US">export STORM_HOME=/usr/storm</span></p><p><span lang="EN-US">export PATH=$PATH:$STORM_HOME/bin</span></p><p>注：<span lang="EN-US">storm</span>安装在<span lang="EN-US">/usr/</span>目录下。每个节点都需要配置环境变量</p><p>使用环境变量生效<span lang="EN-US">source /etc/profile</span></p><ol start="6"><li><strong>启动<span lang="EN-US">Storm</span>集群</strong></li></ol><p>启动<span lang="EN-US">Zookeeper</span>集群，每个<span lang="EN-US">Zookeeper</span>节点上执行<span lang="EN-US">zkServer.sh start</span></p><p>主节点上启动<span lang="EN-US">storm</span>，<a><span lang="EN-US">storm nimbus > ./nimbus.log 2>&1 &</span></a></p><p>主节点上启动图形化管理界面进程，<a><span lang="EN-US">storm ui > ./core.log 2>&1 &</span></a></p><p>子节点上启动<span lang="EN-US">storm</span>，<a><span lang="EN-US">storm supervisor > ./supervisor.log 2>&1 &</span></a></p><ol start="7"><li><strong>检查<span lang="EN-US">storm</span>集群启动情况</strong></li></ol><p>主节点：</p><p><span lang="EN-US"><img id="__LEANOTE_D_IMG_1479696623824" src="http://192.168.56.4:9000/api/file/getImage?fileId=583260f023eeeb0f8f0000a8" alt="" data-media-type="image" data-attr-org-src-id="BE81B5DCB93149CABDD722F7EE2D0BDD" data-attr-org-img-file="file:///C:/Users/Administrator/AppData/Local/YNote/data/hongxiutianmo@163.com/3e80e18d7fcb4cc9abf131c3746417b8/lip_image001.png" data-mce-src="http://192.168.56.4:9000/api/file/getImage?fileId=583260f023eeeb0f8f0000a8"></span></p><p>子节点：</p><p><span lang="EN-US"><img id="__LEANOTE_D_IMG_1479696623825" src="http://192.168.56.4:9000/api/file/getImage?fileId=583260f023eeeb0f8f0000a9" alt="" data-media-type="image" data-attr-org-src-id="28EA2DD620304913A1AED9E6ADE4CE74" data-attr-org-img-file="file:///C:/Users/Administrator/AppData/Local/YNote/data/hongxiutianmo@163.com/39062751d4bf4e4497ff8789d12e7c7e/lip_image002.png" data-mce-src="http://192.168.56.4:9000/api/file/getImage?fileId=583260f023eeeb0f8f0000a9"></span></p><p><span lang="EN-US">WebUI</span>管理页面</p><p><img id="__LEANOTE_D_IMG_1479696623826" src="http://192.168.56.4:9000/api/file/getImage?fileId=583260f023eeeb0f8f0000a7" alt="" data-media-type="image" data-attr-org-src-id="73685139CE9947F7BBA6FE311F55A633" data-attr-org-img-file="file:///C:/Users/Administrator/AppData/Local/YNote/data/hongxiutianmo@163.com/f1115155e5db4394bcd0aa5aa449875a/clipboard.png" data-mce-src="http://192.168.56.4:9000/api/file/getImage?fileId=583260f023eeeb0f8f0000a7"></p></div></div></div>
|
||
</div>
|
||
|
||
<!-- 该js供其它处理 -->
|
||
<script src="../leanote-html.js"></script>
|
||
</body>
|
||
</html> |