337 lines
No EOL
20 KiB
HTML
337 lines
No EOL
20 KiB
HTML
<!DOCTYPE html>
|
||
<html>
|
||
<head>
|
||
<meta charset="utf-8">
|
||
<meta name="tool" content="leanote-desktop-app">
|
||
<title>nginx+keepalive主从双机热备+自动切换解决方案</title>
|
||
<style>
|
||
|
||
*{font-family:"lucida grande","lucida sans unicode",lucida,helvetica,"Hiragino Sans GB","Microsoft YaHei","WenQuanYi Micro Hei",sans-serif;}
|
||
|
||
body {
|
||
margin: 0;
|
||
}
|
||
|
||
/*公用文字样式*/
|
||
h1{font-size:30px}h2{font-size:24px}h3{font-size:18px}h4{font-size:14px}
|
||
.note-container{
|
||
width:850px;
|
||
margin:auto;
|
||
padding: 10px 20px;
|
||
box-shadow: 1px 1px 10px #eee;
|
||
}
|
||
#title {
|
||
margin: 0;
|
||
}
|
||
table {
|
||
margin-bottom: 16px;
|
||
border-collapse: collapse;
|
||
}
|
||
table th, table td {
|
||
padding: 6px 13px;
|
||
border: 1px solid #ddd;
|
||
}
|
||
table th {
|
||
font-weight: bold;
|
||
}
|
||
|
||
table tr {
|
||
background-color: none;
|
||
border-top: 1px solid #ccc;
|
||
}
|
||
table tr:nth-child(2n) {
|
||
background-color: rgb(247, 247, 249);
|
||
}
|
||
.mce-item-table, .mce-item-table td, .mce-item-table th, .mce-item-table caption {
|
||
border: 1px solid #ddd;
|
||
border-collapse: collapse;
|
||
padding: 6px 13px;
|
||
}
|
||
blockquote {
|
||
border-left-width:10px;
|
||
background-color:rgba(128,128,128,0.05);
|
||
border-top-right-radius:5px;
|
||
border-bottom-right-radius:5px;
|
||
padding:15px 20px;
|
||
border-left:5px solid rgba(128,128,128,0.075);
|
||
}
|
||
blockquote p {
|
||
margin-bottom:1.1em;
|
||
font-size:1em;
|
||
line-height:1.45
|
||
}
|
||
blockquote ul:last-child,blockquote ol:last-child {
|
||
margin-bottom:0
|
||
}
|
||
pre {
|
||
padding: 18px;
|
||
background-color: #f7f7f9;
|
||
border: 1px solid #e1e1e8;
|
||
border-radius: 3px;
|
||
display: block;
|
||
}
|
||
code {
|
||
padding: 2px 4px;
|
||
font-size: 90%;
|
||
color: #c7254e;
|
||
white-space: nowrap;
|
||
background-color: #f9f2f4;
|
||
border-radius: 4px;
|
||
}
|
||
.footnote {
|
||
vertical-align: top;
|
||
position: relative;
|
||
top: -0.5em;
|
||
font-size: .8em;
|
||
}
|
||
|
||
hr {
|
||
margin:2em 0
|
||
}
|
||
img {
|
||
max-width:100%
|
||
}
|
||
pre {
|
||
word-break:break-word
|
||
}
|
||
p,pre,pre.prettyprint,blockquote {
|
||
margin:0 0 1.1em
|
||
}
|
||
hr {
|
||
margin:2em 0
|
||
}
|
||
img {
|
||
max-width:100%
|
||
}
|
||
.sequence-diagram,.flow-chart {
|
||
text-align:center;
|
||
margin-bottom:1.1em
|
||
}
|
||
.sequence-diagram text,.flow-chart text {
|
||
font-size:15px !important;
|
||
font-family:"Source Sans Pro",sans-serif !important
|
||
}
|
||
.sequence-diagram [fill="#ffffff"],.flow-chart [fill="#ffffff"] {
|
||
fill:#f6f6f6
|
||
}
|
||
.sequence-diagram [stroke="#000000"],.flow-chart [stroke="#000000"] {
|
||
stroke:#3f3f3f
|
||
}
|
||
.sequence-diagram text[stroke="#000000"],.flow-chart text[stroke="#000000"] {
|
||
stroke:none
|
||
}
|
||
.sequence-diagram [fill="#000"],.flow-chart [fill="#000"],.sequence-diagram [fill="#000000"],.flow-chart [fill="#000000"],.sequence-diagram [fill="black"],.flow-chart [fill="black"] {
|
||
fill:#3f3f3f
|
||
}
|
||
ul,ol {
|
||
margin-bottom:1.1em
|
||
}
|
||
ul ul,ol ul,ul ol,ol ol {
|
||
margin-bottom:1.1em
|
||
}
|
||
kbd {
|
||
padding:.1em .6em;
|
||
border:1px solid rgba(63,63,63,0.25);
|
||
-webkit-box-shadow:0 1px 0 rgba(63,63,63,0.25);
|
||
box-shadow:0 1px 0 rgba(63,63,63,0.25);
|
||
font-size:.7em;
|
||
font-family:sans-serif;
|
||
background-color:#fff;
|
||
color:#333;
|
||
border-radius:3px;
|
||
display:inline-block;
|
||
margin:0 .1em;
|
||
white-space:nowrap
|
||
}
|
||
.toc ul {
|
||
list-style-type:none;
|
||
margin-bottom:15px
|
||
}
|
||
</style>
|
||
<!-- 该css供自定义样式 -->
|
||
<link href="../leanote-html.css" rel="stylesheet">
|
||
</head>
|
||
|
||
<body>
|
||
|
||
<div class="note-container">
|
||
<h1 class="title" id="leanote-title">nginx+keepalive主从双机热备+自动切换解决方案</h1>
|
||
<div class="content-html" id="leanote-content"><p>环境采集cenots 6.3 64位迷你安装，因为安装前，你需要做一些工作</p><pre id="leanote_ace_1480070528557_0" class="ace-tomorrow">yum install -y make wget</pre><p>如果你愿意可以更新下系统，更换下yum源.</p><h3>1.安装keepalive</h3><p>官方最新版 keepalived-1.2.7 </p><pre id="leanote_ace_1480070528573_0" class="ace-tomorrow">tar zxvf keepalived-1.2.7.tar.gz
|
||
cd keepalived-1.2.7</pre><p>在此之前。请安装一下一些简单的工具 </p><pre id="leanote_ace_1480070528584_0" class="ace-tomorrow">yum install -y gcc openssl-devel popt-devel</pre><p>不然会编译不成功的。然后：</p><pre id="leanote_ace_1480070528593_0" class="ace-tomorrow ace_focus">./configure
|
||
make && make install
|
||
|
||
cp /usr/local/etc/rc.d/init.d/keepalived /etc/init.d/
|
||
cp /usr/local/etc/sysconfig/keepalived /etc/sysconfig/
|
||
chmod +x /etc/init.d/keepalived
|
||
chkconfig --add keepalived
|
||
chkconfig keepalived on
|
||
mkdir /etc/keepalived
|
||
ln -s /usr/local/sbin/keepalived /usr/sbin/</pre><h3>2.安装<a title="Nginx" href="http://www.linuxde.net/tag/nginx" target="_blank" data-mce-href="http://www.linuxde.net/tag/nginx">Nginx</a> </h3><pre id="leanote_ace_1480070528614_0" class="ace-tomorrow">tar zxvf nginx-1.2.5.tar.gz
|
||
cd nginx-1.2.5</pre><p>安装一下相关组件.</p><pre id="leanote_ace_1480070528627_0" class="ace-tomorrow">yum install -y pcre-devel
|
||
./configure --prefix=/usr/local/nginx --user=www --group=www --with-http_stub_status_module --with-http_ssl_module
|
||
make && make install</pre><h3>3.配置keepalive</h3><p>两台服务器端keepalived.conf内容都为如下，都设置为backup，不抢占，注意修改优先级不同,更详细的keepalived配置文件说明可以执行<a title="man命令" href="http://man.linuxde.net/man" target="_blank" data-mce-href="http://man.linuxde.net/man">man</a> keepalived.conf查看：</p><pre id="leanote_ace_1480070528640_0" class="ace-tomorrow">! Configuration file for keepalived
|
||
global_defs {
|
||
notification_email {
|
||
admin@lvtao.net
|
||
}
|
||
notification_email_from admin@lvtao.net
|
||
smtp_server 127.0.0.1
|
||
smtp_connect_timeout 30
|
||
router_id LVS_DEVEL
|
||
}
|
||
#监控服务.NGINX mysql等
|
||
vrrp_script chk_nginx {
|
||
script "/home/check_nginx.sh"
|
||
interval 2
|
||
weight 2
|
||
}
|
||
|
||
vrrp_instance VI_1 {
|
||
state BACKUP #主从设置 MASTER
|
||
interface eth2 #网卡名
|
||
virtual_router_id 51
|
||
mcast_src_ip 10.0.1.133 #本机ip
|
||
priority 50 #从机小于主机
|
||
advert_int 1
|
||
authentication {
|
||
auth_type PASS
|
||
auth_pass chtopnet
|
||
}
|
||
virtual_ipaddress {
|
||
10.0.1.2 #VIP 的IP
|
||
}
|
||
track_script {
|
||
chk_nginx #检测脚本
|
||
}
|
||
|
||
}
|
||
|
||
virtual_server 10.0.1.2 80 {
|
||
delay_loop 6
|
||
lb_algo rr
|
||
lb_kind DR
|
||
persistence_timeout 50
|
||
protocol TCP
|
||
|
||
real_server 10.0.1.132 80 {
|
||
weight 3
|
||
TCP_CHECK {
|
||
connect_timeout 10
|
||
nb_get_retry 3
|
||
delay_before_retry 3
|
||
connect_port 80
|
||
}
|
||
}
|
||
real_server 10.0.1.133 80 {
|
||
weight 3
|
||
TCP_CHECK {
|
||
connect_timeout 10
|
||
nb_get_retry 3
|
||
delay_before_retry 3
|
||
connect_port 80
|
||
}
|
||
}
|
||
}</pre><p>启动相关服务。我在这儿使用的是nginx ，每个上面开了一个站点，通过IP可以直接访问的。启动keepalive后，就可以通过VIP的虚拟IP 10.0.1.2来访问站点了，测试方法就是 停止任何其中一个站点，看它是否能自动切换到从服务器上。</p><p>上面代码中 nginx的检测脚本如下 ：</p><pre id="leanote_ace_1480070528660_0" class="ace-tomorrow">#!/bin/bash
|
||
if [ "$(ps -ef | grep "nginx: master process"| grep -v grep )" == "" ]
|
||
then
|
||
/usr/local/nginx/sbin/nginx
|
||
sleep 5
|
||
if [ "$(ps -ef | grep "nginx: master process"| grep -v grep )" == "" ]
|
||
then
|
||
killall keepalived
|
||
fi
|
||
fi</pre><p>在两台Web Server上执行realserver.sh脚本，为lo:0绑定VIP地址10.0.1.2、抑制<a title="arp命令" href="http://man.linuxde.net/arp" target="_blank" data-mce-href="http://man.linuxde.net/arp">arp</a>广播。</p><pre id="leanote_ace_1480070528673_0" class="ace-tomorrow">#!/bin/bash
|
||
#description: Config realserver
|
||
|
||
VIP=10.0.1.2
|
||
|
||
/etc/rc.d/init.d/functions
|
||
|
||
case "$1" in
|
||
start)
|
||
/sbin/ifconfig lo:0 $VIP netmask 255.255.255.255 broadcast $VIP
|
||
/sbin/route add -host $VIP dev lo:0
|
||
echo "1" >/proc/sys/net/ipv4/conf/lo/arp_ignore
|
||
echo "2" >/proc/sys/net/ipv4/conf/lo/arp_announce
|
||
echo "1" >/proc/sys/net/ipv4/conf/all/arp_ignore
|
||
echo "2" >/proc/sys/net/ipv4/conf/all/arp_announce
|
||
sysctl -p >/dev/null 2>&1
|
||
echo "RealServer Start OK"
|
||
;;
|
||
stop)
|
||
/sbin/ifconfig lo:0 down
|
||
/sbin/route del $VIP >/dev/null 2>&1
|
||
echo "0" >/proc/sys/net/ipv4/conf/lo/arp_ignore
|
||
echo "0" >/proc/sys/net/ipv4/conf/lo/arp_announce
|
||
echo "0" >/proc/sys/net/ipv4/conf/all/arp_ignore
|
||
echo "0" >/proc/sys/net/ipv4/conf/all/arp_announce
|
||
echo "RealServer Stoped"
|
||
;;
|
||
*)
|
||
echo "Usage: $0 {start|stop}"
|
||
exit 1
|
||
esac
|
||
|
||
exit 0</pre><p>分别在主从机上执行 sh realserver.sh start 就可实现负载均衡及高可用集群了；</p><h3>keepalive相关参数说明</h3><pre id="leanote_ace_1480070528686_0" class="ace-tomorrow"> ! Configuration File for keepalived
|
||
|
||
global_defs {
|
||
notification_email {
|
||
admin@lvtao.net #设置报警邮件地址，可以设置多个，每行一个。 需开启本机的sendmail服务
|
||
}
|
||
notification_email_from admin@lvtao.net #设置邮件的发送地址
|
||
smtp_server 127.0.0.1 #设置smtp server地址
|
||
smtp_connect_timeout 30 #设置连接smtp server的超时时间
|
||
router_id LVS_DEVEL #表示运行keepalived服务器的一个标识。发邮件时显示在邮件主题的信息
|
||
}
|
||
|
||
vrrp_instance VI_1 {
|
||
state MASTER #指定keepalived的角色，MASTER表示此主机是主服务器，BACKUP表示此主机是备用服务器
|
||
interface eth0 #指定HA监测网络的接口
|
||
virtual_router_id 51 #虚拟路由标识，这个标识是一个数字，同一个vrrp实例使用唯一的标识。即同一vrrp_instance下，MASTER和BACKUP必须是一致的
|
||
priority 100 #定义优先级，数字越大，优先级越高，在同一个vrrp_instance下，MASTER的优先级必须大于BACKUP的优先级
|
||
advert_int 1 #设定MASTER与BACKUP负载均衡器之间同步检查的时间间隔，单位是秒
|
||
authentication { #设置验证类型和密码
|
||
auth_type PASS #设置验证类型，主要有PASS和AH两种
|
||
auth_pass 1111 #设置验证密码，在同一个vrrp_instance下，MASTER与BACKUP必须使用相同的密码才能正常通信
|
||
}
|
||
virtual_ipaddress { #设置虚拟IP地址，可以设置多个虚拟IP地址，每行一个
|
||
10.0.0.148
|
||
}
|
||
}
|
||
|
||
virtual_server 10.0.0.148 80 { #设置虚拟服务器，需要指定虚拟IP地址和服务端口，IP与端口之间用空格隔开
|
||
delay_loop 6 #设置运行情况检查时间，单位是秒
|
||
lb_algo rr #设置负载调度算法，这里设置为rr，即轮询算法
|
||
lb_kind DR #设置LVS实现负载均衡的机制，有NAT、TUN、DR三个模式可选
|
||
persistence_timeout 50 #会话保持时间，单位是秒。这个选项对动态网页是非常有用的，为集群系统中的session共享提供了一个很好的解决方案。
|
||
#有了这个会话保持功能，用户的请求会被一直分发到某个服务节点，直到超过这个会话的保持时间。
|
||
#需要注意的是，这个会话保持时间是最大无响应超时时间，也就是说，用户在操作动态页面时，如果50秒内没有执行任何操作，
|
||
#那么接下来的操作会被分发到另外的节点，但是如果用户一直在操作动态页面，则不受50秒的时间限制
|
||
protocol TCP #指定转发协议类型，有TCP和UDP两种
|
||
|
||
real_server 10.0.0.137 80 { #配置服务节点1，需要指定real server的真实IP地址和端口，IP与端口之间用空格隔开
|
||
weight 3 #配置服务节点的权值，权值大小用数字表示，数字越大，权值越高，设置权值大小可以为不同性能的服务器
|
||
#分配不同的负载，可以为性能高的服务器设置较高的权值，而为性能较低的服务器设置相对较低的权值，这样才能合理地利用和分配系统资源
|
||
TCP_CHECK { #realserver的状态检测设置部分，单位是秒
|
||
connect_timeout 10 #表示3秒无响应超时
|
||
nb_get_retry 3 #表示重试次数
|
||
delay_before_retry 3 #表示重试间隔
|
||
connect_port 80
|
||
}
|
||
}
|
||
real_server 10.0.0.139 80 {
|
||
weight 3
|
||
TCP_CHECK {
|
||
connect_timeout 10
|
||
nb_get_retry 3
|
||
delay_before_retry 3
|
||
connect_port 80
|
||
}
|
||
}
|
||
}</pre><p><br></p></div>
|
||
</div>
|
||
|
||
<!-- 该js供其它处理 -->
|
||
<script src="../leanote-html.js"></script>
|
||
</body>
|
||
</html> |