Puppet利用Nginx多端口實現(xiàn)負載均衡
原創(chuàng)【51CTO原創(chuàng)稿件】隨著公司應(yīng)用需求的增加,需要不斷的擴展,服務(wù)器數(shù)量也隨之增加,當(dāng)服務(wù)器數(shù)量不斷增加,我們會發(fā)現(xiàn)一臺puppetmaster壓力大,解析緩慢,而且時不時出現(xiàn)"time out"之類的報錯,那這時有什么優(yōu)化的辦法嗎?我們在Puppet官網(wǎng)上找尋解決方案,發(fā)現(xiàn)puppetmaster可以配置多端口,結(jié)合WEB代理(推薦Nginx),這樣puppetmaster承受能力至少可以提升數(shù)倍以上,相當(dāng)于在很大程度上優(yōu)化了puppet的處理能力。
1.遵循前面的環(huán)境設(shè)定,我們這里的服務(wù)器環(huán)境及軟件版本分別為:
服務(wù)器系統(tǒng):CentOS5.8 x86_64
Ruby版本:ruby-1.8.5
Puppet版本:puppet-2.7.9
Nginx版本:nginx-0.8.46
2.Mongrel安裝
要使用puppet多端口配置,需要指定mongrel類型,默認沒有安裝,需要安裝:
yum install -y rubygem-mongrel
3.配置puppetmaster
在/etc/sysconfig/puppetmaster文件末尾添加如下兩行,分別代表多端口、mongrel類型,內(nèi)容如下所示:
PUPPETMASTER_PORTS=(8141 8142 8143 8144 8145) PUPPETMASTER_EXTRA_OPTS="--servertype=mongrel --ssl_client_header=HTTP_X_SSL_SUBJECT"
4.安裝Nginx服務(wù)
安裝之前請確保系統(tǒng)已經(jīng)安裝pcre-devel正則庫,然后再編譯安裝Nginx,需要添加SSL模塊參數(shù)支持,Nginx的安裝過程如下所示:
yum -y install pcre-devel cd /usr/local/src wget http://nginx.org/download/nginx-0.8.46.tar.gz tar zxvf nginx-0.8.46.tar.gz cd nginx-0.8.46 ./configure --prefix=/usr/local/nginx --with-http_ssl_module make && make install && cd ../
添加www用戶組及用戶,命令如下所示:
groupadd www useradd -g www www
5.我們依據(jù)puppet需求來修改配置文件nginx.conf,內(nèi)容如下所示:
- user www;
- worker_processes 8;
- events {
- worker_connections 65535;
- }
- http {
- include mime.types;
- default_type application/octet-stream;
- sendfile on;
- tcp_nopush on;
- keepalive_timeout 65;
- #定義puppet客戶端訪問puppet-server端日志格式
- log_format main '$remote_addr - $remote_user [$time_local] "$request" $request_length $request_time $time_local'
- '$status $body_bytes_sent $bytes_sent $connection $msec "$http_referer" '
- '"$http_user_agent" $http_x_forwarded_for $upstream_response_time $upstream_addr $upstream_status ';
- access_log /usr/local/nginx/logs/access.log main;
- upstream puppetmaster {
- server 127.0.0.1:8141;
- server 127.0.0.1:8142;
- server 127.0.0.1:8143;
- server 127.0.0.1:8144;
- server 127.0.0.1:8145;
- }
- server {
- listen 8140;
- root /etc/puppet;
- ssl on;
- ssl_session_timeout 5m;
- #如下為puppetmaster服務(wù)器端證書地址
- ssl_certificate /var/lib/puppet/ssl/certs/server.cn7788.com.pem;
- ssl_certificate_key /var/lib/puppet/ssl/private_keys/server.cn7788.com.pem;
- ssl_client_certificate /var/lib/puppet/ssl/ca/ca_crt.pem;
- ssl_crl /var/lib/puppet/ssl/ca/ca_crl.pem;
- ssl_verify_client optional;
- #File sections
- location /production/file_content/files/ {
- types { }
- default_type application/x-raw;
- #定義puppet推送路徑別名
- alias /etc/puppet/files/;
- }
- # Modules files sections
- location ~ /production/file_content/modules/.+/ {
- root /etc/puppet/modules;
- types { }
- default_type application/x-raw;
- rewrite ^/production/file_content/modules/(.+)/(.+)$ /$1/files/$2 break;
- }
- location / {
- ##設(shè)置跳轉(zhuǎn)到puppetmaster負載均衡
- proxy_pass http://puppetmaster;
- proxy_redirect off;
- proxy_set_header Host $host;
- proxy_set_header X-Real-IP $remote_addr;
- proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
- proxy_set_header X-Client-Verify $ssl_client_verify;
- proxy_set_header X-SSL-Subject $ssl_client_s_dn;
- proxy_set_header X-SSL-Issuer $ssl_client_i_dn;
- proxy_buffer_size 10m;
- proxy_buffers 1024 10m;
- proxy_busy_buffers_size 10m;
- proxy_temp_file_write_size 10m;
- proxy_read_timeout 120;
- }
- }
- }
6.修改完nginx.conf文件以后,我們要啟動nginx及puppet-server,這時應(yīng)該如何操作呢?
1.我們首先關(guān)閉puppetmaster進程,然后先啟動nginx,不然nginx是會啟動失敗的,命令如下所示:
/usr/local/nginx/sbin/nginx
nginx占用puppetmaster默認的8140端口后,我們可以用如下命令來檢查8140端口是否被nginx接管,如下所示:
lsof -i:8140
此命令顯示結(jié)果表明8140被nginx進程接管,如下所示:
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME nginx 4121 root 6u IPv4 20668 0t0 TCP *:8140 (LISTEN) nginx 4122 www 6u IPv4 20668 0t0 TCP *:8140 (LISTEN)
我們再啟動puppetmaster,命令如下所示:
service puppetmaster start
如果ruby版本為1.8.5的話,等會運行puppetmaster會有如下警告,如下所示:
Starting puppetmaster:
Port: 8141** Ruby version is not up-to-date; loading cgi_multipart_eof_fix [ OK ] Port: 8142** Ruby version is not up-to-date; loading cgi_multipart_eof_fix [ OK ] Port: 8143** Ruby version is not up-to-date; loading cgi_multipart_eof_fix [ OK ] Port: 8144** Ruby version is not up-to-date; loading cgi_multipart_eof_fix [ OK ] Port: 8145** Ruby version is not up-to-date; loading cgi_multipart_eof_fix [ OK ] |
這段警告值的意思為:
It's just a warning. Mongrel wants a Ruby version of at least 1.8.6.
But it still runs just fine with previous versions. Just ignore the warning.
翻譯為中文的意思是:
Mongrel需要ruby至少是1.8.6以上的版本,但它仍然在當(dāng)前版本運行,請忽咯當(dāng)前警告,為了保證整個puppet運行環(huán)境的穩(wěn)定,我這里選擇還是沿用1.8.5版本的ruby。
本文作者:余洪春(撫琴煮酒),英文名Andrew.Yu。
個人博客地址:http://andrewyu.blog.51cto.com/,
Sina微博地址:http://weibo.com/yuhongchun027。