Nginx0.8.54+Tomcat6实现负载均衡

于 2011-04-24 11:47:00 发布
阅读量1.9k 收藏
点赞数
分类专栏： JavaEE 文章标签： tomcat nginx documentation interceptor ssl compression
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/gaojie314/article/details/6358610
版权

    最近公司后台系统自从加了 lucene 以来 , 上个星期每天因为内存溢出导致宕机或者系统运行极慢 ( 我都快崩溃了 ), 不得不在后台打开 Jconsole 就行实时监控 , 每当内存达到一定峰值就手动执行 GC, 释放几百 M 的内存 , 才得以正常运行 ! 后来通过 jprofiler6 监控是 lucene Term 实例过多的问题 !

如图 :

虽然内存问题通过以上方式暂时解决了 , 但是也出现了致命的问题 lucene 打开索引的文件数过多没有及时释放 ,

服务器一直在后台打印错误日志 ( 一天有 10G 的日志 )

如图 :

在上面的放两个问题 , 希望的到大家的回帖帮助 !

下面进入主题 :

测试环境：

一共两台服务器 A.B, 都是 Redhat Linux

A:ip(211.151.*.39)  服务器装有 Tomcat39 ， http 请求端口为 8080

B:ip(211.151.*.40)  服务器装有 Tomcat40 ，  http 请求端口为 8080;  nginx 服务器 ,http 请求端口 8085

 

ip 地址 ( 外网 IP) 有一个被省略 , 推荐大家在一台机器测试改变 tomcat 端口就可以啦

以上是公司提供的两台测试服务器

软件版本

Nginx 0.854

Apache Tomcat/6.0.20

 

安装

过程细节网上资料很多 , 我就不写了 ……

配置 ngnix 服务器 /usr/local/nginx/conf/nginx.conf

#user  nobody;

# 工作进程数

worker_processes  6;

 

#error_log  logs/error.log;

#error_log  logs/error.log  notice;

#error_log  logs/error.log  info;

 

#pid         logs/nginx.pid;

 

# 工作模式及连接数上限

events {

    worker_connections  4096;

}

 

 

http {

    include       mime.types;

    default_type  application/octet-stream;

        

    #log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '

    #                   '$status $body_bytes_sent "$http_referer" '

    #                  '"$http_user_agent" "$http_x_forwarded_for"';

 

    #access_log  logs/access.log  main;

 

    sendfile        on;

    #tcp_nopush     on;

 

    #keepalive_timeout  0;

    keepalive_timeout  65;

 

    #gzip  on;

         upstream tqcrm {           # tqcrm 项目名

                   # 配置 tomcat 服务器

                   server 211.151.*.39:8080 weight=1; # tomcat 地址和端口

                   server 211.151.*.40:8080 weight=1;

         }

 

    server {

        listen       8085;     #nginx 监听端口

        server_name  localhost;

 

        #charset koi8-r;

                   charset gb2312;

       

                   #access_log  logs/host.access.log  main;

 

        location / {

            root   html;

            #index  index.html index.htm;

                            proxy_pass http://tqcrm;

        }

 

     location /NginxStatus {

                  stub_status  on;

                  access_log   on;

                   auth_basic  "NginxStatus";

       }

 

 

        #error_page  404              /404.html;

 

        # redirect server error pages to the static page /50x.html

        #

        error_page    500 502 503 504  /50x.html;

        location = /50x.html {

            root   html;

        }

 

        # proxy the PHP scripts to Apache listening on 127.0.0.1:80

        #

        #location ~ /.php$ {

        #    proxy_pass   http://127.0.0.1;

        #}

 

        # pass the PHP scripts to FastCGI server listening on 127.0.0.1:9000

        #

        #location ~ /.php$ {

        #    root           html;

        #    fastcgi_pass   127.0.0.1:9000;

        #    fastcgi_index  index.php;

        #    fastcgi_param  SCRIPT_FILENAME  /scripts$fastcgi_script_name;

        #    include        fastcgi_params;

        #}

 

        # deny access to .htaccess files, if Apache's document root

        # concurs with nginx's one

        #

        #location ~ //.ht {

        #    deny  all;

        #}

    }

 

 

    # another virtual host using mix of IP-, name-, and port-based configuration

    #

    #server {

    #    listen       8000;

    #    listen       somename:8080;

    #    server_name  somename   alias  another.alias;

 

    #    location / {

    #        root   html;

    #        index  index.html index.htm;

    #    }

    #}

 

 

    # HTTPS server

    #

    #server {

    #    listen       443;

    #    server_name  localhost;

 

    #    ssl                  on;

    #    ssl_certificate      cert.pem;

    #    ssl_certificate_key  cert.key;

 

    #    ssl_session_timeout  5m;

 

    #    ssl_protocols  SSLv2 SSLv3 TLSv1;

    #    ssl_ciphers  ALL:!ADH:!EXPORT56:RC4+RSA:+HIGH:+MEDIUM:+LOW:+SSLv2:+EXP;

    #    ssl_prefer_server_ciphers   on;

 

    #    location / {

    #        root   html;

    #        index  index.html index.htm;

    #    }

    #}

 

}

 

配置 tomcat39(server.xml)

<? xml version = '1.0' encoding = 'utf-8' ?>

 

< Server port = "8005" shutdown = "SHUTDOWN" >

 

  <!--APR library loader. Documentation at /docs /apr.html -->

  < Listener className = "org.apache.catalina.core.AprLifecycleListener" SSLEngine = "on" />

  <!--Initialize Jasper prior to webapps are loaded. Documentation at /docs /jasper -howto.html -->

  < Listener className = "org.apache.catalina.core.JasperListener" />

  <!-- JMX Support for the Tomcat server. Documentation at /docs /non-existent.html -->

  < Listener className = "org.apache.catalina.mbeans.ServerLifecycleListener" />

  < Listener className = "org.apache.catalina.mbeans.GlobalResourcesLifecycleListener" />

 

  <!-- Global JNDI resources

       Documentation at /docs /jndi -resources-howto.html

  -->

  < GlobalNamingResources >

    <!-- Editable user database that can also be used by

         UserDatabaseRealm to authenticate users

    -->

    < Resource name = "UserDatabase" auth = "Container"

              type = "org.apache.catalina.UserDatabase"

              description = "User database that can be updated and saved"

              factory = "org.apache.catalina.users.MemoryUserDatabaseFactory"

              pathname = "conf/tomcat-users.xml" />

  </ GlobalNamingResources >

 

  <!-- A "Service" is a collection of one or more "Connectors" that share

       a single "Container" Note:  A "Service" is not itself a "Container",

       so you may not define subcomponents such as "Valves" at this level.

       Documentation at /docs /config /service.html

   -->

  < Service name = "Catalina" >

 

    <!--The connectors can use a shared executor, you can define one or more named thread pools-->

   

    < Executor name = "tomcatThreadPool" namePrefix = "catalina-exec-"

         maxThreads = "500" minSpareThreads = "50" maxIdleTime = "60000" />

   

   

    <!-- A "Connector" represents an endpoint by which requests are received

         and responses are returned. Documentation at :

         Java HTTP Connector: /docs /config /http.html (blocking & non-blocking)

         Java AJP  Connector: /docs /config /ajp.html

         APR (HTTP/AJP) Connector: /docs /apr.html

         Define a non-SSL HTTP/1.1 Connector on port 8080

    -->

  <!--

    <Connector port="8080"

               maxThreads="300" minSpareThreads="25" maxSpareThreads="75"

               enableLookups="false" redirectPort="8443" acceptCount="400"

               debug="0" connectionTimeout="20000"

               disableUploadTimeout="true" URIEncoding="gbk " />     -->

 

<!-- A "Connector" using the shared thread pool-->

  

   

  < Connector executor = "tomcatThreadPool"

               port = "8080" protocol = "HTTP/1.1"

               connectionTimeout = "20000"

               redirectPort = "8443" enableLookups = "false"   disableUploadTimeout = "true" URIEncoding = "gbk"

        compression = "on"

        noCompressionUserAgents = "gozilla, traviata"

        compressableMimeType = "text/html,text/xml,text/javascript,text/css,text/plain,application/json"

 

   />

             

    <!-- Define a SSL HTTP/1.1 Connector on port 8443

         This connector uses the JSSE configuration, when using APR, the

         connector should be using the OpenSSL style configuration

         described in the APR documentation -->

    <!--

    <Connector port="8443" protocol="HTTP/1.1" SSLEnabled="true"

               maxThreads="150" scheme="https " secure="true"

               clientAuth="false" sslProtocol="TLS" />

    -->

 

    <!-- Define an AJP 1.3 Connector on port 8009 -->

    < Connector port = "8009" protocol = "AJP/1.3" redirectPort = "8443" />

 

 

    <!-- An Engine represents the entry point (within Catalina ) that processes

         every request.  The Engine implementation for Tomcat stand alone

         analyzes the HTTP headers included with the request, and passes them

         on to the appropriate Host (virtual host).

         Documentation at /docs /config /engine.html -->

 

    <!-- You should set jvmRoute to support load-balancing via AJP ie :

    <Engine name="Catalina " defaultHost="localhost " jvmRoute="jvm1">        

    -->

    < Engine name = "Catalina" defaultHost = "localhost" jvmRoute = "tomcat39" >

 

      <!--For clustering, please take a look at documentation at:

          /docs /cluster-howto.html  (simple how to)

          /docs /config /cluster.html (reference documentation) -->

     

      < Cluster className = "org.apache.catalina.ha.tcp.SimpleTcpCluster" channelSendOptions = "8" >

       < Manager className = "org.apache.catalina.ha.session.DeltaManager"

                  expireSessionsOnShutdown = "false"

                  notifyListenersOnReplication = "true" />

       < Channel className = "org.apache.catalina.tribes.group.GroupChannel" >

       < Membership className = "org.apache.catalina.tribes.membership.McastService"

                     address = "228.0.0.4"

                     port = "45564"

                     frequency = "500"

                     dropTime = "3000" />

       < Receiver className = "org.apache.catalina.tribes.transport.nio.NioReceiver"

                address = "211.151.*.39"

                port = "4000"

                autoBind = "100"

                selectorTimeout = "5000"

                maxThreads = "6" />  

         < Sender className = "org.apache.catalina.tribes.transport.ReplicationTransmitter" >

              < Transport className = "org.apache.catalina.tribes.transport.nio.PooledParallelSender" />

            </ Sender >

            < Interceptor className = "org.apache.catalina.tribes.group.interceptors.TcpFailureDetector" />

            < Interceptor className = "org.apache.catalina.tribes.group.interceptors.MessageDispatch15Interceptor" />

         < Interceptor className = "org.apache.catalina.tribes.group.interceptors.ThroughputInterceptor" />

          </ Channel >

 

          < Valve className = "org.apache.catalina.ha.tcp.ReplicationValve"

                 filter = "" />

          < Valve className = "org.apache.catalina.ha.session.JvmRouteBinderValve" />

 

          < Deployer className = "org.apache.catalina.ha.deploy.FarmWarDeployer"

                    tempDir = "/tmp/war-temp/"

                    deployDir = "/tmp/war-deploy/"

                    watchDir = "/tmp/war-listen/"

                    watchEnabled = "false" />

 

          < ClusterListener className = "org.apache.catalina.ha.session.JvmRouteSessionIDBinderListener" />

          < ClusterListener className = "org.apache.catalina.ha.session.ClusterSessionListener" />

      </ Cluster >

             

      < Realm className = "org.apache.catalina.realm.UserDatabaseRealm"

             resourceName = "UserDatabase" />

 

      <!-- Define the default virtual host

           Note: XML Schema validation will not work with Xerces 2.2.

       -->

      < Host name = "localhost"   appBase = "webapps"

            unpackWARs = "true" autoDeploy = "true"

            xmlValidation = "false" xmlNamespaceAware = "false" >

      

        < Valve className = "org.apache.catalina.valves.AccessLogValve"

                 directory = "log"   prefix = "localhost_access_log." suffix = ".txt"

                 pattern = "%t %r %s %T" resolveHosts = "false" />

      </ Host >

    </ Engine >

  </ Service >

</ Server >

配置 tomcat40(server.xml)

<? xml version = '1.0' encoding = 'utf-8' ?>

 

< Server port = "8005" shutdown = "SHUTDOWN" >

 

  <!--APR library loader. Documentation at /docs /apr.html -->

  < Listener className = "org.apache.catalina.core.AprLifecycleListener" SSLEngine = "on" />

  <!--Initialize Jasper prior to webapps are loaded. Documentation at /docs /jasper -howto.html -->

  < Listener className = "org.apache.catalina.core.JasperListener" />

  <!-- JMX Support for the Tomcat server. Documentation at /docs /non-existent.html -->

  < Listener className = "org.apache.catalina.mbeans.ServerLifecycleListener" />

  < Listener className = "org.apache.catalina.mbeans.GlobalResourcesLifecycleListener" />

 

  <!-- Global JNDI resources

       Documentation at /docs /jndi -resources-howto.html

  -->

  < GlobalNamingResources >

    <!-- Editable user database that can also be used by

         UserDatabaseRealm to authenticate users

    -->

    < Resource name = "UserDatabase" auth = "Container"

              type = "org.apache.catalina.UserDatabase"

              description = "User database that can be updated and saved"

              factory = "org.apache.catalina.users.MemoryUserDatabaseFactory"

              pathname = "conf/tomcat-users.xml" />

  </ GlobalNamingResources >

 

  <!-- A "Service" is a collection of one or more "Connectors" that share

       a single "Container" Note:  A "Service" is not itself a "Container",

       so you may not define subcomponents such as "Valves" at this level.

       Documentation at /docs /config /service.html

   -->

  < Service name = "Catalina" >

 

    <!--The connectors can use a shared executor, you can define one or more named thread pools-->

   

    < Executor name = "tomcatThreadPool" namePrefix = "catalina-exec-"

         maxThreads = "500" minSpareThreads = "50" maxIdleTime = "60000" />

   

   

    <!-- A "Connector" represents an endpoint by which requests are received

         and responses are returned. Documentation at :

         Java HTTP Connector: /docs /config /http.html (blocking & non-blocking)

         Java AJP  Connector: /docs /config /ajp.html

         APR (HTTP/AJP) Connector: /docs /apr.html

         Define a non-SSL HTTP/1.1 Connector on port 8080

    -->

  <!--

    <Connector port="8080"

               maxThreads="300" minSpareThreads="25" maxSpareThreads="75"

               enableLookups="false" redirectPort="8443" acceptCount="400"

               debug="0" connectionTimeout="20000"

               disableUploadTimeout="true" URIEncoding="gbk " />     -->

 

<!-- A "Connector" using the shared thread pool-->

  

   

  < Connector executor = "tomcatThreadPool"

               port = "8080" protocol = "HTTP/1.1"

               connectionTimeout = "20000"

               redirectPort = "8443" enableLookups = "false"   disableUploadTimeout = "true" URIEncoding = "gbk"

        compression = "on"

        noCompressionUserAgents = "gozilla, traviata"

        compressableMimeType = "text/html,text/xml,text/javascript,text/css,text/plain,application/json"

 

   />

             

    <!-- Define a SSL HTTP/1.1 Connector on port 8443

         This connector uses the JSSE configuration, when using APR, the

         connector should be using the OpenSSL style configuration

         described in the APR documentation -->

    <!--

    <Connector port="8443" protocol="HTTP/1.1" SSLEnabled="true"

               maxThreads="150" scheme="https " secure="true"

               clientAuth="false" sslProtocol="TLS" />

    -->

 

    <!-- Define an AJP 1.3 Connector on port 8009 -->

    < Connector port = "8009" protocol = "AJP/1.3" redirectPort = "8443" />

 

 

    <!-- An Engine represents the entry point (within Catalina ) that processes

         every request.  The Engine implementation for Tomcat stand alone

         analyzes the HTTP headers included with the request, and passes them

         on to the appropriate Host (virtual host).

         Documentation at /docs /config /engine.html -->

 

    <!-- You should set jvmRoute to support load-balancing via AJP ie :

    <Engine name="Catalina " defaultHost="localhost " jvmRoute="jvm1">        

    -->

    < Engine name = "Catalina" defaultHost = "localhost" jvmRoute = "tomcat39" >

 

      <!--For clustering, please take a look at documentation at:

          /docs /cluster-howto.html  (simple how to)

          /docs /config /cluster.html (reference documentation) -->

     

      < Cluster className = "org.apache.catalina.ha.tcp.SimpleTcpCluster" channelSendOptions = "8" >

       < Manager className = "org.apache.catalina.ha.session.DeltaManager"

                  expireSessionsOnShutdown = "false"

                  notifyListenersOnReplication = "true" />

       < Channel className = "org.apache.catalina.tribes.group.GroupChannel" >

       < Membership className = "org.apache.catalina.tribes.membership.McastService"

                     address = "228.0.0.4"

                     port = "45564"

                     frequency = "500"

                     dropTime = "3000" />

       < Receiver className = "org.apache.catalina.tribes.transport.nio.NioReceiver"

                address = "211.151.*.39"

                port = "4000"

                autoBind = "100"

                selectorTimeout = "5000"

                maxThreads = "6" />  

         < Sender className = "org.apache.catalina.tribes.transport.ReplicationTransmitter" >

              < Transport className = "org.apache.catalina.tribes.transport.nio.PooledParallelSender" />

            </ Sender >

            < Interceptor className = "org.apache.catalina.tribes.group.interceptors.TcpFailureDetector" />

            < Interceptor className = "org.apache.catalina.tribes.group.interceptors.MessageDispatch15Interceptor" />

         < Interceptor className = "org.apache.catalina.tribes.group.interceptors.ThroughputInterceptor" />

          </ Channel >

 

          < Valve className = "org.apache.catalina.ha.tcp.ReplicationValve"

                 filter = "" />

          < Valve className = "org.apache.catalina.ha.session.JvmRouteBinderValve" />

 

          < Deployer className = "org.apache.catalina.ha.deploy.FarmWarDeployer"

                    tempDir = "/tmp/war-temp/"

                    deployDir = "/tmp/war-deploy/"

                    watchDir = "/tmp/war-listen/"

                    watchEnabled = "false" />

 

          < ClusterListener className = "org.apache.catalina.ha.session.JvmRouteSessionIDBinderListener" />

          < ClusterListener className = "org.apache.catalina.ha.session.ClusterSessionListener" />

      </ Cluster >

             

      < Realm className = "org.apache.catalina.realm.UserDatabaseRealm"

             resourceName = "UserDatabase" />

 

      <!-- Define the default virtual host

           Note: XML Schema validation will not work with Xerces 2.2.

       -->

      < Host name = "localhost"   appBase = "webapps"

            unpackWARs = "true" autoDeploy = "true"

            xmlValidation = "false" xmlNamespaceAware = "false" >

      

        < Valve className = "org.apache.catalina.valves.AccessLogValve"

                 directory = "log"   prefix = "localhost_access_log." suffix = ".txt"

                 pattern = "%t %r %s %T" resolveHosts = "false" />

      </ Host >

    </ Engine >

  </ Service >

</ Server >

以上是参考的是 tomcat 集群配置 : http://yzb.hit.edu.cn/docs/cluster-howto.html

最后一步修改应用的 web.xml

< distributable />

加在 </web-app> 的前面

测试访问

在两个 tomcat 的应用首页设置不同的标记 , 表示你访问的页面在两个 tomcat 切换

我是这么做的

Tomcat39 服务器

 

Tomcat40 服务器

 

注意

以上配置是基于 tomcat session 复制实现 , 请确定保存在 session 中的对象必须实现 Serializable 接口 , 否则对象无法在服务器之间传输

结束

欢迎留言 , 转载最好能注明来源 !

博客
安全::hash密码存储
08-04 295
Hash在密码存储方面的应用
博客
【DNS】DNS SRV配置和检查
07-28 1313
检查DNS SRV配置信息
博客
[C++] - GCC和LLVM对方法 warning: non-void function does not return a value [-Wreturn-type] 的处理差异
11-21 1140
GCC和LLVM对方法 warning: non-void function does not return a value [-Wreturn-type] 的处理差异
博客
[KVM] qcow2增大磁盘空间
01-16 358
qemu-img info查看磁盘空间情况root@root-host:/lvm/1/VM# qemu-img info win10.qcow2 image: win10.qcow2file format: qcow2virtual size: 210G (225485783040 bytes)disk size: 11Gcluster_size: 65536Format specific information:compat: 1.1lazy refcounts: fal...
博客
【Git】- Filename too long
12-01 716
Git Filename too long
博客
SpringCloud异常不输出报错原因解决方法
11-24 735
在springcloud项目开发中由于配置原因发生异常时却没有打印错误，由于Fallback处理类是实现服务层接口，那就无法确定什么原因导致进入Fallback方法，这种情况下只能通过断点中断程序来实现。打开类ActionObserver，在onError增加断点，如下：再次执行请求，则进入上面设置的断点，则可以查看到异常原因！...
博客
对软件项目经验和理解、分享
10-22 1790
软件项目的理解全局把控：在整个项目的周期中所涉及到的需求、成本、进度、技术、安全以及团队管理、客户协调等多个方面，缺少其中一环都可能带来很多不确定性，进而导致所带来的项目风险，所以全局性思维在整个项目周期中至关重要的。工程思维：项目开发中不同的项目类型利用遵从不同的软件开发流程模型来指导项目开发流程、技术开发规范。每个成员都遵照统一的规范部署去设计、开发、测试、沟通，才能提高开发的效率，提高项目开发的质量。团队管理：会议是引导团队开发的最有效的方......
博客
Gitlab CI Could not resolve host: xxxx
07-18 1328
Gitlab CI Could not resolve host: xxxxGitlab CI构建项目都很正常也很好用，最近却发现构建项目异常，查看控制台发无法拉取git代码，报错信息：fatal: unable to access 'http://xxx.xxx.xxx.xxx:1024/***************.git/': Could not resolve host: xxx.xxx.xxx.xxx截图如下：一开始以为是不是DNS的问题，把配置改成IP地址也不行，出现 :Faile
博客
解决Rancher Dashbroad组件controller-manager、scheduler不健康的问题
05-16 2308
安装完k8s，在rancher导入完k8s集群之后，显示如下问题：解决：1、解决方法，把主节点如下两个文件：/etc/kubernetes/manifests/kube-controller-manager.yaml/etc/kubernetes/manifests/kube-scheduler.yaml找到中 --port=0 去掉即可；2、重启kubelet：root@hncs-k8s-1:~# systemctl restart kubelet.service.
博客
Caused by: java.lang.IllegalStateException: Only single-level inheritance supported: XxxxService
11-07 1175
Spring Cloud项目启动中，报如下异常：Caused by: java.lang.IllegalStateException: Only single-level inheritance supported: UserClientService at feign.Util.checkState(Util.java:129) at feign.Contract$BaseContract.parseAndValidateMetadata(Contract.java:51) at feign.
博客
记一次清除ddos肉鸡的经历
05-18 1万+
其实这个事情发生在2014年10月份的时候，那个时候就想把经历写成博客来着，但是当时任务过多搁置了，当然也不排除我懒的原因吧！最近也是因为在微云发现我当时保存的肉鸡样本，才想起现在来写点什么， 目前只能凭借依稀记忆和样本来写这篇博客啦。样本如下：好了begin 。。。 是这样的，公司内网有一题台服务器，一个星期到某个时段公司所有机器断网上不去网的情况，
博客
用eclipse运行和部署myeclipse项目
07-13 5533
用eclipse运行和部署myeclipse项目
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值