Perlbal is our Perl-based reverse proxy load balancer and web server

转载 2007年10月03日 18:45:00


Perlbal is our Perl-based reverse proxy load balancer and web server.


Perlbal is a single-threaded event-based server supporting HTTP load balancing, web serving, and a mix of the two (see below).

One of the defining things about Perlbal is that almost everything can be configured or reconfigured on the fly without needing to restart the software. A basic configuration file containing a management port enables you to easily perform operations on a running instance of Perlbal.

Here is a basic list of the personalities and features that Perlbal implements at this time.

Role: Web Server

  • Listen on a port, share from a directory
  • Directory indexing
  • Byte range support (clients can resume downloads)
  • Can have directory index requests fall back to index file list
    • I.e., requests for /foo/ go to /foo/index.html instead
    • Multiple index files supported, tries one at a time until it finds one
  • Persistent client connections (configurable)
  • Almost all1 disk operations are done asynchronously as to not stall the event loop
  • Configurable support for storing files (PUT, DELETE support)

1 Almost. When you enable PUT support, the close() operation is blocking. However, it’s generally pretty fast (we’ve had no problems). Also, directory indexing is a synchronous operation.

Role: Reverse Proxy

  • Maintains pool of connected backend connections to reduce turnover
  • Gets list of nodes either from asynchronously monitored node file, or from in-server pool objects which you can add/remove nodes from using the management interface.
  • Intelligent load balancing based on what backend connections are free for a new request. No unreliable “weighting” numbers required.
  • Can verify (using a quick OPTIONS request) that a backend connection is talking to a webserver and not just the kernel’s listen queue before sending client requests at it. Lower latency for the client.
  • Has a high priority queue for sending requests through to backends quickly
    • Uses cookies to determine if a request should go to fast queue (configurable)
    • Highpri (high priority) plugin supports making requests high priority by URI or Host
    • Can specify a relief level to let low priority requests through to prevent starvation
  • Can allow X-Forwarded-For (and similar) headers from client based on client IP
  • Configurable header management before sending request to backend
  • Internal redirection to file or URL(s)
    • Big one for us; a backend can instruct Perlbal to fetch the user’s data from a completely separate server and port and URL, 100% transparent to the user
    • Can actually give Perlbal a list of URLs to try. Perlbal will find one that’s alive. Again, the end user sees no redirects happening.
    • Can also redirect to a file, which Perlbal will serve non-blocking. See webserver mode above.
  • Persistent client connections (configurable)

Statistics and Monitoring

  • CPU usage (user, system)
  • Total requests served across all services
  • Requests service by individual backends
  • Perlbal uptime
  • All connected sockets (and tons of info about each)
  • Outstanding connections to backends
  • Backends that have recently failed verification
  • Pending backend connections by service
  • Total of all socket states by socket type
  • Size (in seconds and number of connections) of all queues
  • State of reproxy engine (queued requests, outstanding requests, backends)
  • Loaded plugins per service

(All statistics are in machine readable form, easy to parse and write scripts that check on the status of Perlbal!)

Plugins (Extensibility)

Perlbal supports the concept of having per-service (and global) plugins that can override many parts of request handling and behavior. We have written custom plugins that send new headers to the backends, promote requests to the fast queue, maintain more detailed statistics, do image header manipulation, and more…

For more information on how plugins work, see the plugins directory in the distribution. They’re fairly self-explanatory.

Much more documentation needs to happen…



Web Server 架构浅谈-Threadpool-based Multiple Threaded Achitecture

上节我们讲到了简单的多线程架构,这个架构可以做一些改进和优化: 首先,是优化线程创建的开销。操作系统默认的进程初始栈空间,32位操作系统为1M,64位操作系统为2M(不同操作系统版本可能会有差异)。...

web server:What you get is what I put

#!/usr/bin/env python from twisted.web import server,resource from twisted.internet import reactor i...

Reverse Proxy Web Sockets with Nginx and Socket.IO

最近一直在关注socket.io这个东西,看到一篇博客去仔细分析。引自:   If you’r...
  • cnhome
  • cnhome
  • 2011年11月03日 10:33
  • 1770

How To Turn Up Logging on the Siebel Web Server Extension in Siebel Versions 7.x and 8.x? [ID 477185

How To Turn Up Logging on the Siebel Web Server Extension in Siebel Versions 7.x and 8.x? [ID 477185...

How to Install NoCat Splash and Link it to an External Web Server

Compile NoCatSplash: goto and download the latest stable ...
  • zx824
  • zx824
  • 2012年07月09日 11:11
  • 2987

Setting up Django and your web server with uWSGI and nginx

设置Django和基于uWSGI和nginx的Web服务器概念the web client the web server the socket uwsgi Django创建Django项目pi...

PeopleSoft and the Load Balancer

We are doing a PeopleSoft PeopleTools upgrade among with upgrading our server environment to a "high...
您举报文章:Perlbal is our Perl-based reverse proxy load balancer and web server