Blazing fast node.js: 10 performance tips from LinkedIn Mobile

In a previous post, we discussed how we test LinkedIn's mobile stack, including our Node.js mobile server. Today, we’ll tell you how we make this mobile server fast. Here are our top 10 performance takeaways for working with Node.js:

1. Avoid synchronous code

By design, Node.js is single threaded. To allow a single thread to handle many concurrent requests, you can never allow the thread to wait on a blocking, synchronous, or long running operation. A distinguishing feature of Node.js is that it was designed and implemented from top to bottom to be asynchronous. This makes it an excellent fit for evented applications.

Unfortunately, it is still possible to make synchronous/blocking calls. For example, many file system operations have both asynchronous and synchronous versions, such as writeFile and writeFileSync. Even if you avoid synchronous methods in your own code, it's still possible to inadvertently use an external library that has a blocking call. When you do, the impact on performance is dramatic.

      
      
// Good: write files asynchronously
fs . writeFile ( 'message.txt' , 'Hello Node' , function ( err ) {
   console . log ( "It's saved and the server remains responsive!" );
});
// BAD: write files synchronously
fs . writeFileSync ( 'message.txt' , 'Hello Node' );
console . log ( "It's saved, but you just blocked ALL requests!" );
view raw Synchronous.js This Gist brought to you by  GitHub.

Our initial logging implementation accidentally included a synchronous call to write to disc. This went unnoticed until we did performance testing. When benchmarking a single instance of Node.js on a developer box, this one synchronous call caused a performance drop from thousands of requests per second to just a few dozen!

2. Turn off socket pooling

The Node.js http client automatically uses socket pooling: by default, this limits you to 5 sockets per host. While the socket reuse may keep resource growth under control, it will be a serious bottleneck if you need to handle many concurrent requests that all need data from the same host. In these scenarios, it's a good idea to increase maxSockets or entirely disable socket pooling:

      
      
// Disable socket pooling
var http = require ( 'http' );
var options = {.....};
options . agent = false ;
var req = http . request ( options )

3. Don't use Node.js for static assets

For static assets, such as CSS and images, use a standard webserver instead of Node.js. For example, LinkedIn mobile uses nginx. We also take advantage of Content Delivery Networks (CDNs), which copy the static assets to servers around the world. This has two benefits: (1) we reduce load on our Node.js servers and (2) CDNs allow static content to be delivered from a server close to the user, which reduces latency.

4. Render on the client-side

Let's quickly compare rendering a page server-side vs. client-side. If we have Node.js render server-side, we'll send back an HTML page like this for every request:

      
      
<!-- An example of a simple webpage rendered entirely server side -->
<!DOCTYPE html>
<html>
   <head>
     <title>LinkedIn Mobile </title>
   </head>
   <body>
     <div class= "header" >
       <img src= "http://mobile-cdn.linkedin.com/images/linkedin.png" alt= "LinkedIn" />
     </div>
     <div class= "body" >
      Hello John!
     </div>
   </body>
</html>

Note that everything on this page, except for the user's name, is static: that is, it's identical for every user and page reload. So a much more efficient approach is to have Node.js return just the dynamic data needed for the page as JSON:

      
      
{ "name" : "John" }
view raw ReturnJustJson.js This Gist brought to you by  GitHub.

The rest of the page - all the static HTML markup - can be put into a JavaScript template (such as anunderscore.js template):

      
      
<!-- An example of a JavaScript template that can be rendered client side -->
<!DOCTYPE html>
<html>
   <head>
     <title>LinkedIn Mobile </title>
   </head>
   <body>
     <div class= "header" >
       <img src= "http://mobile-cdn.linkedin.com/images/linkedin.png" alt= "LinkedIn" />
     </div>
     <div class= "body" >
      Hello <%= name %>!
     </div>
   </body>
</html>

Here's where the performance benefit comes in: as per tip #3, the static JavaScript template can be served from your webserver (e.g. nginx) and, even better, from a CDN. Moreover, JavaScript templates can be cached in the browser or saved in LocalStorage, so after the initial page load, the only data sent to the client is the dynamic JSON, which is maximally efficient. This approach dramatically reduces the CPU, IO, and load on Node.js.

5. Use gzip

Most servers and clients support gzip to compress requests and responses. Make sure you take advantage of it, both when responding to clients and when making requests to remote servers:

Use gzip

6. Go parallel

Try to do all your blocking operations - that is, requests to remote services, DB calls, and file system access - in parallel. This will reduce latency to the slowest of the blocking operations rather than the sum of each one in sequence. To keep the callbacks and error handling clean, we use Step for flow control.

Make blocking calls in parallel

7. Go session-free

LinkedIn mobile uses the Express framework to manage the request/response cycle. Most express examples include the following configuration:

      
      
app . use ( express . session ({ secret : "keyboard cat" }));
view raw ExpressSession.js This Gist brought to you by  GitHub.

By default, session data is stored in memory, which can add significant overhead to the server, especially as the number of users grows. You could switch to an external session store, such as MongoDB or Redis, but then each request incurs the overhead of a remote call to fetch session data. Where possible, the best option is to store no state on the server-side at all. Go session free by NOT including the express config above and you'll see better performance.

8. Use binary modules

When available, use binary modules instead of JavaScript modules. For example, when we switched from a SHA module written in JavaScript to the compiled version that comes with Node.js, we saw a big performance bump:

      
      
// Use built in or binary modules
var crypto = require ( 'crypto' );
var hash = crypto . createHmac ( "sha1" , key ). update ( signatureBase ). digest ( "base64" );
view raw BinaryModules.js This Gist brought to you by  GitHub.

9. Use standard V8 JavaScript instead of client-side libraries

Most JavaScript libraries are built for use in a web browser, where the JavaScript environment is inconsistent: for example, one browser may support functions like forEachmap and reduce, but other browsers don't. As a result, client-side libraries usually have a lot of inefficient code to overcome browser differences. On the other hand, in Node.js, you know exactly what JavaScript functions are available: the V8 JavaScript engine that powers Node.js implements ECMAScript as specified inECMA-262, 5th edition. By directly using the standard V8 functions instead of client libraries, you may see significant performance gains.

10. Keep your code small and light

Working with mobile, where devices are slower and latencies are higher, teaches you to keep your code small and light. Apply this same idea to your server code as well. Revisit your decisions from time to time and ask yourself questions like: “Do we really need this module?”, “Why are we using this framework? Is it worth the overhead?”, “Can we do this in a simpler way?”. Smaller, lighter code is usually more efficient and faster.

Try it out

We worked hard to make our mobile apps fast. Try them out and let us know how we did: we have aniPhone appAndroid app and an HTML5 mobile version.

原文地址:http://engineering.linkedin.com/nodejs/blazing-fast-nodejs-10-performance-tips-linkedin-mobile

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值