在 PyPy2.x 上安装 Gevent (源码安装)

最新推荐文章于 2021-11-08 16:48:21 发布

weixin_34327223

最新推荐文章于 2021-11-08 16:48:21 发布

阅读量286

点赞数

文章标签： python c/c++ git

原文链接：https://my.oschina.net/heshupingblog/blog/192055

版权

2019独角兽企业重金招聘Python工程师标准>>>

python / gevent / pypy

PyPy has been on my radar for a while but I have never really brought myself to the point of actually trying it. Recently, a notification caught to my attention stating PyPy 2.0.2 was released and had support to run Gevent. Good news! I was looking at speed improvements for my Wishbone library and decided to spend some effort into getting PyPy with Gevent up and running. The information available explaining how to setup Gevent in PyPy is rather sparse which might be a bit time consuming when you have to figure out the bits and pieces. After some tinkering I got PyPy with Gevent up and running within virtualenv on a Fedora host. Here are my notes, It might be useful for you to and save some previous time:

Before you proceed make sure you have read the "building-from-source" instructions from the PyPy site.

Compiling

PyPy has some binaries available but they can only be used on Ubuntu so we'll have to download the source and compile from scratch.

Start by downloading the source and unpack the tarball.

$ tar -xvjf pypy-2.0.2-src.tar.bz2

Before starting to compile make sure we have all required libraries installed:

$ yum install openssl-devel libffi-devel ncurses-devel expat-devel bzip2-devel

Move into our unpacked directory and start the compilation. In the below examples we use the Python version which comes with your os to run the compilation process.

$ cd pypy-2.0.2-src/pypy/goal
$ python ../../rpython/bin/rpython --opt=jit targetpypystandalone.py
这里我需要至少3g内存去编译pypy环境

The compilation process is fairly lengthy. It took +- 90 minutes(!) on my laptop for the process to finish.

Prepare the installation

When the compilation has finished we should have a file called pypy-c in the current directory.

Best is to move the complete install to the /opt/ directory and rename the directory appropriately.

$ mv pypy-2.0.2-src /opt/pypy-2.0.2

Now let's use virtualenv to create an isolated instance of PyPy, keeping your freshly compiled one clean:

$ virtualenv -p /opt/pypy-2.0.2/pypy/goal/pypy-c ~/pypy-2.0.2
$ . ~/pypy-2.0.2/bin/activate

Gevent

First make sure you have following library installed:

$ yum install libev-devel

Install the cffi module:

(pypy-2.0.2)$ pip install cffi

Install a version of Gevent which has been modified to run on PyPy. Make sure we install Gevent inside our virtualenv:

$ git clone https://github.com/schmir/gevent.git
$ cd gevent
$ git checkout pypy-hacks
$ . ~/pypy-2.0.2/bin/activate(pypy-2.0.2)
$ pypy setup.py install

Now we need one last modification which implements gevent.core as cffi module:

$ git clone https://github.com/gevent-on-pypy/pypycore.git
$ cd pypycore
$ . ~/pypy-2.0.2/bin/activate(pypy-2.0.2)
$ CFLAGS=-O2 pip install -e .

If setup.py complains it can not locate ev.h it's possible the library search path isn't complete. In that case locate the location of the file and add that directory to pypycore.py (starts at line 207) using the include_dirs variable:

libev = C = ffi.verify(""" // passed to the real C compiler#includevoid gevent_noop(struct ev_loop *_loop, void *watcher, int revents) { }""", libraries=["ev"], include_dirs=["/usr/include/libev"])

Test

Before starting PyPy we have to make sure gevent used the right gevent.core:* *

$ export GEVENT_LOOP=pypycore.loop

Now start PyPy and execute some gevent code:

$ . ~/pypy-2.0.2/bin/activate(pypy-2.0.2)
$ pypy
Python 2.7.3 (5acfe049a5b0cd0de158f62553a98f5ef364fd29, Jun 01 2013, 08:37:22)[PyPy 2.0.2 with GCC 4.7.2 20121109 (Red Hat 4.7.2-8)] on linux2Type "help", "copyright", "credits" or "license" for more information.And now for something completely different: ``PyPy 1.3 released (windowsbinaries included)''
>>>> import gevent
>>>> for _ in xrange(100):.... gevent.spawn(gevent.sleep, 1)