PyPy v7.3.0: release of 2.7, and 3.6

The PyPy team is proud to release the version 7.3.0 of PyPy, which includes two different interpreters:

  • PyPy2.7, which is an interpreter supporting the syntax and the features of Python 2.7 including the stdlib for CPython 2.7.13

  • PyPy3.6: which is an interpreter supporting the syntax and the features of Python 3.6, including the stdlib for CPython 3.6.9.

The interpreters are based on much the same codebase, thus the double release.

We have worked with the python packaging group to support tooling around building third party packages for python, so this release changes the ABI tag for PyPy.

Based on the great work done in portable-pypy, the linux x86 downloads we provide are now built on top of the manylinux2010 CentOS6 docker image. The tarballs include the needed shared objects to run on any platform that supports manylinux2010 wheels, which should include all supported versions of debian- and RedHat-based distributions (including Ubuntu, CentOS, and Fedora).

The CFFI backend has been updated to version 1.13.1. We recommend using CFFI rather than c-extensions to interact with C.

The built-in _cppyy module was upgraded to 1.10.6, which provides, among others, better template resolution, stricter enum handling, anonymous struct/unions, cmake fragments for distribution, optimizations for PODs, and faster wrapper calls. We reccomend using cppyy for performant wrapping of C++ code for Python.

The vendored pyrepl package for interaction inside the REPL was updated.

Support for codepage encoding and decoding was added for Windows.

As always, this release fixed several issues and bugs raised by the growing community of PyPy users. We strongly recommend updating. Many of the fixes are the direct result of end-user bug reports, so please continue reporting issues as they crop up.

You can download the v7.3 releases here:

We would like to thank our donors for the continued support of the PyPy project. If PyPy is not quite good enough for your needs, we are available for direct consulting work.

We would also like to thank our contributors and encourage new people to join the project. PyPy has many layers and we need help with all of them: PyPy and RPython documentation improvements, tweaking popular modules to run on pypy, or general help with making RPython’s JIT even better. Since the previous release, we have accepted contributions from 3 new contributors, thanks for pitching in.

If you are a python library maintainer and use c-extensions, please consider making a cffi / cppyy version of your library that would be performant on PyPy. If you are stuck with using the C-API, you can use docker images with PyPy built in or the multibuild system to build wheels.

What is PyPy?

PyPy is a very compliant Python interpreter, almost a drop-in replacement for CPython 2.7, 3.6. It’s fast (PyPy and CPython 2.7.x performance comparison) due to its integrated tracing JIT compiler.

We also welcome developers of other dynamic languages to see what RPython can do for them.

This PyPy release supports:

  • x86 machines on most common operating systems (Linux 32/64 bits, Mac OS X 64 bits, Windows 32 bits, OpenBSD, FreeBSD)

  • big- and little-endian variants of PPC64 running Linux,

  • s390x running Linux

  • 64-bit ARM machines running Linux.

Unfortunately at the moment of writing our ARM buildbots are out of service, so for now we are not releasing any binary for the ARM architecture (32 bit), although PyPy does support ARM 32 bit processors.

Changelog

Changes shared across versions

  • Fix segfault when calling descr-methods with no arguments

  • Change the SOABI and subsequently change the reported ABI tag.

  • Update the builtin _cppyy backend to 1.10.6

  • Performance improvements in string/unicode handling

  • Fix compilation error when building revdb (issue 3084, actually released in PyPy 7.2 but not mentioned in the release notes)

  • Add JIT options to documentation and an option for JIT help via pypy --jit help

  • Fix regex escapes in pyrepl (issue 3097)

  • Allow reloading of subclasses of module (issue 3099)

  • Work around a gcc bug, which was reported to them and fixed (issue 3086)

  • Fix (again) faulty logic when decoding invalid UTF-8 (issue 2389)

  • Fix up LICENSE file

  • Turn all http links in the documentation to https

  • Update the bndled pip and setuptools (used in pypy -mensurepip to version that support manylinux2010 wheels

  • Link the DEFAULT_SOABI to the PYPY_VERSION

  • Workaround for programs calling sys.setrecursionlimit(huge_value) (issue 3094)

  • Set minimal MACOSX_DEPLOYMENT_TARGET to 10.7 on macOS; cpython uses 10.5

  • Fix a JIT bug causing rare register corruption on aarch64

  • Add discovery of ncursesw when building _minimal_curses and improve handling of old curses versions (issue 2970)

  • Improve the error message for class X(random_object) (issue 3109)

  • Deal with json dicts containing repeated keys in the new map based parser (issue 3108)

  • Port parts of the portable pypy repackaging scripts to add an option for RPATH manipulation on linux

  • Check for overflow in ctypes array creation

  • Better support and report MSVC versions used to compile on windows

  • Allow any kind of buffer in socket.setsockopt(), like CPython (issue 3114)

  • Fix importing a module with unicode in sys.path (issue 3112)

  • Support OpenSSL 1.1 and TLSv1_3

  • Remove the (deprecated since 5.7) asmgcc rootfinder from the GC

  • Overflow in RPython when converting 2<<32 into a Signed on 32-bit platforms rather than automatically using a SignedLongLong, require an explicit r_int64() call instead

  • Fix multithread contention when creating an object in cffi (PyPy only)

  • Copy lib/* shared objects in portable builds when creating virtual environments with virtualenv and venv

  • Potential fix in rare-case JIT optimizer (issue 3128)

C-API (cpyext) and c-extensions

  • Add _PySet_Next, _PySet_NextEntry

  • Correctly swallow exceptions happening inside PyDict_GetItem() (issue 3098)

  • Respect tp_dict on PyType_Ready

  • Allow calling PyType_Ready on a subclass with a partially built tp_base (issue 3117`_)

  • Rename tuple_new to _PyPy_tuple_new to follow the naming convention of exported symbols in libpypy-c.so

  • Actually restore the traceback in PyErr_Restore (issue 3120)

Python 3.6 only

  • Don’t grow the lzma.decompress() buffer past max_length (issue 3088)

  • Backport fix from CPython for failure of lzma to decompress a file (issue 3090)

  • Fix asyncgen_hooks and refactor coroutine execution

  • Fix range checking in GB18030 decoder (CPython issue 29990)

  • Fix handling escape characters in HZ codec (CPython issue 30003)

  • Reject null characters in a few more functions (CPython issue 13617)

  • Fix build on macOS without clock_gettime (before 10.12 and xcode 8, released 2016)

  • Backport 3.7.5 changes to timedelta.__eq__ and time.__eq__ (CPython issue 37579)

  • Backport more fixes to comparisons in datetime.py (CPython issue 37985)

  • Use the python tag in pyc file names, not the abi tag

  • Handle string formatting with a single [ in the format string (issue 3100)

  • Backport some of the patches in macports pypy

  • Add missing HAVE_FACCESSAT to posix._have_functions

  • Update pyrepl from upstream package (issue 2971)

  • Fix PyFrame._guess_function_name_parens()

  • Fix range of allowed years in time.mktime to match CPython 13312

  • Generators need to store the old current exc_info in a place that is visible, because in one corner case a call to sys.exc_info() might need it. (issue 3096)

  • Remove incorrect clobbering of the locals after running exec()

  • Adds encoding, decoding codepages on win32

  • Remove socket error attributes from _ssl (issue 3119)

  • Add missing os.getgrouplist (part of issue 2375)

  • Back-port the tentative fix from cpython: “Import deadlock detection causes deadlock” (part of issue 3111)

  • Fix handling of sys.exc_info() in generators

  • Return W_IntObject when converting from float to int when possible, which speeds up many code paths.

Python 3.6 C-API

  • Add PyObject_GenericGetDict, PyObject_GenericSetDict, _Py_strhex, _Py_strhex_bytes, PyUnicodeNew, _PyFinalizing, PySlice_Unpack, PySlice_AdjustIndices, PyOS_FSPath, PyModule_AddFunctions

  • Implement pystrhex.h (issue 2687)

  • Make PyUnicodeObject slightly more compact

  • Fix memory leak when releasing a PyUnicodeObject