Mailman 3 April 2020 - pypy-dev

PyPy Winter Sprint + cpyext
by Stefan Beyer Dec. 21, 2022

Dec. 21, 2022

Hey everyone! Those of you who attended or followed one of the last two winter sprints in Leysin might know me, the others probably won't. I'm (still) a Master's student writing my thesis on PyPy's current issue with cross-heap cycles when using cpyext. The main point is, that they are not collected and stay around as floating garbage, even if they are not reachable any more. Correct me if I'm wrong, but I didn't notice anyone else working on that topic (and/or committing something) since I've picked it up two years ago (yeah, I know, that long ago...). I saw that you would be working on "cpyext performance and completeness" during the current winter sprint this week and thought that this might also concern my thesis. So I thought I'll give you an update. I recently pushed my current (non-optimized, breaking-some-tests, but more or less working) implementation of the "CPython-style" GC-extension for cpyext. It is still in an early stage and not all cases (legacy and non-legacy-finalizers, weakrefs) are handled. However, I picked up some pace during the last couple of weeks and I'm determined to finish this implementation during the following weeks (some quirks with the tests have been haunting me, but I think I figured most of them out by now). After that, I will implement a second alternative implementation (to compare to, mostly for the sake of my thesis), which will take some more time. I also added a couple of fancy test cases (the so called "dot-tests"), so that we can test complex object graphs a little bit easier (and also because it was kind of cool to have another language inside PyPy/RPython, even if it was only for the tests...), with more test cases to come (the current ones are a bit messy). None of the new changes concerning low-latency applications are currently integrated, but that should not be too hard. I guess it won't make much sense for me to join you at this year's winter sprint, especially as I won't be able to get there before Thursday, but I might be able to join you over the IRC channel (or some other form of communication if you like). If there is anything that is worth discussing please let me know! Also feel free to comment on my code, but beware that I might change some things once I try to do some optimizations (probably not many, but at least fix the worst issues) and make it a little bit more readable. You can find my code on the cpyext-gc-cycle branch.<https://bitbucket.org/pypy/pypy/commits/branch/cpyext-gc-cycle> Looking forward to hearing from you! Greetings, Stefan

2 2

We have officially moved to foss.heptapod.net/pypy
by Matti Picus Sept. 1, 2020

Sept. 1, 2020

As reported in the recent blog post https://morepypy.blogspot.com/2020/02/pypy-and-cffi-have-moved-to-heptapod.…, please do not add content to bitbucket.org/pypy or any of the repos there. From now on use https://foss.heptapod.net/pypy/pypy. The repos will continue to live on bitbucket until May 31, and we are still hosting our wiki and downloads there, but activity should move to the new instance. Anyone can open an issue, but in order to commit (as explained in the previous mail) you will need permissions on the repo. The FOSS heptapod instance does not support personal forks, so for now PRs will be branches (heptapod recommends topic branches but some of us are not convinced) on the main repo. Also take a look at the facelift on www.pypy.org. Matti

3 2

cffi embedding interface uwsgi plugin
by Daniel Holth May 27, 2020

May 27, 2020

I'm playing with the cffi embedding interface. I dusted off the uwsgi pypy plugin and began porting it to the new interface. I'm very impressed at how little C is required to make it work. The Python code embedded in the module, that attaches Python functions to uwsgi's plugin interface with @ffi.def_extern(), could be replaced with "import <module passed as uwsgi argument>" and you could iterate on this without (the 1-second of) recompiling each time. A suitably motivated person could build an ASGI server this way. Need to look up how to initialize virtualenv at the Python level. I had more success with pypy 7.1.1 which seemed to be finding the virtualenv based on the working directory. Currently pypy 7.3.1 is having trouble finding the os module in pypy_init_home. And this patch https://foss.heptapod.net/pypy/cffi/issues/450 is needed to get rid of a warning. When it works the cool demo would be to compile suffixed variants of the plugin for pypy and cpython, having one uwsgi emperor mange servers in both languages. It's at https://github.com/unbit/uwsgi/pull/2146/files Cheers, Daniel Holth

2 3

PyPy 7.3.1 is out
by Matti Picus April 28, 2020

April 28, 2020

2 1

Fwd: foss.heptapod.net: major downtime next Monday for upgrade to 0.12
by Matti Picus April 15, 2020

April 15, 2020

1 0

windows 64 bit
by Steven Mathews April 14, 2020

April 14, 2020

I saw pypy is windows 32bit. Does that mean my code won't be able to use 32GB of RAM, only 4GB ?

2 1

Moving the canonical download link away from bitbucket
by Matti Picus April 13, 2020

April 13, 2020

Thanks to Maciej and Armin, we now have https;/bitbucket.pypy.org/pypy as a nicer index to https:/bitbucket.pypy.org/mirror, which is a mirror of the bitbucket-hosted downloads. The idea is that we will get the PSF to put a CDN in front of https;/bitbucket.pypy.org/pypy and host it as https://downloads.python.org/pypy. Any thoughts how to make the downloads page prettier? The Jinja2 template used to build the page lives at https://foss.heptapod.net/pypy/buildbot/blob/branch/default/master/template…, suggestions or PRs to improve it are more than welcome. Note the buildbot now can be accessed via https. Matti

1 2

How to install pypy on Mac OS X?
by Peng Yu April 9, 2020

April 9, 2020

Hi, I see people recommend to use brew to install pypy on Mac OS X. https://stackoverflow.com/questions/20502471/how-to-use-pypy-on-a-mac $ ls -lg $(which pypy) lrwxr-xr-x 1 staff 31 2019/10/27-09:33:52 /usr/local/bin/pypy -> ../Cellar/pypy/7.1.1_1/bin/pypy $ ls -lg $(which pypy3) lrwxr-xr-x 1 staff 33 2019/10/27-09:20:07 /usr/local/bin/pypy3 -> ../Cellar/pypy3/7.1.1_1/bin/pypy3 But it seems that this installed pypy does not know python modules installed in this directory. /Library/Frameworks/Python.framework Is there a way to install pypy on Mac OS so that the modules installed in the above directory are accessible by pypy? Thanks. -- Regards, Peng

2 1

Scipy install/build fails
by Guillaume Dubé April 8, 2020

April 8, 2020

Hi Pypy Dev I was wondering if scipy is supported by pypy3. I’ve been trying (and googling) for a few days. Any help you could provide would me much appreciated. See the attachment for the install log. Here’s my env: macOS Catalina 10.15.3 xcode is installed an up to date % cat ~/.zshrc […] eval "$(pyenv init -)" pyenv global 3.6.5 export WORKON_HOME=~/.virtualenvs mkdir -p $WORKON_HOME . ~/.pyenv/versions/$(pyenv global)/bin/virtualenvwrapper.sh % pyenv --version pyenv 1.2.17 % pypy -V Python 3.6.9 (1608da62bfc71e8ac775121dd0b21bb72e61c6ea, Jan 08 2020, 22:53:09) [PyPy 7.3.0 with GCC 4.2.1 Compatible Apple LLVM 11.0.0 (clang-1100.0.33.16)] Intel® Math Kernal Library 2020 Update 1 for macOS* installed as administrator in /opt/intel ln -s /opt/intel/mkl/lib/libmkl_rt.dylib /Users/<user>/.virtualenvs/<project>/lib/libmkl_rt.dylib ln -s /usr/local/Cellar/pypy3/7.3.0/libexec/lib/libpypy3-c.dylib /Users/<user>/.virtualenvs/<project>/lib/libpypy3-c.dylib I’ve got a project with requirements.txt file Flask==1.0.2 Flask-Inputs==0.2.0 Jinja2==2.10 jsonschema==2.6.0 numpy>=1.14.4 pandas==0.23.0 pytest==3.6.0 python-dateutil==2.7.3 requests==2.18.4 scipy>=1.1.0 scikit-learn>=0.19.1 sklearn>=0.0 urllib3==1.22 Werkzeug==0.14.1 -- Guillaume Dubé Software Developer Expedia Group Inc.

3 4

pypy 7.3.1 rc3 is available, please test it out
by Matti Picus April 7, 2020

April 7, 2020

I have uploaded rc3 of the upcoming pypy v7.3.1 to https://bitbucket.org/pypy/pypy/downloads/ The sha256 hashes are here https://www.pypy.org/download.html#checksums The release notice is here https://doc.pypy.org/en/latest/release-v7.3.1.html Please download the tarball and try it out: make sure it all works as expected. Matti N.B: the downloads are still on bitbucket, we will be hosting them differently soon.

1 0