Skip to content

[DIFF] Immutability for NoGIL for 3.15a - #112

Open
xFrednet wants to merge 3786 commits into
immutable-basefrom
immutable-nogil
Open

[DIFF] Immutability for NoGIL for 3.15a#112
xFrednet wants to merge 3786 commits into
immutable-basefrom
immutable-nogil

Conversation

@xFrednet

@xFrednet xFrednet commented Sep 24, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Collaborator

This is the entire diff to implement shallow and deep immutability for Python. This also includes the write-barriers from #63. The relevant files for this PR are probably:

Include/cpython/immutability.h
Include/internal/pycore_gc.h
Include/internal/pycore_immutability.h
Include/internal/pycore_object.h
Include/internal/pycore_stackref.h
Include/internal/pycore_weakref.h
Include/object.h
Include/refcount.h
Lib/immutable.py
Modules/_immutablemodule.c
Modules/_weakref.c
Objects/object.c
Objects/weakrefobject.c
Python/ceval.c
Python/crossinterp.c
Python/gc.c
Python/immutability.c

📚 Documentation preview 📚: https://cpython-previews--112.org.readthedocs.build/

miss-islington and others added 30 commits August 27, 2026 13:47
@miss-islington @terryjreedy
[3.15] pythongh-155648: Fix IDLE tests that cannot fail (pythonGH-156257
96ae61d 
) (python#156315)

Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>
@miss-islington @hoodmane
[3.15] pythongh-156243: Indicate that emscripten_runtime depends on s…
7d10c8d 
…tringToNewUTF8 (pythonGH-156335) (python#156383)

Co-authored-by: Hood Chatham <roberthoodchatham@gmail.com>
@miss-islington @arcivanov @warsaw
[3.15] pythongh-156404: Restore the 'fullname' variable for .pth impo…
224db4e 
…rt lines (pythonGH-156406) (python#156431)

Co-authored-by: Arcadiy Ivanov <arcadiy@ivanov.biz>
Co-authored-by: Barry Warsaw <barry@python.org>
@zooba
[3.15] pythongh-148750: Unfreeze encodings module to avoid import err…
5886ba2 
…ors with zipped stdlib (pythonGH-156183) (python#156328)
@zware
[3.15] pythongh-156369: Bump OpenSSL versions for iOS and Android (py…
7b69079 
…thonGH-156432) (python#156436)
@miss-islington @ned-deily
[3.15] pythongh-156369: Update macOS installer to use OpenSSL 3.5.8. (p…
bd83c3d 
…ythonGH-156447) (python#156449)

Co-authored-by: Ned Deily <nad@python.org>
@nedbat
[3.15] Docs: remove __path__ discussion from tutorial (pythonGH-156426)…
f6b7e5b 
… (python#156455)
@miss-islington @encukou
[3.15] pythongh-65961: Document __cached__ removal in What's New & cl…
1c82381 
…arify references to it (pythonGH-156053) (python#156123)

Co-authored-by: Petr Viktorin <encukou@gmail.com>
@miss-islington @deadlovelll
[3.15] pythongh-156246: Fix documented default of the asyncio limit a…
7b89973 
…rgument (pythonGH-156247) (python#156254)

Co-authored-by: Timofei Ivankov <128279579+deadlovelll@users.noreply.github.com>
@miss-islington @dr-carlos
[3.15] pythongh-141174: Test type_repr() of Template with invalid…
4c9ac60 
… syntax in `Interpolation` (pythonGH-155661) (python#155711)

Co-authored-by: dr-carlos <77367421+dr-carlos@users.noreply.github.com>
@miss-islington @dr-carlos
[3.15] pythongh-141174: Test get_annotations() on wrapped cyclical …
94aa79c 
…`functools.partial` (pythonGH-155663) (python#155709)

Co-authored-by: dr-carlos <77367421+dr-carlos@users.noreply.github.com>
@miss-islington @asnelling
@claude @serhiy-storchaka
[3.15] pythongh-90982: Document prefixes argument on site.getsitepack…
50c4698 
…ages (pythonGH-31546) (python#155643)

Co-authored-by: Addison Snelling <addison@asnell.io>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-84548: Document Windows specific behavior of abspath(…
6e4aa89 
…) and realpath() (pythonGH-155388) (python#155673)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-89024: Document the 3.10 change in escaping the csv e…
f47da0f 
…scapechar (pythonGH-155067) (python#155685)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@serhiy-storchaka @claude
[3.15] pythongh-154139: Document that curses is not thread-safe (pyth…
4951a11 
…onGH-154173) (python#155690)

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
@serhiy-storchaka
[3.15] pythongh-156234: Fix and rewrite the curses documentation on r…
6a9dbff 
…eading (pythonGH-156235) (python#156279)
@miss-islington @MannarAmuthan @ashkop
[3.15] pythongh-67765: Add tests for wsgiref.validate (pythonGH-112398)…
c15b6bf 
… (python#155622)

Co-authored-by: Amuthan Mannar <amuthanmannar4@gmail.com>
Co-authored-by: Alex Shkop <a.v.shkop@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-78526: Add tests for PEP 468 and PEP 520 (pythonGH-15…
a1b9786 
…5387) (python#155676)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-155732: Join the terminated process in test_repr_lock (…
bfa1595 
…pythonGH-155734) (python#155766)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @serhiy-storchaka
[3.15] pythongh-155727: Ignore internal imports in test_attribute_com…
a8e716a 
…pletion (pythonGH-155730) (python#155769)

Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
@miss-islington @dslavicek @tomasr8
[3.15] improve test_copy_reduce and test_deepcopy_reduce coverage (py…
5f6e39a 
…thonGH-154182) (python#155792)

Co-authored-by: David <slavicek.david29@gmail.com>
Co-authored-by: Tomas R. <tomas.roun8@gmail.com>
@miss-islington @picnixz
[3.15] pythongh-155430: fix hmac.digest bigmem test (pythonGH-155431)…
6f65cec 
… (python#155846)

Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>
@miss-islington @StanFromIreland
[3.15] pythongh-111735: Skip turtle doctests when _tkinter is not…
431f526 
… available (pythonGH-156417) (python#156470)

Co-authored-by: Stan Ulbrych <stan@python.org>
@miss-islington @zware
[3.15] pythongh-156369: Update Windows builds to OpenSSL 3.5.8 (pytho…
f1be67f 
…nGH-156528) (python#156530)

pythongh-156369: Update Windows builds to OpenSSL 3.5.8 (pythonGH-156528)
(cherry picked from commit b7ce9c3)

Co-authored-by: Zachary Ware <zach@python.org>
@miss-islington @StanFromIreland
[3.15] pythongh-155952: Fix <unrepresentable> Argument Clinic defau…
32beeab 
…lts in several signatures (pythonGH-155954) (python#156165)

pythongh-155952: Fix `<unrepresentable>` Argument Clinic defaults in several signatures (pythonGH-155954)
(cherry picked from commit 033dc43)

Co-authored-by: Stan Ulbrych <stan@python.org>
@miss-islington @fedonman
[3.15] pythongh-153772: Make abc isinstance() tolerate instances with…
d122f3e 
…out __class__ (pythonGH-154149) (python#156541)

pythongh-153772: Make abc isinstance() tolerate instances without __class__ (pythonGH-154149)

The built-in isinstance() reads an instance's __class__ with a lookup that
suppresses AttributeError and falls back to the object's type, so
isinstance(obj, int) returns False for an object whose __class__ access
raises. ABCMeta.__instancecheck__ read __class__ directly instead, so
isinstance(obj, Mapping) leaked that AttributeError.

Fall back to type(instance) when __class__ is unavailable, in both the C
and the pure-Python implementations, so the abstract base classes behave
like the built-in isinstance(). Such objects are unusual, but they do turn
up in the wild (for example some Qt widgets).
(cherry picked from commit 3e245fa)

Co-authored-by: Vyron Vasileiadis <hi@fedonman.com>
@miss-islington @deadlovelll
[3.15] pythongh-156523: Fix asyncio.as_completed() not recording the …
1eec518 
…awaiting task (pythonGH-156527) (python#156552)

Co-authored-by: Timofei Ivankov <128279579+deadlovelll@users.noreply.github.com>
@miss-islington @deadlovelll
[3.15] pythongh-155888: Fix asyncio writelines() hanging on an empty …
27d7bf2 
…chunk (pythonGH-155889) (python#155904)

Co-authored-by: Timofei Ivankov <128279579+deadlovelll@users.noreply.github.com>
@miss-islington @cuishuang
[3.15] pythongh-155781: Hold strong references to sqlite3 converters (p…
bd519fc 
…ythonGH-155784) (python#156192)

Co-authored-by: cui fliter <imcusg@gmail.com>
@miss-islington @clementperon
[3.15] pythongh-156115: Use the simulator deployment-target flag for …
928060b 
…iOS simulator builds (pythonGH-156116) (python#156211)

Co-authored-by: Clément Péron <peron.clem@gmail.com>
miss-islington and others added 17 commits October 5, 2026 14:20
@miss-islington @maurycy @pablogsal
[3.15] pythongh-154060: Fix the Profile Stats offsets in the profil…
6dfba4d 
…ing binary format docs and a missing flag (pythonGH-157871) (python#158855)

pythongh-154060: Fix the `Profile Stats` offsets in the profiling binary format docs and a missing flag (pythonGH-157871)

* correct profile stats size and paddings

* missing flag

* pythongh-154060: Clarify the main-thread status flag

---------
(cherry picked from commit 8df2580)

Co-authored-by: Maurycy Pawłowski-Wieroński <maurycy@maurycy.com>
Co-authored-by: Pablo Galindo Salgado <Pablogsal@gmail.com>
@miss-islington @pablogsal
[3.15] pythongh-158552: Wait for Windows threads to suspend before bl…
31288da 
…ocking sampling (pythonGH-158802) (python#158845)

pythongh-158552: Wait for Windows threads to suspend before blocking sampling (pythonGH-158802)

* pythongh-158552: Wait for Windows threads to suspend before blocking sampling

* Use a named Windows thread enumeration status constant
(cherry picked from commit 1643525)

Co-authored-by: Pablo Galindo Salgado <Pablogsal@gmail.com>
@pablogsal @tonghuaroot
[3.15] pythongh-152721: Fix quadratic RLE replay time in the profilin…
ebaca2a 
…g binary reader (pythonGH-152722) (python#158850)

Backport of pythonGH-152722.

Co-authored-by: tonghuaroot <tonghuaroot@gmail.com>
@pablogsal @tonghuaroot
[3.15] pythongh-156545: Fix flamegraph export RecursionError on deepl…
0ac7217 
…y recursive programs (pythonGH-156546) (python#158851)

Backport of pythonGH-156546.

Co-authored-by: tonghuaroot (童话) <tonghuaroot@gmail.com>
@miss-islington @hetaozdh @edvilme
[3.15] pythongh-158540: Add the profiled script's directory to sys.pa…
f52d831 
…th (pythonGH-158548) (python#158844)

pythongh-158540: Add the profiled script's directory to sys.path (pythonGH-158548)

* pythongh-158540: Add the profiled script's directory to sys.path

When a script is profiled with ``python -m profiling.sampling run
script.py`` from another directory, the script cannot import modules
placed next to it, because ``_sync_coordinator._execute_script()``
executes it with the working directory (added by
``_setup_environment()`` for the module case) as ``sys.path[0]``
instead of the script's own directory.

Make the script's directory importable in ``_execute_script()``,
matching the behavior of ``python script.py``.

Add a regression test that runs the coordinator on a script importing
a sibling module.

* Update _sync_coordinator.py Comment simplified



* pythongh-158540: Resolve symlinks when adding the script directory to sys.path

``python script.py`` resolves symlinks when computing ``sys.path[0]``, so
a script reached through a symlink (``link.py -> sub/where.py``) imports
modules from the real script's directory.  Apply ``os.path.realpath()``
before taking the directory name, and make sure the result is placed at
the front of ``sys.path`` even if it was already listed.

Add a regression test for a symlinked script.

---------
(cherry picked from commit 3f02aab)

Co-authored-by: he_tao <53343436+hetaozdh@users.noreply.github.com>
Co-authored-by: Eduardo Villalpando Mello <eduardo.villalpando.mello@gmail.com>
@pablogsal @tonghuaroot
[3.15] pythongh-153838: Skip non-regular source files in the heatmap …
48998df 
…exporter (pythonGH-153839) (python#158853)

Backport of pythonGH-153839.

Co-authored-by: tonghuaroot <tonghuaroot@gmail.com>
@pablogsal @hetaozdh
[3.15] pythongh-158539: Fix exception mode missing handlers in genera…
d625ecb 
…tors/coroutines (pythonGH-158581) (python#158852)

* [3.15] pythongh-158539: Fix exception mode missing handlers in generators/coroutines (pythonGH-158581)

Backport of pythonGH-158581.

Co-authored-by: LucasZhou <donghao.zhou@outlook.com>

* [3.15] pythongh-158539: Use portable static assertion messages

* [3.15] pythongh-158539: Keep layout assertions with debug-offset validation

* [3.15] pythongh-158539: Use the platform guard for in-process inspection tests

---------

Co-authored-by: LucasZhou <donghao.zhou@outlook.com>
@pablogsal @deadlovelll
[3.15] pythongh-158522: Fix truncated stack for a task whose coroutin…
a904b39 
…e recurses (pythonGH-158526) (python#158870)

Co-authored-by: Timofei Ivankov <128279579+deadlovelll@users.noreply.github.com>
@pablogsal
[3.15] Revert backports merged during the 3.15.0 release freeze on 5 …
c49b3dc 
…October (python#158873)
@miss-islington @encukou
[3.15] pythongh-158098: Add Setuptools workaround to abi3t migration …
965e2b7 
…guide (pythonGH-158405) (python#158601)

Co-authored-by: Petr Viktorin <encukou@gmail.com>
@miss-islington @mhsmith
[3.15] pythongh-158536: Skip some Android logging tests on OS version…
6fae227 
…s with aggressive "chatty" filtering (pythonGH-158531) (python#158537)

Co-authored-by: Malcolm Smith <smith@chaquo.com>
@miss-islington @ngoldbaum
@encukou @hugovk
[3.15] Doc: update abi3t build tool support (pythonGH-158171) (python…
874d112 
…#158959)

Co-authored-by: Nathan Goldbaum <nathan.goldbaum@gmail.com>
Co-authored-by: Petr Viktorin <encukou@gmail.com>
Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
@miss-islington @maurycy
[3.15] Fix the sys.remote_exec row in the audit events table (pytho…
19fd4df 
…nGH-158940) (python#158949)

Co-authored-by: Maurycy Pawłowski-Wieroński <maurycy@maurycy.com>
@miss-islington @hugovk
[3.15] pythongh-142927: Update Tachyon examples (pythonGH-159050) (py…
e5f271f 
…thon#159052)

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
@miss-islington @hugovk
[3.15] pythongh-133879: Announce final release in What's New in Pytho…
ed062fa 
…n 3.15 (pythonGH-158256) (python#159053)

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
@miss-islington @hugovk
[3.15] Update Docs lockfile to use blurb 2.2.0 (pythonGH-159058) (pyt…
cc3c98b 
…hon#159060)

Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
@hugovk
Python 3.15.0
d220409
@xFrednet
xFrednet force-pushed the immutable-nogil branch 2 times, most recently from e099c5e to 674e84b Compare October 12, 2026 16:51
xFrednet and others added 10 commits October 14, 2026 09:50
@xFrednet Matthew A Johnson
@mjp41 @kulisak12 @TobiasWrigstad
Immutability: Proposed code changes for PEP 795.
ec29810 
Co-authored-by: Matthew A Johnson <matjoh@microsoft.com>
Co-authored-by: Matthew Parkinson <mattpark@microsoft.com>
Co-authored-by: David Klement <kulisak12lp@gmail.com>
Co-authored-by: Tobias Wrigstad <tobias.wrigstad@it.uu.se>
@xFrednet
Fixes 1
236eaae
@xFrednet
Fixes 2
43fca95
@xFrednet
Bug fixes 3
6601413
@xFrednet
Bug fixes 4
14e282b
@xFrednet
Bug fixes
3134d30
@xFrednet
Remove moved benchmark
48d3b68
@xFrednet
So many fixes
fa2cecc
@xFrednet
Immutability: Document Sub-Interpreter Sharing Segfaults
5e841ba
@xFrednet
Benchmarking stupidity
3164ac2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mjp41 mjp41 Awaiting requested review from mjp41

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.