Releases: pybind/pybind11
Version 2.11.0
New features:
- The newly added
pybind11::detail::is_move_constructibletrait can be specialized for cases in whichstd::is_move_constructibledoes not work as needed. This is very similar to the long-establishedpybind11::detail::is_copy_constructible. #4631 - Introduce
recursive_container_traits. #4623 pybind11/type_caster_pyobject_ptr.hwas added to support automatic wrapping of APIs that make use ofPyObject *. This header needs to included explicitly (i.e. it is not included implicitly withpybind/pybind11.h). #4601format_descriptor<>&npy_format_descriptor<>PyObject *specializations were added. The latter enablespy::array_t<PyObject *>to/from-python conversions. #4674buffer_infogained anitem_type_is_equivalent_to<T>()member function. #4674- The
capsuleAPI gained a user-friendly constructor (py::capsule(ptr, "name", dtor)). #4720
Changes:
PyGILState_Check()'s inpybind11::handle'sinc_ref()&dec_ref()are now enabled by default again. #4246py::initialize_interpreter()usingPyConfig_InitPythonConfig()instead ofPyConfig_InitIsolatedConfig(), to obtain completesys.path. #4473- Cast errors now always include Python type information, even if
PYBIND11_DETAILED_ERROR_MESSAGESis not defined. This increases binary sizes slightly (~1.5%) but the error messages are much more informative. #4463 - The docstring generation for the
std::array-list caster was fixed. Previously, signatures included the size of the list in a non-standard, non-spec compliant way. The new format conforms to PEP 593. Tooling for processing the docstrings may need to be updated accordingly. #4679 - Setter return values (which are inaccessible for all practical purposes) are no longer converted to Python (only to be discarded). #4621
- Allow lambda specified to function definition to be
noexcept(true)in C++17. #4593 - Get rid of recursive template instantiations for concatenating type signatures on C++17 and higher. #4587
- Compatibility with Python 3.12 (beta). Note that the minimum pybind11 ABI version for Python 3.12 is version 5. (The default ABI version for Python versions up to and including 3.11 is still version 4.). #4570
- With
PYBIND11_INTERNALS_VERSION 5(default for Python 3.12+), MSVC builds usestd::hash<std::type_index>andstd::equal_to<std::type_index>instead of string-based type comparisons. This resolves issues when binding types defined in the unnamed namespace. #4319 - Python exception
__notes__(introduced with Python 3.11) are now added to theerror_already_set::what()output. #4678
Build system improvements:
- CMake 3.27 support was added, CMake 3.4 support was dropped. FindPython will be used if
FindPythonInterpis not present. #4719 - Update clang-tidy to 15 in CI. #4387
- Moved the linting framework over to Ruff. #4483
- Skip
ltochecks and target generation whenCMAKE_INTERPROCEDURAL_OPTIMIZATIONis defined. #4643 - No longer inject
-stdlib=libc++, not needed for modern Pythons (macOS 10.9+). #4639 - PyPy 3.10 support was added, PyPy 3.7 support was dropped. #4728
- Testing with Python 3.12 beta releases was added. #4713
Version 2.10.4
Changes:
python3 -m pybind11gained a--versionoption (prints the version and exits). #4526
Bug Fixes:
Version 2.10.3
Changes:
- Temporarily made our GIL status assertions (added in 2.10.2) disabled by default (re-enable manually by defining
PYBIND11_ASSERT_GIL_HELD_INCREF_DECREF, will be enabled in 2.11). #4432 - Improved error messages when
inc_ref/dec_refare called with an invalid GIL state. #4427 #4436
Bug Fixes:
- Some minor touchups found by static analyzers. #4440
Version 2.10.2
Changes:
scoped_interpreterconstructor takingPyConfig. #4372pybind11/eigen/tensor.hadds converters to and fromEigen::TensorandEigen::TensorMap#4201PyGILState_Check()'s were integrated topybind11::handleinc_ref()&dec_ref(). The added GIL checks are guarded byPYBIND11_ASSERT_GIL_HELD_INCREF_DECREF, which is the default only ifNDEBUGis not defined. #4246- Add option for enable/disable enum members in docstring. #2768
- Fixed typing of
KeysView,ValuesViewandItemsViewinbind_map. #4353
Bug fixes:
- Bug fix affecting only Python 3.6 under very specific, uncommon conditions: move
PyEval_InitThreads()call to the correct location. #4350 - Fix segfault bug when passing foreign native functions to functional.h. #4254
Build system improvements:
- Support setting PYTHON_LIBRARIES manually for Windows ARM cross-compilation (classic mode). #4406
- Extend IPO/LTO detection for ICX (a.k.a IntelLLVM) compiler. #4402
- Allow calling
find_package(pybind11 CONFIG)multiple times from separate directories in the same CMake project and properly link Python (new mode). #4401 multiprocessing_set_spawnin pytest fixture for added safety. #4377- Fixed a bug in two pybind11/tools cmake scripts causing "Unknown arguments specified" errors. #4327
Version 2.10.1
This is the first version to fully support embedding the newly released Python 3.11.
Changes:
- Allow
pybind11::capsuleconstructor to take null destructor pointers. #4221 embed.hwas changed so thatPYTHONPATHis used also with Python 3.11 (established behavior). #4119- A
PYBIND11_SIMPLE_GIL_MANAGEMENToption was added (cmake, C++ define), along with many additional tests intest_gil_scoped.py. The option may be useful to try when debugging GIL-related issues, to determine if the more complex default implementation is or is not to blame. See #4216 for background. WARNING: Please be careful to not create ODR violations when using the option: everything that is linked together with mutual symbol visibility needs to be rebuilt. #4216 PYBIND11_EXPORT_EXCEPTIONwas made non-empty only under macOS. This makes Linux builds safer, and enables the removal of warning suppression pragmas for Windows. #4298
Bug fixes:
- Fixed a bug where
UnicodeDecodeErrorwas not propagated from variouspy::strctors when decoding surrogate utf characters. #4294 - Revert perfect forwarding for
make_iterator. This broke at least one valid use case. May revisit later. #4234 - Fix support for safe casts to
void*(regression in 2.10.0). #4275 - Fix
char8_tsupport (regression in 2.9). #4278 - Unicode surrogate character in Python exception message leads to process termination in
error_already_set::what(). #4297 - Fix MSVC 2019 v.1924 & C++14 mode error for
overload_cast. #4188 - Make augmented assignment operators non-const for the object-api. Behavior was previously broken for augmented assignment operators. #4065
- Add proper error checking to C++ bindings for Python list append and insert. #4208
- Work-around for Nvidia's CUDA nvcc compiler in versions 11.4.0 - 11.8.0. #4220
- A workaround for PyPy was added in the
py::error_already_setimplementation, related to PR #1895 released with v2.10.0. #4079 - Fixed compiler errors when C++23
std::forward_likeis available. #4136 - Properly raise exceptions in contains methods (like when an object in unhashable). #4209
- Further improve another error in exception handling. #4232
get_local_internals()was made compatible withfinalize_interpreter(), fixing potential freezes during interpreter finalization. #4192
Performance and style:
- Reserve space in set and STL map casters if possible. This will prevent unnecessary rehashing / resizing by knowing the number of keys ahead of time for Python to C++ casting. This improvement will greatly speed up the casting of large unordered maps and sets. #4194
- GIL RAII scopes are non-copyable to avoid potential bugs. #4183
- Explicitly default all relevant ctors for pytypes in the
PYBIND11_OBJECTmacros and enforce the clang-tidy checksmodernize-use-equals-defaultin macros as well. #4017 - Optimize iterator advancement in C++ bindings. #4237
- Use the modern
PyObject_GenericGetDictandPyObject_GenericSetDictfor handling dynamic attribute dictionaries. #4106 - Document that users should use
PYBIND11_NAMESPACEinstead of usingpybind11when opening namespaces. Using namespace declarations and namespace qualification remain the same aspybind11. This is done to ensure consistent symbol visibility. #4098 - Mark
detail::forward_likeas constexpr. #4147 - Optimize unpacking_collector when processing
arg_varguments. #4219 - Optimize casting C++ object to
None. #4269
Build system improvements:
- CMake: revert overwrite behavior, now opt-in with
PYBIND11_PYTHONLIBS_OVERRWRITE OFF. #4195 - Include a pkg-config file when installing pybind11, such as in the Python package. #4077
- Avoid stripping debug symbols when
CMAKE_BUILD_TYPEis set toDEBUGinstead ofDebug. #4078 - Followup to #3948, fixing vcpkg again. #4123
Version 2.10.0
Removed support for Python 2.7, Python 3.5, and MSVC 2015. Support for MSVC 2017 is limited due to availability of CI runners; we highly recommend MSVC 2019 or 2022 be used. Initial support added for Python 3.11.
New features:
py::anyset&py::frozensetwere added, with copying (cast) tostd::set(similar toset). #3901- Support bytearray casting to string. #3707
type_caster<std::monostate>was added.std::monostateis a tag type that allowsstd::variantto act as an optional, or allows default construction of astd::variantholding a non-default constructible type. #3818pybind11::capsule::set_nameadded to mutate the name of the capsule instance. #3866- NumPy: dtype constructor from type number added, accessors corresponding to Python API
dtype.num,dtype.byteorder,dtype.flagsanddtype.alignmentadded. #3868
Changes:
- Python 3.6 is now the minimum supported version. #3688 #3719
- The minimum version for MSVC is now 2017. #3722
- Fix issues with CPython 3.11 betas and add to supported test matrix. #3923
error_already_setis now safer and more performant, especially for exceptions with long tracebacks, by delaying computation. #1895- Improve exception handling in python
strbindings. #3826 - The bindings for capsules now have more consistent exception handling. #3825
PYBIND11_OBJECT_CVTandPYBIND11_OBJECT_CVT_DEFAULTmacro can now be used to define classes in namespaces other than pybind11. #3797- Error printing code now uses
PYBIND11_DETAILED_ERROR_MESSAGESinstead of requiringNDEBUG, allowing use with release builds if desired. #3913 - Implicit conversion of the literal
0topybind11::handleis now disabled. #4008
Bug fixes:
- Fix exception handling when
pybind11::weakref()fails. #3739 module_::def_submodulewas missing proper error handling. This is fixed now. #3973- The behavior or
error_already_setwas made safer and the highly opaque "Unknown internal error occurred" message was replaced with a more helpful message. #3982 error_already_set::what()now handles non-normalized exceptions correctly. #3971- Support older C++ compilers where filesystem is not yet part of the standard library and is instead included in
std::experimental::filesystem. #3840 - Fix
-Wfree-nonheap-objectwarnings produced by GCC by avoiding returning pointers to static objects withreturn_value_policy::take_ownership. #3946 - Fix cast from pytype rvalue to another pytype. #3949
- Ensure proper behavior when garbage collecting classes with dynamic attributes in Python >=3.9. #4051
- A couple long-standing
PYBIND11_NAMESPACE__attribute__((visibility("hidden")))inconsistencies are now fixed (affects only unusual environments). #4043 pybind11::detail::get_internals()is now resilient to in-flight Python exceptions. #3981- Arrays with a dimension of size 0 are now properly converted to dynamic Eigen matrices (more common in NumPy 1.23). #4038
- Avoid catching unrelated errors when importing NumPy. #3974
Performance and style:
- Added an accessor overload of
(object &&key)to reference steal the object when using python types as keys. This prevents unnecessary reference count overhead for attr, dictionary, tuple, and sequence look ups. Added additional regression tests. Fixed a performance bug the caused accessor assignments to potentially perform unnecessary copies. #3970 - Perfect forward all args of
make_iterator. #3980 - Avoid potential bug in pycapsule destructor by adding an
error_guardto one of the dtors. #3958 - Optimize dictionary access in
strip_paddingfor numpy. #3994 stl_bind.hbindings now take slice args as a const-ref. #3852- Made slice constructor more consistent, and improve performance of some casters by allowing reference stealing. #3845
- Change numpy dtype from_args method to use const ref. #3878
- Follow rule of three to ensure
PyErr_Restoreis called only once. #3872 - Added missing perfect forwarding for
make_iteratorfunctions. #3860 - Optimize c++ to python function casting by using the rvalue caster. #3966
- Optimize Eigen sparse matrix casting by removing unnecessary temporary. #4064
- Avoid potential implicit copy/assignment constructors causing double free in
strdup_gaurd. #3905 - Enable clang-tidy checks
misc-definitions-in-headers,modernize-loop-convert, andmodernize-use-nullptr. #3881 #3988
Build system improvements:
- CMake: Fix file extension on Windows with cp36 and cp37 using FindPython. #3919
- CMake: Support multiple Python targets (such as on vcpkg). #3948
- CMake: Fix issue with NVCC on Windows. #3947
- CMake: Drop the bitness check on cross compiles (like targeting WebAssembly via Emscripten). #3959
- Add MSVC builds in debug mode to CI. #3784
- MSVC 2022 C++20 coverage was added to GitHub Actions, including Eigen. #3732, #3741
Backend and tidying up:
- New theme for the documentation. #3109
- Remove idioms in code comments. Use more inclusive language. #3809
#include <iostream>was removed from thepybind11/stl.hheader. Your project may break if it has a transitive dependency on this include. The fix is to "Include What You Use". #3928- Avoid
setup.py <command>usage in internal tests. #3734
Version 2.9.2
Changes:
- Enum now has an
__index__method on Python <3.8 too. #3700 - Local internals are now cleared after finalizing the interpreter. #3744
Bug fixes:
- Better support for Python 3.11 alphas. #3694
PYBIND11_TYPE_CASTERnow uses fully qualified symbols, so it can be used outside ofpybind11::detail. #3758- Some fixes for PyPy 3.9. #3768
- Fixed a potential memleak in PyPy in
get_type_override. #3774 - Fix usage of
VISIBILITY_INLINES_HIDDEN. #3721
Build system improvements:
- Uses
sysconfigmodule to determine installation locations on Python >= 3.10, instead ofdistutilswhich has been deprecated. #3764 - Support Catch 2.13.5+ (supporting GLIBC 2.34+). #3679
- Fix test failures with numpy 1.22 by ignoring whitespace when comparing
str()of dtypes. #3682
Backend and tidying up:
- clang-tidy: added
readability-qualified-auto,readability-braces-around-statements,cppcoreguidelines-prefer-member-initializer,clang-analyzer-optin.performance.Padding,cppcoreguidelines-pro-type-static-cast-downcast, andreadability-inconsistent-declaration-parameter-name. #3702, #3699, #3716, #3709 - clang-format was added to the pre-commit actions, and the entire code base automatically reformatted (after several iterations preparing for this leap). #3713
Version 2.9.1
Changes:
- If possible, attach Python exception with
py::raise_fromtoTypeErrorwhen casting from C++ to Python. This will give additional info if Python exceptions occur in the caster. Adds a test case of trying to convert a set from C++ to Python when the hash function is not defined in Python. #3605 - Add a mapping of C++11 nested exceptions to their Python exception equivalent using
py::raise_from. This attaches the nested exceptions in Python using the__cause__field. #3608 - Propagate Python exception traceback using
raise_fromif a pybind11 function runs out of overloads. #3671 py::multiple_inheritanceis now only needed when C++ bases are hidden from pybind11. #3650 and #3659
Bug fixes:
- Remove a boolean cast in
numpy.hthat causes MSVC C4800 warnings when compiling against Python 3.10 or newer. #3669 - Render
py::bool_andpy::float_asboolandfloatrespectively. #3622
Build system improvements:
- Fix CMake extension suffix computation on Python 3.10+. #3663
- Allow
CMAKE_ARGSto override CMake args in pybind11's ownsetup.py. #3577 - Remove a few deprecated c-headers. #3610
- More uniform handling of test targets. #3590
- Add clang-tidy readability check to catch potentially swapped function args. #3611
Version 2.9.0
This is the last version to support Python 2.7 and 3.5.
New Features:
- Allow
py::argsto be followed by other arguments; the remaining arguments are implicitly keyword-only, as if apy::kw_only{}annotation had been used. #3402
Changes:
- Make str/bytes/memoryview more interoperable with
std::string_view. #3521 - Replace
_withconst_namein internals, avoid definingpybind::_if_defined as macro (common gettext usage) #3423
Bug fixes:
- Fix a rare warning about extra copy in an Eigen constructor. #3486
- Fix caching of the C++ overrides. #3465
- Add missing
std::forwardcalls to somecpp_functionoverloads. #3443 - Support PyPy 7.3.7 and the PyPy3.8 beta. Test python-3.11 on PRs with the
python devlabel. #3419 - Replace usage of deprecated
Eigen::MappedSparseMatrixwithEigen::Map<Eigen::SparseMatrix<...>>for Eigen 3.3+. #3499 - Tweaks to support Microsoft Visual Studio 2022. #3497
Build system improvements:
- Nicer CMake printout and IDE organisation for pybind11's own tests. #3479
- CMake: report version type as part of the version string to avoid a spurious space in the package status message. #3472
- Flags starting with
-gin$CFLAGSand$CPPFLAGSare no longer overridden by.Pybind11Extension. #3436 - Ensure ThreadPool is closed in
setup_helpers. #3548 - Avoid LTS on
mips64andppc64le(reported broken). #3557
Version 2.8.1
v2.8.1 (Oct 27, 2021)
Changes and additions:
- The simple namespace creation shortcut added in 2.8.0 was deprecated due to usage of CPython internal API, and will be removed soon. Use
py::module_::import("types").attr("SimpleNamespace"). #3374 - Add C++ Exception type to throw and catch
AttributeError. Useful for defining custom__setattr__and__getattr__methods. #3387
Fixes:
- Fixed the potential for dangling references when using properties with
std::optionaltypes. #3376 - Modernize usage of
PyCodeObjecton Python 3.9+ (moving toward support for Python 3.11a1) #3368 - A long-standing bug in
eigen.hwas fixed (originally PR #3343). The bug was unmasked by newly addedstatic_assert's in the Eigen 3.4.0 release. #3352 - Support multiple raw inclusion of CMake helper files (Conan.io does this for multi-config generators). #3420
- Fix harmless warning on upcoming CMake 3.22. #3368
- Fix 2.8.0 regression with MSVC 2017 + C++17 mode + Python 3. #3407
- Fix 2.8.0 regression that caused undefined behavior (typically segfaults) in
make_key_iterator/make_value_iteratorif dereferencing the iterator returned a temporary value instead of a reference. #3348