Difference between revisions of "Buildroot:Python2Packages"

From eLinux.org
Jump to: navigation, search
m (waf)
m (Python in the build system)
(15 intermediate revisions by the same user not shown)
Line 1: Line 1:
In an effort to follow the Python2 deprecation on the 1st of January 2020, here is a listing of current Buildroot packages that depend on Python2 (as of master during the [[Buildroot:DeveloperDaysELCE2019|Buildroot developer days at ELCE2019]])  
+
In an effort to follow the Python2 deprecation on the 1st of January 2020, here is a listing of current Buildroot packages that depend on Python2 (as of master during the [[https://elinux.org/Buildroot:DeveloperDaysFOSDEM2020|Buildroot developer days at FOSDEM 2020]])  
  
 
== Non Python packages ==
 
== Non Python packages ==
Line 6: Line 6:
  
 
* alsa-lib (install Python module with option BR2_PACKAGE_ALSA_LIB_PYTHON): To be tested
 
* alsa-lib (install Python module with option BR2_PACKAGE_ALSA_LIB_PYTHON): To be tested
* crudini: currently in v0.9, can be bumped to 0.9.3 which adds py3 support
+
* crudini: <s>currently in v0.9, can be bumped to 0.9.3 which adds py3 support. Patch series pending: https://patchwork.ozlabs.org/project/buildroot/list/?series=156917</s> DONE !
 
* <s>dstat: currently in v0.7.3, can be bumped to v0.7.4 which adds py3 support</s> DONE!
 
* <s>dstat: currently in v0.7.3, can be bumped to v0.7.4 which adds py3 support</s> DONE!
* fail2ban: at a first glance, does not seem to support Python3 !
+
* <s>fail2ban: at a first glance, does not seem to support Python3 !</s> Support was added in commit 2d666026385573286371a0f5d9f4b5e0d80f723b
 
* gdb: seems to be compatible with both Python 2 and 3, but not sure since which version
 
* gdb: seems to be compatible with both Python 2 and 3, but not sure since which version
 
* gnuradio: currently in v3.7.13.5, can be bumped to v3.8+ which supports Python 3. <s>Work can resume from these patches: http://patchwork.ozlabs.org/patch/1158469/ and http://patchwork.ozlabs.org/patch/1158470/</s> New series under review: https://patchwork.ozlabs.org/project/buildroot/list/?series=153798 (+ 1 patch that got lost alone: https://patchwork.ozlabs.org/patch/1224753/)
 
* gnuradio: currently in v3.7.13.5, can be bumped to v3.8+ which supports Python 3. <s>Work can resume from these patches: http://patchwork.ozlabs.org/patch/1158469/ and http://patchwork.ozlabs.org/patch/1158470/</s> New series under review: https://patchwork.ozlabs.org/project/buildroot/list/?series=153798 (+ 1 patch that got lost alone: https://patchwork.ozlabs.org/patch/1224753/)
Line 25: Line 25:
 
== Python in the build system ==
 
== Python in the build system ==
  
These packages use Python in their build process (hence requiring host-python)
+
These packages use Python in their build process, hence requiring host-python (or host-python3). We aim at removing dependencies on host-python(2) where possible, and therefore remove conditionals such as illustrated below. This should instead unconditionnally depend on host-python3 now:
  
=== waf ===
+
ifeq ($(BR2_PACKAGE_PYTHON)
 +
FOO_DEPENDENCIES += host-python
 +
else
 +
FOO_DEPENDENCIES += host-python3
 +
endif
  
The waf build system in itself is now compatible with Python3; but the wscript (build definition file) provided by some packages is still syntactically incompatible with Python3. Because Buildroot has a dedicated waf infrastructure, it is difficult to handle each of these packages individually: the `waf-package` infrastructure in itself depends on host-python, and we cannot upgrade it to host-python3 until all the waf packages can actually be built under Python3 only. Buildroot currently has the following waf-based packages:
+
At the moment, the following packages reference host-python(2). In the following list, the packages that are <u>underlined</u> have been migrated and tested with only host-python3 by Titouan<ref>https://github.com/titouanc/buildroot/compare/master...py3</ref>. This be posted soon in a series to the mailing list.
  
==== Compatible with Python3 ====
+
* <u>ca-certificates</u>
 +
* '''canfestival''': uses its script objdictgen as part of the build process. The whole code base is still syntactically Python3 incompatible
 +
* <u>host-dbus-python</u>
 +
* host-gdb
 +
* <u>gnuradio</u>
 +
* <u>gst1-validate</u>
 +
* <u>host-gtest</u>
 +
* libimxvpuapi
 +
* <u>libsigrock</u>
 +
* libxcb
 +
* midori
 +
* '''nodejs''': the "active" version (12.x.y) does explicitly only support Python2 at the moment<ref>https://github.com/nodejs/node/blob/v12.18.3/BUILDING.md#building-nodejs-on-supported-platforms</ref><ref>https://github.com/nodejs/node/blob/v12.18.0/configure</ref>. The "current" version (14.x.y) can be built with Python3<ref>https://github.com/nodejs/node/blob/v14.6.0/BUILDING.md#building-nodejs-on-supported-platforms</ref>. 14.x.y is expected to become the "active" version on the 2020-10-20 <ref>https://nodejs.org/en/about/releases/</ref>, so we can drop host-python(2) support at that time
 +
* ogre
 +
* <u>host-omniorb</u>
 +
* qpid-proton
 +
* qt5webengine
 +
* qt5webkit
 +
* <u>rust</u>
 +
* sdbusplus
 +
* '''spidermonkey''': Still tightly coupled to Python2.7 (./configure attempts to find python2.7)
 +
* tvheadend
 +
* webkitgtk
 +
* wpewebkit
 +
* xcb-proto, host-xcb-proto
 +
* zynq-boot-bin
  
* aubio
+
=== waf ===
* jack2
 
* mpv
 
* norm (patch series pending: https://patchwork.ozlabs.org/project/buildroot/list/?series=156705)
 
 
 
==== To be examined yet ====
 
  
* libimxvpuapi
+
The waf-package infrastructure has been fully migrated to host-python3
* glmark2
 
* gstreamer1/gst1-imx
 
  
 
=== Scons ===
 
=== Scons ===
  
Similarly to waf, SCons in itself is compatible with Python3, but build definition files can be Python3 incompatible. However, because there is no dedicated SCons infrastructure, each package can be handled individually. Buildroot currently has the following SCons based packages:
+
All packages using SCons (no dedicated infrastructure) have been migrated to host-python3
 
 
* <s>alljoyn, alljoyn-base, alljoyn-tcl, alljoyn-tcl-base: Upstream seems dead, Patch for removal sent: http://patchwork.ozlabs.org/patch/1186692/</s> REMOVED!
 
* <s>benejson: Patch sent sent for upgrade to host-python3 http://patchwork.ozlabs.org/patch/1185105/</s> DONE!
 
* <s>gpsd: Patch sent for upgrade to host-python3 http://patchwork.ozlabs.org/patch/1185026/</s> DONE!
 
* mongodb: Patch series pending: http://patchwork.ozlabs.org/project/buildroot/list/?series=138894
 

Revision as of 01:48, 27 July 2020

In an effort to follow the Python2 deprecation on the 1st of January 2020, here is a listing of current Buildroot packages that depend on Python2 (as of master during the [developer days at FOSDEM 2020])

Non Python packages

These packages integrate with Python2: either they contain scripts written in Python, or they install Python libraries as byproducts.

Python packages

(TBD) These packages are Python libraries that can then be imported by Python scripts

Python in the build system

These packages use Python in their build process, hence requiring host-python (or host-python3). We aim at removing dependencies on host-python(2) where possible, and therefore remove conditionals such as illustrated below. This should instead unconditionnally depend on host-python3 now:

ifeq ($(BR2_PACKAGE_PYTHON)
FOO_DEPENDENCIES += host-python
else
FOO_DEPENDENCIES += host-python3
endif

At the moment, the following packages reference host-python(2). In the following list, the packages that are underlined have been migrated and tested with only host-python3 by Titouan[1]. This be posted soon in a series to the mailing list.

  • ca-certificates
  • canfestival: uses its script objdictgen as part of the build process. The whole code base is still syntactically Python3 incompatible
  • host-dbus-python
  • host-gdb
  • gnuradio
  • gst1-validate
  • host-gtest
  • libimxvpuapi
  • libsigrock
  • libxcb
  • midori
  • nodejs: the "active" version (12.x.y) does explicitly only support Python2 at the moment[2][3]. The "current" version (14.x.y) can be built with Python3[4]. 14.x.y is expected to become the "active" version on the 2020-10-20 [5], so we can drop host-python(2) support at that time
  • ogre
  • host-omniorb
  • qpid-proton
  • qt5webengine
  • qt5webkit
  • rust
  • sdbusplus
  • spidermonkey: Still tightly coupled to Python2.7 (./configure attempts to find python2.7)
  • tvheadend
  • webkitgtk
  • wpewebkit
  • xcb-proto, host-xcb-proto
  • zynq-boot-bin

waf

The waf-package infrastructure has been fully migrated to host-python3

Scons

All packages using SCons (no dedicated infrastructure) have been migrated to host-python3