Commit Graph

36 Commits

Author SHA1 Message Date
Mario Gersbach 0311cd1c20
ENH Add SHA-256 hash to packages.json entries (#2455) 2022-05-02 22:09:14 -06:00
Gyeongjae Choi e18e6c81a3
Fix rebuild check (#2419) 2022-04-26 16:10:36 +09:00
Gyeongjae Choi 6900afdc5b
PKG Add opencv-python, ffmpeg and libwebp (#2305)
* Add opencv-python

* Update comment

* Add JPEG, PNG, WEBP, ZLIB support

* Add tests for image processing

* Add more core modules

* Disable opencl

* Replace lena with baboon and add more tests

* Add file system support

* Add ffmpeg

* Add more tests

* Disable pthread in ffmpeg

* Disable canonical input processing mode in node test

* Update changelog

* Remove import test

* Allow more time in the first test

* Split out libwebp

* Fix node test

* Use a seperate CI job for opencv-python

* Fix generator

* Update changelog

* Remove protobuf package

* Try to fix CI workspace conflict

* Fix CI

* Use another CI job for generating unified packages.json

* Try to fix CI

* Fix CI again

* Disable verbose build

* Prevent from building opencv-python twice

* Persist only build artifacts

* Sepearate Cmake args into a script

* Try to reuse build packages job

* Fix CI

* Fix typo

* Fix merge conflict

* Use large resource class for package build

* Do not upload unwanted artifacts

* Do not upload unwanted artifacts
2022-04-19 09:24:47 +09:00
Henry Schreiner 93dc922f46
chore: Python 3.10 pyupgrade (#2342)
Co-authored-by: Roman Yurchak <rth.yurchak@gmail.com>
2022-04-02 00:36:55 +02:00
Hood Chatham abba842fd9
MAINT Use tee to pipe stdout to build.log from buildpkg (#2293)
This makes it so that buildpkg generates build.log on its own
even when it isn't run from buildall. This is helpful because
when working on a specific package it is nicer to run buildpkg
directly so you can see the build on the console. However, it
is frustrating when you want to grep the build log for instance
that there isn't a build log.

This tees stdout into a build log from insidde buildpkg. It also
fixes the issue with overwriting build.log when nothing needs to
be done (though that issue I think was also fixed in December by
calling needs_build from buildall). Now buildall can just redirect
the subprocess output to /dev/null.
2022-03-20 20:24:39 -07:00
Hood Chatham 25358e4f38
Improve error message when no matching wheel is found (#2284) 2022-03-17 20:22:17 -07:00
Hood Chatham 59ace09c11
Implement more accurate wheel finding using the packaging tags module (#2275)
This adds a find_matching_wheels function that correctly determines
which wheels the Pyodide interpreter supports according to the platform
compatibility tags spec. This should fix problems with extra host platform
wheels lying around or wheels built for different versions of Python (e.g., 
cp39 vs cp310).
2022-03-16 10:55:07 -07:00
Gyeongjae Choi b6555fb6b8
Move making archive of shared libraries to buildpkg (#2279)
Moves the logic of generating zip archive of a shared library from 
`buildall` to `buildpkg` so that thread-unsafe `shutil.make_archive` 
won't bother us anymore.
2022-03-16 08:00:11 -07:00
Henry Schreiner 37c8a70479
fix(build): lock around logging and archiving portions (#2262)
* fix: lock around logging and archiving portions

Signed-off-by: Henry Schreiner <henryschreineriii@gmail.com>

* refactor: fewer locks

Signed-off-by: Henry Schreiner <henryschreineriii@gmail.com>
2022-03-11 21:13:29 +09:00
Hood Chatham c01ab547f0
Better package cross compilation (#2238)
Co-authored-by: Gyeongjae Choi <def6488@gmail.com>
2022-03-09 20:34:25 -08:00
Henry Schreiner 4f8b0a0344
chore: more pre-commit checking (#2257) 2022-03-07 21:51:20 -08:00
Henry Schreiner 7763e0a8f1
fix: better error messages, fewer tracebacks (#2242)
This reduces the text output when an error is hit, removing the tracebacks for known errors. Tracebacks are for unknown/unexpected errors - if you expect an error, it's better to print out an actual error message. I've also made the patch applying a bit more verbose in case it helps, as it sometimes does.

Also improvements to `BashRunner`: it no longer hangs when an error is raised and it is now a context manager
2022-03-04 23:44:54 -08:00
Henry Schreiner 8d00451142
chore: enable the rest of flake8 & bugbear (#2216) 2022-02-27 12:39:53 -05:00
Henry Schreiner 8385df36a4
tests: enabling mypy on untyped defs (#2204) 2022-02-23 17:10:53 -05:00
Henry Schreiner 66856a7427
MAINT isort (#2200) 2022-02-21 23:27:03 +01:00
Henry Schreiner ed22c06e07
chore: pyupgrade 3.9+ (#2195) 2022-02-20 17:13:37 -05:00
Hood Chatham 8323987b39
Use wheels instead of file_packager (#2027) 2022-01-23 17:47:04 -08:00
Hood Chatham eab2381c87
Fix needs_build for stdlib packages (#2072) 2022-01-01 17:16:16 -08:00
Hood Chatham f44f7b3dfe
ENH improvements to pyodide-build (#2069) 2021-12-31 09:29:36 -08:00
Hood Chatham 42180e8681
Make buildall print list of in progress packages (#2064) 2021-12-27 10:00:09 +01:00
Hood Chatham d56cc330c8 Revert "Make buildall print list of in progress packages"
I don't know why 'git push' decided to push to upstream rather than to origin (not that I was trying to update 'origin main' either)

This reverts commit 7ca0bb5702.
2021-12-22 17:15:46 -08:00
Hood Chatham 7ca0bb5702 Make buildall print list of in progress packages 2021-12-22 17:12:36 -08:00
Hood Chatham 6065bcd532
MAINT Clean up environment variables and pywasmcross (#2053) 2021-12-20 11:26:27 -08:00
Hood Chatham 17f675a89e
MAINT Clean up buildpkg (#2036) 2021-12-14 20:02:27 -08:00
Hood Chatham 418813de33
MAINT Split CI build-packages step in two (#2017)
Split build packages into a step for everything up to and including numpy and a second step for numpy and its dependencies.
Intended to prevent timeouts.
2021-12-05 12:34:09 -08:00
Roman Yurchak 20d760ea7c
Typo and grammar fixes (#1959) 2021-11-14 21:47:49 +01:00
Roman Yurchak cc3ddfc087
CI Fix test-js (#1909) 2021-10-26 10:42:46 +02:00
Roman Yurchak d25bbb70fe
ENH Unvendor unit tests from packages (#1834) 2021-09-21 08:47:48 +02:00
Roman Yurchak 869705f6d4
ENH Improve logging when building packages (#1835)
Co-authored-by: Hood Chatham <roberthoodchatham@gmail.com>
2021-09-15 10:18:56 +02:00
Roman Yurchak 1fe84bb68b
FIX pyodide-build mkpkg usability (#1828)
Co-authored-by: Hood Chatham <roberthoodchatham@gmail.com>
2021-09-12 23:13:49 +02:00
Roman Yurchak ab53f6b06c
ENH Change to minimal build by default (#1804) 2021-09-02 22:19:23 +02:00
Roman Yurchak cdd2db03d3
MAINT Order package entries by names in packages.json (#1772) 2021-08-03 17:01:29 +02:00
Roman Yurchak b455d6a6fb
Toward a conda compatible packages.json (#1700) 2021-07-24 09:22:46 -07:00
Hood Chatham 9ffae14dbf
Store package build logs as circleci artifacts (#1646) 2021-06-19 09:51:36 -07:00
Hood Chatham 5f775051cd
Handle mixed case package names (#1615) 2021-05-30 20:07:31 -07:00
Roman Yurchak 4e9d10833e
BLD Create an installable pyodide-build package (#1566) 2021-05-03 20:51:11 +02:00