Commit Graph

195 Commits

Author SHA1 Message Date
Dexter Chua cd198e2927
Use python:3.8.2-slim-buster Docker base image (#1095)
This doesn't come with any build dependencies by default, so this
clarifies what really is needed (and as you can see from the diff, not
much).
2021-01-10 21:14:50 +08:00
Dexter Chua 0eaa29b3f3
Clean up workspace after core-python build (#1045)
Persisting fewer artifacts between jobs should give a slightly faster
build. This also guarantees that all we need to build packages are emsdk
and cpython/installs, which is useful for third party packages building.
2021-01-05 09:47:28 +01:00
Dexter Chua f6f5da1145
Create script to set emscripten env vars (#1013) 2021-01-03 12:25:14 +01:00
Dexter Chua 4ae245855d
Install uglifyjs and lessc via npm (#1002)
The installation is very fast, and this avoids having two copies of node
around. In particular, this avoids the need to monkey-patch uglify-js to
use the system node.

This can be further streamlined when #792 is merged
2021-01-01 23:43:48 +08:00
Dexter Chua e205121806
Build docs in CI (#983) 2020-12-31 13:18:13 +01:00
Dexter Chua b4c71a6dd2
CI Don't block tests on lint (#963)
Lints can be fixed easily, and this exposes "real" problems sooner.
2020-12-31 11:09:58 +01:00
Dexter Chua 8b090b4f5c
Restore PYODIDE_BASE_URL (#953)
A more permanent solution ought to be found, but CircleCI does not seem
to make it easy. This would make dev builds work for now.
2020-12-26 08:01:03 +01:00
Roman Yurchak 0d10cfaded
Release 0.16.1 (#950) 2020-12-25 22:05:54 +01:00
Dexter Chua bc8d17a374
CI Fix artifact upload (#948) 2020-12-25 09:46:57 +01:00
Dexter Chua 00d4d7eb2c
Fix CircleCI config (#946)
This incorporates two changes.

1. Since chrome tests are now much less flaky, we require chrome tests
   to pass before deploying.

2. Mark all jobs (except benchmark) as filters/tags/only: /.*/ so that
   they run on releases. This was previously causing the 1.16.0 release
   to not contain package builds.
2020-12-25 09:45:54 +01:00
Roman Yurchak 47878173c1
Release v0.16.0 (#940) 2020-12-24 18:16:26 +01:00
Dexter Chua 8de2ed1202
Build C libraries via buildall.py (#927)
This addresses part of #713, by listing and building C libraries as
dependencies. This means we automatically build CLAPACK when needed, and
`lxml`'s C dependencies are not built if lxml is not. In particular,
building "core" should now be faster.

The building itself is still performed by Makefile.
2020-12-23 14:24:32 +01:00
Dexter Chua 77b2a99697
Test emsdk patches (#905) 2020-12-21 11:20:11 +08:00
Roman Yurchak 641ce219b8
Use PYODIDE_BASE_URL for the deployment location (#855) 2020-12-18 13:23:45 +01:00
Dexter Chua 0de8ddb0cf
MAINT Move all lint commands to Makefile (#879) 2020-12-17 10:54:23 +01:00
Dexter Chua 0c91434bb6
Rerun failed tests sequentially (#859) 2020-12-14 18:05:15 +01:00
Dexter Chua dd616b5265
Fix cache saving (#850) 2020-12-12 12:31:21 +01:00
Roman Yurchak db9f12826f
Split build for core and packages in CI pipeline (#828) 2020-12-11 16:47:47 +01:00
Dexter Chua 9e050c143c
Remove clang-format symlink in config.yml (#837) 2020-12-08 09:01:58 +01:00
Dexter Chua 0defcb3825
BLD Don't compile host python (#830) 2020-12-08 00:19:16 +01:00
Dexter Chua 331756a5cd
Run tests in parallel with pytest-xdist (#833) 2020-12-07 09:19:31 +01:00
Dexter Chua 81df4e24a7
Simplify Docker image (#815)
Co-authored-by: Roman Yurchak <rth.yurchak@gmail.com>
2020-12-06 21:17:17 +01:00
Roman Yurchak 411a058d7b
TST Replace test CGI server with pytest-httpserver (#823) 2020-12-06 14:08:22 +01:00
Dexter Chua d67648a6b8
BLD Update package build script's default ldflags (#817) 2020-12-03 14:27:40 +01:00
Roman Yurchak f7adad7eb3
Upgrade to emscripten 1.38.34 with fastcomp (#480)
Co-authored-by: Dexter Chua <dec41@srcf.net>
2020-11-30 18:54:35 +01:00
Roman Yurchak 8c22c98a43
MAINT Reorganize src/ and tests/ folders (#786) 2020-11-09 13:28:02 +01:00
Roman Yurchak ada586daa6
MAINT Update cibuilds image in CI (#784) 2020-11-01 11:24:24 +01:00
Roman Yurchak 49dc822acb
MNT Use gzip compression for package artifacts (#770) 2020-10-20 21:56:59 +02:00
Roman Yurchak a84ecd31f6
Fix lint CI (#759) 2020-09-24 12:28:10 +02:00
Roman Yurchak a5f3a2ba07
MNT Put files in a subfolder in the release .tar.bz2 (#743) 2020-08-18 10:59:56 +02:00
Roman Yurchak 5cc20673be
MNT Add mypy setup in CI and pre-commit (#746) 2020-08-16 19:35:32 +02:00
chigozienri 9dd8c565f8
MNT Add type annotations to pyodide_build/buildpkg.py (#735)
Co-authored-by: Michael Greminger <michael.greminger@gmail.com>
Co-authored-by: Roman Yurchak <rth.yurchak@gmail.com>
2020-08-16 13:20:08 +02:00
Roman Yurchak 018f4a23c9
MNT Update to firefox 70.0 / geckodriver 0.26 in CI (#622) 2020-07-09 00:37:02 +02:00
Roman Yurchak bcc4f6b521
MNT Clean-up root folder (#714)
* Move six

* Move jedi and parso

* Move lz4

* Move CLAPACK

* Move zlib and libxslt

* Move libiconv and libxml

* Remobe netlify/state.json and move remove_modules to cpython

* Move bumpversion.cfg to setup.cfg

* Reset cache

* Fix test_common.py
2020-07-08 16:58:10 +02:00
Roman Yurchak fc5495ffdb
Update to Python 3.8.2 (#712)
* Updating to CPython 3.8

* More fixes

* Skip python headers check in tools/dependency-check.sh

* Fix checksum

* Fix packages

* Fix syntax error

* Fix benchmark path

* Update CPython tests

* More test fixes

* Fix PyStone

* More Cpython test fixes

* Update docs

* Fix issue in conftest

* Add documentation

* Upload updated Docker image
2020-07-07 16:21:33 +02:00
Roman Yurchak 9afc7a1617
STY Apply black for code style (#702)
* Apply black

* A few fixes

* Relax flake8 checks

* Exclude tools/file_packager.py from black
2020-06-28 20:24:40 +02:00
Roman Yurchak ee3e5e44c3
Update docker image to Debian buster (#660) 2020-06-06 14:18:21 +02:00
jcaesar 9c91707994
Dockerfile: add swig, pytest-rerunfailures (#659)
Co-authored-by: Roman Yurchak <rth.yurchak@gmail.com>
2020-06-06 00:30:43 +02:00
Roman Yurchak 4ee8dedeed
Update to emscripten 1.38.31 (#674)
Co-authored-by: Michael Droettboom <mdboom@gmail.com>
2020-05-28 18:13:51 +02:00
Roman Yurchak 6cf891380d
Compress .data files in CDN (v2) (#673) 2020-05-23 16:02:10 +02:00
Roman Yurchak 9f9a6c3965
CI Add deployment setup for pyodide-cdn2.iodide.io (#666) 2020-05-19 18:15:21 +02:00
Roman Yurchak ab6d0d9703 Add build-test-minimal CI job 2020-05-09 01:52:25 +02:00
Adam Seering 3ec7849cfe
ENH Upgrade cpython to 3.7.4 (#625) 2020-03-25 12:31:12 +01:00
Adam Seering 7c0cbf61f4
Upgrade cpython to 3.7.3 (#624) 2020-03-18 10:36:50 +01:00
Michael Droettboom 2f2ed8fc26
Upgrade to Python 3.7.2 (#321)
Co-authored-by: Roman Yurchak <rth.yurchak@gmail.com>
2020-03-12 13:30:33 +01:00
Adam Seering f71b69bf7c
ENH Upgrade to Python 3.7.1 (#619) 2020-03-11 11:32:30 +01:00
Adam Seering 6a02cabaad Update to use sdk-fastcomp-tag-<version> for emscripten (#589)
* Update to use sdk-fastcomp-tag-<version> for emscripten, as sdk-tag-<version> is no longer available upstream.
* Update code to use new path
* Replace Circle-CI CPU_CORES hack with environment variables (now supported upstream)

Co-authored-by: AndyLockhart <AndyLockhart@users.noreply.github.com>
2019-12-31 12:09:39 -05:00
Roman Yurchak 2cf8639973 MAINT Move package tests under packages/ dir (#471)
* Move package tests under the packages/ folder

* Fix tests
2019-06-19 14:26:08 -04:00
Michael Droettboom 1799e45525 Go back to tags only 2019-05-31 15:50:59 -04:00
Michael Droettboom d5c7794ea6 Use sudo to deploy 2019-05-31 15:50:35 -04:00
Michael Droettboom 722b8f0f7c Deploy from master 2019-05-31 14:41:15 -04:00
Michael Droettboom 87da2ec033
Automated deployment to Netlify (#451) 2019-05-31 14:39:52 -04:00
Michael Droettboom 047b414f3d
Upgrade to emscripten 1.38.30 (#374) 2019-04-04 07:57:47 -04:00
Michael Droettboom 5c3bf202a2 Update build cache version 2019-01-17 08:27:12 -05:00
Michael Droettboom fe16f98a70 Fix #283: Handle function pointers in dylib with signatures not in main 2018-12-20 13:07:54 -05:00
Roman Yurchak 79ba41b484 Update the iodide/pyodide-env:0.3.1 image 2018-11-15 13:24:27 +01:00
Roman Yurchak 66fe5feb2c Better refactoring 2018-11-15 13:24:27 +01:00
Roman Yurchak d6bc94ef53 Refactor scipy tests 2018-11-15 13:24:27 +01:00
Roman Yurchak ccdadc6e93 Move CLAPACK_WA to the root folder 2018-11-15 13:22:36 +01:00
Roman Yurchak 3e1d6348a7 Statically link BLAS/LAPACK 2018-11-15 13:22:36 +01:00
Roman Yurchak 9482984268 More patches for ellip_harm_2.pyx that uses ctypes 2018-11-15 13:22:36 +01:00
Roman Yurchak 27319bc675 Fix build in Docker 2018-11-15 13:22:36 +01:00
Roman Yurchak ad94658e68 Force malloc 2018-11-15 13:22:36 +01:00
Roman Yurchak 40605620f8 Use scipy 0.17.1 2018-11-15 13:22:36 +01:00
Michael Droettboom b4830f8f66 Fix typo 2018-11-07 12:17:03 -05:00
Michael Droettboom 30e7cc1182 Fix release packaging 2018-11-07 09:44:13 -05:00
Michael Droettboom 276aff3eca Quote arguments to ghr command 2018-11-06 15:19:51 -05:00
Michael Droettboom f6ad68fdf2 Trying to fix deploy 2018-11-06 10:53:48 -05:00
Michael Droettboom 5cabeb8c97 Fix tagging for deploy 2018-11-06 09:59:54 -05:00
Michael Droettboom 6814e077da Ignore branch 2018-11-06 09:20:01 -05:00
Michael Droettboom 9bffabdb96 Try to get master CI to run again 2018-11-06 08:24:39 -05:00
Michael Droettboom b50c8d622f Fix workflow 2018-11-02 13:02:00 -04:00
Michael Droettboom 76415e4abd Don't require Chrome to pass for deploy 2018-11-02 11:49:58 -04:00
Michael Droettboom 4d93d79f9c Fix multiple executor types 2018-11-02 11:30:36 -04:00
Michael Droettboom 0e47366eeb USe github releases for deployment 2018-11-02 11:25:13 -04:00
Michael Droettboom 9312bd1ee6
Merge pull request #212 from rth/package-joblib
Package joblib
2018-10-26 09:11:32 -04:00
Roman Yurchak bad48f6b34 Use emsdk version from the scipy PR 2018-10-23 12:19:40 +02:00
Roman Yurchak bb53e36a78 Rename to dryrun, add docstring and doctest 2018-10-23 12:13:59 +02:00
Roman Yurchak 4abdff5187 Add test_pywasmcross.py 2018-10-16 15:41:01 +02:00
Michael Droettboom 4879b77e52
Merge pull request #223 from rth/pure-python-tests
TST Add ability to run pure python tests
2018-10-15 16:31:28 -04:00
Roman Yurchak 53de9fa548 Attaching the workspace before build is not necessary 2018-10-15 20:56:14 +02:00
Roman Yurchak 00db2a4be1 Ability to run pure python tests 2018-10-15 17:29:06 +02:00
Roman Yurchak c10d0b138a Address review comments and use the new iodide/pyodide-env:0.3.0 image 2018-10-15 15:28:11 +02:00
Roman Yurchak cf55eb3294 Optimize the pyodide-env docker image 2018-10-15 14:54:13 +02:00
Michael Droettboom da7b5803a6 Rename image pyodide -> pyodide-env 2018-10-09 12:38:51 -04:00
Michael Droettboom 7ae58324bc Address comments in the PR 2018-10-09 10:22:25 -04:00
Michael Droettboom 4562841b61 Provide a Docker image for building 2018-10-08 15:33:33 -04:00
Roman Yurchak 0fa6f7b808 Only store benchmark.json in artefacts 2018-10-04 14:07:40 +02:00
Roman Yurchak 95379aa043
Merge pull request #202 from mdboom/fix-benchmarks
Fix benchmarks in light of recent changes
2018-10-03 12:02:02 +02:00
Michael Droettboom 370a4f06f3 Don't plot on Circle-CI 2018-10-02 17:56:27 -04:00
Michael Droettboom 210bc3c585 Fix patch 2018-10-02 13:23:26 -04:00
Michael Droettboom eee0fa2c8a Fix benchmark job 2018-10-02 12:06:08 -04:00
Michael Droettboom f985065347 Upgrade C libraries in benchmark job 2018-10-02 11:07:41 -04:00
Michael Droettboom 6f2656e979 Fix ordering of downloads 2018-10-02 09:29:16 -04:00
Michael Droettboom 6ca3f2be9a Fix benchmark job 2018-10-02 09:25:35 -04:00
Michael Droettboom 4fe1d47459 Fix running of benchmark in Circle-CI 2018-10-01 21:13:32 -04:00
Michael Droettboom a685f18f0e Fix benchmarks in light of recent changes 2018-10-01 18:54:31 -04:00
Michael Droettboom 94e935b4c8
Merge pull request #107 from rth/pyodide-package
Refactoring common functions under pyodide_build
2018-09-27 12:32:43 -04:00
Roman Yurchak b9ad36fdd7 Set "BINARYEN_TRAP_MODE='clamp'" 2018-09-27 11:38:26 +02:00
Michael Droettboom ec7912005a Fix LZ4 decoding bug
This was introduced in #170, but wasn't caught since emsdk didn't get rebuilt
2018-09-21 14:53:13 -04:00