mitogen/.ci
Alex Willmer f9a6748154 ci: Fix Python 2.7 builds on macOS 11
With current macOS 11 runner images (20231216.1) the `python` on `$PATH` is
Python 3.12 and setuptools isn't installed by default. E.g.

```
python -mtox -e "py27-mode_localhost-ansible4"
========================== Starting Command Output ===========================
/bin/bash --noprofile --norc
/Users/runner/work/_temp/93a29c4c-f606-45e4-8dbd-a4a5f51b8730.sh
GLOB sdist-make: /Users/runner/work/1/s/setup.py
ERROR: invocation failed (exit code 1), logfile:
/Users/runner/work/1/s/.tox/log/GLOB-0.log
================================== log start
===================================
Traceback (most recent call last):
  File "/Users/runner/work/1/s/setup.py", line 32, in <module>
    from setuptools import find_packages, setup
ModuleNotFoundError: No module named 'setuptools'
```

Installing setuptools under Python 3.12 chooses package versions incompatible
with Python 2.7. Additionally Mitogen isn't yet compatible with Python 3.12
(#1033), so tests that call a local context with `python` fail.
2024-01-10 10:04:10 +00:00
..
soak .ci: import soak scripts. 2019-02-18 18:01:54 +00:00
README.md ci: Switch Continuous Integration to Tox 2021-11-10 20:17:53 +00:00
ansible_install.py ci: Switch Continuous Integration to Tox 2021-11-10 20:17:53 +00:00
ansible_tests.py tests: Don't rely on facts when setting become 2022-09-12 19:59:51 +01:00
azure-pipelines-steps.yml ci: Fix Python 2.7 builds on macOS 11 2024-01-10 10:04:10 +00:00
azure-pipelines.yml Add Python 3.11 support 2023-08-11 09:35:54 +01:00
ci_lib.py tests: Only use subprocess32 package on Python 2.x 2023-08-10 09:31:32 +01:00
debops_common_install.py tests: Suppress pip version warnings 2022-04-20 14:10:40 +01:00
debops_common_tests.py Support for Ansible 3 & 4 2021-11-12 22:10:53 +00:00
localhost_ansible_install.py ci: Switch Continuous Integration to Tox 2021-11-10 20:17:53 +00:00
localhost_ansible_tests.py Remove unused module imports 2022-04-23 10:01:06 +01:00
mitogen_install.py ci: Switch Continuous Integration to Tox 2021-11-10 20:17:53 +00:00
mitogen_py24_install.py ci: Switch Continuous Integration to Tox 2021-11-10 20:17:53 +00:00
mitogen_py24_tests.py issue #477: add mitogen_py24 CI test type. 2019-01-26 22:00:30 +00:00
mitogen_tests.py issue #482: ci: add stray process checks to all jobs 2019-08-09 20:19:16 +01:00

README.md

.ci

This directory contains scripts for Continuous Integration platforms. Currently Azure Pipelines, but they will also happily run on any Debian-like machine.

The scripts are usually split into _install and _test steps. The _install step will damage your machine, the _test step will just run the tests the way CI runs them.

There is a common library, ci_lib.py, which just centralized a bunch of random macros and also environment parsing.

Some of the scripts allow you to pass extra flags through to the component under test, e.g. ../../.ci/ansible_tests.py -vvv will run with verbose.

Hack these scripts until your heart is content. There is no pride to be found here, just necessity.

ci_lib.run_batches()

There are some weird looking functions to extract more paralellism from the build. The above function takes lists of strings, arranging for the strings in each list to run in order, but for the lists to run in parallel. That's great for doing setup.py install while pulling a Docker container, for example.

Environment Variables

  • TARGET_COUNT: number of targets for debops_ run. Defaults to 2.
  • DISTRO: the mitogen_ tests need a target Docker container distro. This name comes from the Docker Hub mitogen user, i.e. mitogen/$DISTRO-test
  • DISTROS: the ansible_ tests can run against multiple targets simultaneously, which speeds things up. This is a space-separated list of DISTRO names, but additionally, supports:
    • debian-py3: when generating Ansible inventory file, set ansible_python_interpreter to python3, i.e. run a test where the target interpreter is Python 3.
    • debian*16: generate 16 Docker containers running Debian. Also works with -py3.