Commit Graph

170 Commits

Author SHA1 Message Date
Matus Valo b506a514e1 pin pytest<=5.3.5 due issue in pytest-sugar 2020-04-03 14:16:31 +02:00
Miro Hrončok 97e887605b Use importlib.metadata from the standard library on Python 3.8+ (#1086) 2019-12-03 07:57:07 +06:00
Asif Saif Uddin 597d675ca1
Revert "Issue #1087 redis fix (#1089)" (#1106)
This reverts commit 2f6f5f6a5d.
2019-11-02 23:43:08 +06:00
Asif Saif Uddin 19528addd7
remove hard pin 2019-11-02 23:34:53 +06:00
Kris Ciccarello 2d92827746 Issue #1019 Fix redis transport socket timeout (#1113)
* Issue #1019 Fix redis transport socket timeout

Patch from @jschwartzentruber https://github.com/celery/kombu/issues/1019#issuecomment-535157400

* Fix test_register_with_event_loop redis test

* Fix linter

* Bump redis to 3.3.11
2019-10-23 10:23:26 +06:00
Asif Saif Uddin b51d1d678e
pinned to amqp 2.5.2 to avoid previous mistake 2019-10-01 16:53:41 +06:00
Asif Saif Uddin 2d72047861
pin py-amqo to 2.5.2 2019-09-30 19:09:01 +06:00
Matt Davis 2f6f5f6a5d Issue #1087 redis fix (#1089)
* issue-1087 Revert _lookup api and correct redis implemetnation.  Update variable naming to be self documenting and more readable by non native speakers.  Major overhaul of redis test cases by adding more full featured fakeredis module.

* Add more test cases to boost coverage of kombu redis transport.

* Refactor the producer consumer test cases to be based on original mocks and be passing

* Fix lingering line length issue in test.
2019-08-31 23:54:01 +06:00
Matt Davis 8a974955a8 issue-1035 it might just work to include the prior version which was able to upload the various binary wheels to pypi. (#1083) 2019-08-18 10:40:41 +06:00
Asif Saif Uddin ab35032d05
bump py-amqp to 2.5.1 2019-08-14 22:11:46 +06:00
Marcin Puhacz 0ad7d08c4c Fixing MongoDB backend to work properly with TTL (#1076)
* Fixing MongoDB backend to work properly with TTL
Bumping pymongo version to 3.8.0

* Updating authors

* Adding dependencies to travis config

* Fixing travis test cases

* Changing pymongo version to align with mongo result backend
2019-08-07 15:06:13 +03:00
David Szotten 193054d243 Switch from pkg_resources importlib-metadata (#1071)
See e.g. https://github.com/pypa/setuptools/issues/510#issuecomment-463667124

On a moderatly large project (~200 packages) at $work this saves ~150 ms on
`python -c 'from kombu import Exchange'`
2019-07-06 00:33:35 +06:00
Asif Saif Uddin b91c81be43
Revert "Use fastuuid on CPython>=3.5 (#1056)" (#1061)
This reverts commit f9fbd8eb48.
2019-06-15 03:25:50 +06:00
Omer Katz f9fbd8eb48
Use fastuuid on CPython>=3.5 (#1056)
* Use fastuuid on CPython>=3.5.

* Only install fastuuid on Linux.

* For some reason we're stillgetting the thrusty build env.
Specify xenial explictly.

* Specify Python versions for lint stages.

* Ensure pycurl deps are installed.

* Run update before.

* Upgrade tox and dependencies.

* Happify docstyle.
2019-06-10 18:14:25 +03:00
Asif Saif Uddin b20c8e0e7b
min 2.5 pyamqp 2019-05-30 17:09:37 +06:00
Omer Katz e83f1c5371 Fix windows build (#1044)
* Fix requirements for CI.

* Try to skip PyCurl on Windows CI when testing 3.7.

* Fix apicheck job.
2019-05-16 00:37:18 +06:00
Omer Katz c5845ba950
Added an index with windows wheels for lzma. (#1043) 2019-05-15 12:51:23 +03:00
Asif Saif Uddin 066de17200
fixed packaging issue. 2019-05-12 17:54:26 +06:00
Omer Katz ba6850f649 Added pytest-travis-fold to clean up CI output. 2019-03-03 21:39:55 +02:00
Peter Lithammer eb6e4c8d51 Revert #954 and update redis-py to at least 3.2.0 (#1011)
This reverts #954, and bumps the required redis-py dependency to 3.2.0
to include this fix:

4e1e748092

Fixes #1006
2019-02-22 12:09:39 +06:00
Asif Saif Uddin 4a4f1b9106
required py-amqp 2.4 as minimum version 2019-01-13 20:48:46 +06:00
Omer Katz 627964c804
Added optional support for zstd compression. (#985) 2019-01-13 09:44:44 +02:00
Omer Katz 8c88d9276a Added support for lzma compression (#984)
* Added support for lzma compression.

* Ignore branch.
2019-01-10 15:00:37 +06:00
Omer Katz 93a05f7261
Added optional support for brotli compression (#983)
* Added optional support for brotli compression.

* Ignore import error for coverage purposes.
2019-01-09 19:05:02 +02:00
Irmen de Jong aa8ea28f50 Making the pyro transport available, fix it for recent Pyro4 versions, add broker daemon (#895)
* Make the pyro transport available and fix it for recent Pyro4 version.
Implemented the missing Pyro Kombu broker to actually be able to use the Pyro transport

* code style
2018-11-25 20:40:54 +06:00
Omer Katz 71c0d0a34b
Revert "Pin Redis-py version (#946)" (#952)
This reverts commit d9de66bd4e.
2018-11-19 19:34:08 +02:00
Ash Berlin-Taylor d9de66bd4e Pin Redis-py version (#946)
Redis-py 3.0.0 was released today and introduced a backwards incompatible changes.

9b03af26dc/CHANGES (L27-L29)

This isn't the "best" fix but is the quickest
2018-11-15 19:10:34 +02:00
Clemens Wolff 32633554ac Add transports based on Azure PaaS (#891)
* Add transports based on Azure PaaS

This pull request adds two new transport implementations:

- `azurestoragequeues` is implemented on top of Azure Storage
  Queues [1]. This offers a simple but scalable and low-cost PaaS
  transport for Celery users in Azure. The transport is intended to be
  used in conjunction with the Azure Block Blob Storage backend [2].

- `azureservicebus` is implemented on top of Azure Service Bus [3] and
  offers PaaS support for more demanding Celery workloads in Azure. The
  transport is intended to be used in conjunction with the Azure
  CosmosDB backend [4].

This pull request was created together with @ankurokok, @dkisselev,
@evandropaula, @martinpeck and @michaelperel.

[1] https://azure.microsoft.com/en-us/services/storage/queues/
[2] https://github.com/celery/celery/pull/4685
[3] https://azure.microsoft.com/en-us/services/service-bus/
[4] https://github.com/celery/celery/pull/4720

* Exclude Azure transports from code coverage

There is test coverage for the transports but the tests require Azure
credentials to run (passed via environment variables) so codecov doesn't
exercise them.

* Remove env vars to configure transport

* Remove abbreviations
2018-08-30 23:34:52 +06:00
Omer Katz b59bf1b679
Added Python 3.7 to the build matrix (#908)
* Run tests with Python 3.7.

* Add missing dependencies.

* Show skip reasons.

* Add more dependencies to CI tests.

* Fix requirements.
2018-08-16 07:53:25 -05:00
Omer Katz c1351f59df
Use pytest-sugar for output. 2018-05-20 11:02:41 +03:00
Nicolas Delaby 9883a300f6 msgpack package has been renamed (#822)
https://github.com/msgpack/msgpack-python#messagepack-for-python
2018-01-09 18:07:45 +06:00
Omer Katz 81e52b1a9a
Install sphinx_celery from git for now. (#818) 2017-12-13 10:27:14 +02:00
Colin Jeanne 488ed977e0 Require Redis 2.10.4 or greater (#788)
* Require Redis 2.10.4 or greater

The Redis transport uses the `can_read`'s `timeout` parameter. This parameter was added in 2.10.4.

* Bump the version to what Celery uses
2017-09-08 07:45:35 +03:00
Amin Ghadersohi be79b3d4cd Re-Adding support for sqlalchemy as it is needed by Apache project Airflow (#687)
* Re-Adding support for sqlalchemy as it is needed by Apache project Airflow

* Re-Adding support for sqlalchemy as it is needed by Apache project Airflow
2017-05-17 14:17:47 +06:00
georgepsarakis d27abc837d Use pydocstyle version 1.1.1 for now 2017-04-26 21:45:17 +03:00
georgepsarakis cdbfe9a64e Allow endpoint URL to be specified in the boto3 connection
- Minor fixes after re-enabling unit tests
2017-04-16 11:28:24 +03:00
Mischa Spiegelmock 129a9e4ed0 Switching to boto3 only (#693)
* Switch Boto2 to Boto3 for SQS messaging

* Fixed region support

* Add SQS FIFO queue support

* Add sensible defaults for message attributes

* Asynchronous support, plus boto3 for region endpoint lookups

* Clean up imports

* Fix Python 2 support

* Fix receive_message tests

* Reformat docstring

* boto3 import changes for CI

* skip tests if boto3 not installed

* skip tests if boto3 not installed

* flake8

* noboto

* ditching boto2. got queue URL fetching, async HTTP request generation and signing working.

* request signing working kinda

* async parsing of SQS message response more or less working

* botocore sqs dep

* ripping out more old boto2 stuff

* removing tests that are no longer valid with boto3/SQS

* fix boto3 dep, min version and no botocore

* no boto2 for test

* cleaning up some SQS tests. fixing header parsing of response to msg

* fixing some sqs tests

* removing response-parsing tests that are no longer necessary as we're using the botocore response parsing machinery instead of implementing SAX parsing in kombu.

* fixing more SQS tests

* wants a region

* trying to fix py2 parsing of sqs message

* lint

* py2/py2 message header parsing stupidness

* forgot

* python 2 sux

* flake8

* Import boto3 from the right place

* Changes

* Update encode fuction

* Fix lint

* remove some unused things

* removing unused stuff

* ugh

* ugh

* ugh

* landscape ignoring

* shut up, landscape
2017-04-14 11:22:18 +06:00
Ask Solem 34eb5c714b Now depends on amqp 2.1.4 2016-12-15 15:30:53 -08:00
Ask Solem 2783d7f4b4 Now depends on amqp 2.1.3 2016-12-07 17:52:28 -08:00
Ask Solem 7708a66ab2 Now depends on amqp 2.1.2 2016-12-07 14:15:23 -08:00
Ask Solem a7fda57557 Try to fix test suite 2016-10-28 16:17:13 -07:00
Ask Solem e3d4b4ed53 Tests: Now depends on case 1.5.1 2016-10-28 15:50:25 -07:00
Ask Solem 27aae407f1 Tests: Now depends on case 1.5 2016-10-28 15:46:40 -07:00
Ask Solem 4c47054296 Now depends on amqp 2.1.1 2016-10-14 17:54:43 -07:00
Ask Solem c457a88459 pep257 -> pydocstyle 2016-10-11 14:59:00 -07:00
Ask Solem 0cc7a517fa Fixes flakes 2016-10-11 12:48:50 -07:00
Ask Solem c636c1e806 Now depends on amqp 2.1.0 2016-09-07 16:50:54 -07:00
Ask Solem ad1195ff97 Merge branch 'master' of github.com:celery/kombu 2016-08-29 13:20:33 -07:00
Ask Solem 8104aed130 kombu[sqs] now depends on pycurl 2016-08-29 13:20:17 -07:00
Stephen Milner 7fa3172ead Add Etcd Transport (#619)
This transport is highly influenced by the Consul Transport.
Messages are kept in keys within Etcd through the python-etcd library.
2016-08-26 15:06:54 +06:00