Commit Graph

  • dcf644596d
    Set workerpool with_scheduler defaults to True (#2027) Christofer Saputra 2024-02-13 09:33:06 +0700
  • cfc1af992c
    Update README.md (#2036) Arne Strickmann 2024-02-13 03:32:27 +0100
  • e379151e2c Delay a bit longer for test chromium7 2024-02-12 08:56:41 +0700
  • f265717991 Black format chromium7 2024-02-11 22:12:08 +0700
  • 7b37d88535 Add delay before sending shutdown command chromium7 2024-02-11 22:08:10 +0700
  • 05e513666e fix #2038 Joe 2024-02-09 12:13:20 -0700
  • a06480c87a
    Update README.md Arne Strickmann 2024-02-06 21:29:53 +0100
  • 0f518608f5 Remove push_connection from workers.py and cli Selwin Ong 2024-02-04 20:03:46 +0700
  • 8f904932f3
    Bump codecov/codecov-action from 3 to 4 dependabot[bot] 2024-01-31 20:02:53 +0000
  • 304393a8cd Fix pipeline call to exists Ethan Wolinsky 2024-01-28 16:40:40 -0500
  • 83952a9bf4 Pipeline group cleanup Ethan Wolinsky 2024-01-28 12:09:02 -0500
  • 1bab378d9b Removed push_connection from worker.work() Selwin Ong 2024-01-28 15:31:18 +0700
  • e61afce72e Removed pop_connection from Worker.find_by_key() Selwin Ong 2024-01-28 07:44:47 +0700
  • 1ea6d1ea4e Fix black formatting Ethan Wolinsky 2024-01-27 10:19:00 -0500
  • 5dfd386d4e Apply black formatting Ethan Wolinsky 2024-01-27 09:49:12 -0500
  • b3413959a5 Cleanup expired jobs Ethan Wolinsky 2024-01-27 09:17:17 -0500
  • 41eb67eb85 Check if group exists instead of catching error Ethan Wolinsky 2024-01-27 09:17:05 -0500
  • 00f5e3d8e9 Use all method when cleaning group registry Ethan Wolinsky 2024-01-27 09:16:47 -0500
  • c08108b98f Move cleanup logic to instance method Ethan Wolinsky 2024-01-27 09:16:21 -0500
  • b8b6bb76a2 Use uuid4().hex for shorter id Ethan Wolinsky 2024-01-27 08:24:50 -0500
  • 997422671f Set workerpool with_scheduler defaults to True chromium7 2024-01-22 13:02:00 +0700
  • 37941847c2 Add with_scheduler support for WorkerPool chromium7 2024-01-22 11:57:53 +0700
  • 2f5fecc1ba
    fix: cast redis server version from `float` to `str` (#2025) Péter Gyarmati 2024-01-19 01:21:26 +0100
  • fc4349b2ac
    fix: cast redis server version from `float` to `str` Péter Gyarmati 2024-01-18 16:49:02 +0100
  • 5b8991b1fc Fix test to assert that lock is released Ethan Wolinsky 2024-01-17 21:52:20 -0500
  • bd5df181a3 Delete maintenance lock after registries cleaned Ethan Wolinsky 2024-01-17 21:10:45 -0500
  • 71680118c2 Clean groups before fetching Ethan Wolinsky 2024-01-17 21:05:28 -0500
  • 9dc6a37135 Fix group name arg Ethan Wolinsky 2024-01-17 20:57:13 -0500
  • 2a448bfaf7 Fix group name arg Ethan Wolinsky 2024-01-17 20:14:40 -0500
  • 02d7747309 Remove job_ids variable Ethan Wolinsky 2024-01-17 20:12:19 -0500
  • 7e69d83d1c Only run cleanup when jobs are retrieved Ethan Wolinsky 2024-01-17 20:08:58 -0500
  • 1582a6c3f8 Rename id arg to name Ethan Wolinsky 2024-01-17 20:08:00 -0500
  • eec01f71db Assert job 1 data in group Ethan Wolinsky 2024-01-17 20:01:43 -0500
  • 3e73a6b959 Add slow decorator Ethan Wolinsky 2024-01-17 20:00:23 -0500
  • c387d5825a Rename expired job ids array Ethan Wolinsky 2024-01-17 19:56:17 -0500
  • 2c8521078c Make pipeline mandatory in _add_jobs method Ethan Wolinsky 2024-01-17 19:55:32 -0500
  • e2b600d9df
    docs: fix typo in `workers.md` (#2023) Péter Gyarmati 2024-01-13 03:02:00 +0100
  • b6159abb76
    docs: fix typo in `workers.md` Péter Gyarmati 2024-01-11 12:44:53 +0100
  • aed76e93eb Fix issues raised in #2005 - share 'last_cleaned_at' between workers and set it at maintenance task start time - release maintenance lock when maintenance task is finished Damien Krotkine 2023-12-30 16:32:35 +0100
  • a8209391ff
    Fix 'quiet' option for 'worker_pool' comand (#2010) Mindiell 2023-12-24 04:16:18 +0100
  • 960d9e5123
    chore(logging): add logging for job retries (#2012) Mathieu Défosse 2023-12-24 03:54:25 +0100
  • e81bed0ed8 Added test for 'quiet' option Mindiell 2023-12-20 09:29:40 +0100
  • 3b18d75f36
    Bump actions/setup-python from 4.7.1 to 5.0.0 (#2013) dependabot[bot] 2023-12-19 18:32:35 +0800
  • ed4abd4448
    Bump actions/download-artifact from 3 to 4 (#2018) dependabot[bot] 2023-12-19 18:32:08 +0800
  • 6bd43325eb
    Bump actions/upload-artifact from 3 to 4 (#2019) dependabot[bot] 2023-12-19 18:31:52 +0800
  • 02d712d995
    Bump github/codeql-action from 2 to 3 (#2017) dependabot[bot] 2023-12-18 21:02:33 +0800
  • 59e92666c7
    Bump supercharge/redis-github-action from 1.7.0 to 1.8.0 (#2016) dependabot[bot] 2023-12-18 21:02:18 +0800
  • 4e61e284aa chore(logging): add logging for job retries Mathieu Défosse 2023-12-06 11:44:14 +0100
  • 03b1b205ee
    Bump actions/upload-artifact from 3 to 4 dependabot[bot] 2023-12-14 19:19:36 +0000
  • 3b1bf83f93
    Bump actions/download-artifact from 3 to 4 dependabot[bot] 2023-12-14 19:19:31 +0000
  • f101f480a4
    Bump github/codeql-action from 2 to 3 dependabot[bot] 2023-12-13 19:40:39 +0000
  • 86279ba5ce style: fix ruff finding Jesse P. Johnson 2023-12-13 10:40:49 -0600
  • 70062a59bc style: format black errors Jesse P. Johnson 2023-12-12 16:47:28 -0600
  • 0b3a9fb68b refactor: remediate common security findings Jesse P. Johnson 2023-12-12 16:34:15 -0600
  • 6364b4b32b
    Bump supercharge/redis-github-action from 1.7.0 to 1.8.0 dependabot[bot] 2023-12-12 19:29:14 +0000
  • c1d223dc43 Remove unused import Ethan Wolinsky 2023-12-10 18:23:03 -0700
  • 377cd24c91 Remove str group test Ethan Wolinsky 2023-12-10 18:20:58 -0700
  • 72a635a4df Move cleanup logic to classmethod Ethan Wolinsky 2023-12-10 18:20:33 -0700
  • 45def899e5 Only allow Queue in enqueue many Ethan Wolinsky 2023-12-10 17:01:36 -0700
  • 0f2c5e01bd Fix group constant names Ethan Wolinsky 2023-12-10 16:56:54 -0700
  • 7a1f311558 Update feature version Ethan Wolinsky 2023-12-10 16:55:13 -0700
  • 8fe58b5534 Rename clean_group_registries method Ethan Wolinsky 2023-12-10 16:53:36 -0700
  • b767420fbb
    Bump actions/setup-python from 4.7.1 to 5.0.0 dependabot[bot] 2023-12-06 19:39:37 +0000
  • b8acb5d369
    Bump actions/setup-python from 4.7.1 to 4.8.0 dependabot[bot] 2023-12-05 19:41:13 +0000
  • ff932c2f83 Fix 'quiet' option for 'worker_pool' comand Mindiell 2023-12-03 17:18:59 +0100
  • 29bb95e8f8 ci: simplify sast job Jesse P. Johnson 2023-11-28 21:10:41 -0600
  • e192bb8e4a ci: simplify sast job Jesse P. Johnson 2023-11-28 21:07:35 -0600
  • cb1c1a68f0 ci: simplify sast job Jesse P. Johnson 2023-11-28 20:42:32 -0600
  • 0257ad1383 test: add static application security testing Jesse P. Johnson 2023-11-28 20:19:43 -0600
  • 5b3484da7b Enqueue dependents when job is abandoned maya 2023-11-26 19:31:36 +0100
  • d11094af95
    Typo: serialzers in workers.md (#2000) Conor 2023-11-24 07:33:02 -0500
  • 6e620b33bc
    make sure the job data is not expired by Redis before the maintenance task runs and expire the job rezference id in the various registries (#8) Damien Krotkine 2023-11-23 12:30:53 +0100
  • 7a83eff5bd
    add more docstring indicating CPU and space complexity (#7) Damien Krotkine 2023-11-23 10:05:23 +0100
  • 5a3a8ce681 Responding to PR comments, switching to setting the expiry of the settings instead of checking to respect the pipelining Neil Goossen 2023-10-23 10:33:58 -0700
  • cdcd6784de Addressing Issue #1602 Neil Goossen 2023-10-19 16:24:09 -0700
  • 627a9c02db Remove local config file Ethan Wolinsky 2023-11-12 21:09:23 -0500
  • 827b96435e Sort imports Ethan Wolinsky 2023-11-12 21:07:53 -0500
  • 885d0d6123 Import EnqueueData for type hint Ethan Wolinsky 2023-11-12 21:07:45 -0500
  • 134e1e38e9 Merge branch 'master' into feature/batch-jobs Ethan Wolinsky 2023-11-12 20:57:56 -0500
  • 2a1343c5a9 Change Batch to Group Ethan Wolinsky 2023-11-12 20:55:32 -0500
  • cf3fa15c27 Don't delete batch in cleanup Ethan Wolinsky 2023-11-12 20:48:56 -0500
  • 093f3db770 Add test for batched jobs with str queue arg Ethan Wolinsky 2023-11-12 20:43:16 -0500
  • 2679e496c8 Update batch docs Ethan Wolinsky 2023-11-12 20:43:00 -0500
  • b25377b521 Move batch enqueueing to batch class Ethan Wolinsky 2023-11-12 20:37:47 -0500
  • 8965b4ca3b
    Allow CA be passed as a variable (#1969) Yamil Asusta 2023-11-10 21:01:15 -0400
  • 85b32492a3
    add more docstring indicating CPU and space complexity (#6) Damien Krotkine 2023-11-10 11:25:02 +0100
  • 8560909574
    Merge branch 'rq:master' into patch-1 Yamil Asusta 2023-11-09 09:22:00 -0400
  • 04a40927ab ruff fix Damien Krotkine 2023-11-08 20:54:33 +0100
  • 0cc204313f
    remove calls to cleanup from count and get_job_ids methods of the registry classes, because it's impacting performance, and it's redundant with the workers' maintenance task that already calls cleanup (#5) Damien Krotkine 2023-11-08 20:16:58 +0100
  • 98be5b84bf remove calls to cleanup from count and get_job_ids methods of the registry classes, beacause it's impacting performance, and it's redundant with the workers' maintenance task that already calls cleanup Damien Krotkine 2023-11-08 20:03:49 +0100
  • 95a8eb4f3c
    also delete the root worker key (#4) Damien Krotkine 2023-11-08 18:33:07 +0100
  • a34cb09a33
    cleanup workers keys that expired and were then recreated because increment_successful/failed_job_count or increment_total_working_time. Such workers keys end up as redis hash with only 2 fields, and *no TTL expiration* so they consume redis space for nothing (#3) Damien Krotkine 2023-11-08 10:28:18 +0100
  • 236d765862
    Typo: serialzers in workers.md Conor 2023-11-07 15:16:20 -0500
  • 0d3a160149 Blackify executions.py Selwin Ong 2023-11-03 18:12:25 +0700
  • 0a64cb40ae Prepare docs for release Selwin Ong 2023-11-03 18:04:50 +0700
  • 3c89f9dada
    Job with multiple executions (#1964) Selwin Ong 2023-11-03 17:05:59 +0700
  • 317406d4e6
    don't cleanup when counting (#2) Damien Krotkine 2023-11-02 15:46:07 +0100
  • 6eb03adf3a
    Merge pull request #1 from alan-eu/dams/cpu_time_complexity Damien Krotkine 2023-11-02 12:26:17 +0100
  • ab94173d71 better name Damien Krotkine 2023-11-02 11:46:06 +0100
  • cdf683704e Start adding CPU time complexity doc Damien Krotkine 2023-11-02 11:41:56 +0100