Rooba
/
proxy.py
mirror of https://github.com/abhinavsingh/proxy.py.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
proxy.py/benchmark/README.md

37 lines
820 B
Markdown
Raw Normal View History

Add benchmarks comparison for `proxy.py`, `tornado`, `aiohttp`, `flask` (#827) * Add benchmarks for `proxy.py`, `tornado`, `aiohttp`, `flask` * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Lint happy * Disable W0223 for tornado Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 14:50:23 +00:00
# Benchmark
# Table of Contents
Add `benchmark` results to `README.md` (#828) * Add benchmark results to top-level README * mypy * Push down WIP example * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Spelling * Link rtfd within `Internal Documentation` for now Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 18:40:04 +00:00
- [TL;DR](#tldr)
Add benchmarks comparison for `proxy.py`, `tornado`, `aiohttp`, `flask` (#827) * Add benchmarks for `proxy.py`, `tornado`, `aiohttp`, `flask` * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Lint happy * Disable W0223 for tornado Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 14:50:23 +00:00
- [Usage](#usage)
- [Results](#results)
Add `benchmark` results to `README.md` (#828) * Add benchmark results to top-level README * mypy * Push down WIP example * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Spelling * Link rtfd within `Internal Documentation` for now Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 18:40:04 +00:00
## TL;DR
Optimizations & Update Benchmark Results (#832) * Bail out of lock earlier * Avoid calling `get_events` for unfinished work tasks. Use `cached_property` for `HttpParser` optimization * Add `type: ignore[no-any-return]`, odd scenario * We dont have to rebuild response packet repeatedly within `WebServerPlugin` * Parse line and header in one invocation * Minor optimizations and update benchmark to use `oha` instead of `hey` * Remove `flask` from benchmark, only benchmark `asgi` or `async` based libraries. Use `uvicorn` and 10 workers for `blacksheep`. Use `oha` instead of `hey` * Add benchmark for `starlette` * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Add missing dep * pre-commit Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-30 22:48:49 +00:00
NOTE: On Macbook Pro 2019 / 2.4 GHz 8-Core Intel Core i9 / 32 GB RAM
Add `benchmark` results to `README.md` (#828) * Add benchmark results to top-level README * mypy * Push down WIP example * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Spelling * Link rtfd within `Internal Documentation` for now Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 18:40:04 +00:00
Optimizations & Update Benchmark Results (#832) * Bail out of lock earlier * Avoid calling `get_events` for unfinished work tasks. Use `cached_property` for `HttpParser` optimization * Add `type: ignore[no-any-return]`, odd scenario * We dont have to rebuild response packet repeatedly within `WebServerPlugin` * Parse line and header in one invocation * Minor optimizations and update benchmark to use `oha` instead of `hey` * Remove `flask` from benchmark, only benchmark `asgi` or `async` based libraries. Use `uvicorn` and 10 workers for `blacksheep`. Use `oha` instead of `hey` * Add benchmark for `starlette` * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Add missing dep * pre-commit Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-30 22:48:49 +00:00
| Server | Throughput (request/sec) | Num Workers | Runner |
| ------ | ------------ | ------------------------| ------ |
| `blacksheep` | 46,564 | 10 | uvicorn |
| `starlette` | 44,102 | 10 | uvicorn |
| `proxy.py` | 39,232 | 10 | - |
| `aiohttp` | 6,615 | 1 | - |
| `tornado` | 3,301 | 1 | - |
Add `benchmark` results to `README.md` (#828) * Add benchmark results to top-level README * mypy * Push down WIP example * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Spelling * Link rtfd within `Internal Documentation` for now Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 18:40:04 +00:00
Optimizations & Update Benchmark Results (#832) * Bail out of lock earlier * Avoid calling `get_events` for unfinished work tasks. Use `cached_property` for `HttpParser` optimization * Add `type: ignore[no-any-return]`, odd scenario * We dont have to rebuild response packet repeatedly within `WebServerPlugin` * Parse line and header in one invocation * Minor optimizations and update benchmark to use `oha` instead of `hey` * Remove `flask` from benchmark, only benchmark `asgi` or `async` based libraries. Use `uvicorn` and 10 workers for `blacksheep`. Use `oha` instead of `hey` * Add benchmark for `starlette` * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Add missing dep * pre-commit Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-30 22:48:49 +00:00
- On a single core, `proxy.py` yields `~9449 req/sec` throughput.
- Try it using `--num-acceptors=1`
Add `benchmark` results to `README.md` (#828) * Add benchmark results to top-level README * mypy * Push down WIP example * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Spelling * Link rtfd within `Internal Documentation` for now Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 18:40:04 +00:00
Add benchmarks comparison for `proxy.py`, `tornado`, `aiohttp`, `flask` (#827) * Add benchmarks for `proxy.py`, `tornado`, `aiohttp`, `flask` * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Lint happy * Disable W0223 for tornado Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 14:50:23 +00:00
## Usage
```console
❯ git clone https://github.com/abhinavsingh/proxy.py.git
❯ cd proxy.py
❯ pip install -r benchmark/requirements.txt
❯ ./benchmark/compare.sh > /tmp/compare.log 2>&1
```
## Results
```console
❯ cat /tmp/compare.log
```