Generates realistic traffic for load testing tile servers

Brandon Liu

Last update: Dec 5, 2022

Related tags

Testing TileSiege

Overview

Generates realistic traffic for load testing tile servers. Useful for:

Measuring throughput, latency and concurrency of your tile serving stack.
Identifying bottlenecks such as network, disk I/O, filesystem, CPU.

You could benchmark using random tiles instead, but 70% of those will be ocean.

How to use

Install siege via apt install siege or another package manager.

Create a urls.txt from anonymized tile requests to openstreetmap.org for the week of 2021-08-08:

python create_urls.py

The output urls.txt will contain 10,000 rows, with server parameters you can edit:

PROT=http
HOST=localhost
PORT=8080
PATH=
EXT=pbf
$(PROT)://$(HOST):$(PORT)/$(PATH)9/271/168.$(EXT)
$(PROT)://$(HOST):$(PORT)/$(PATH)9/264/186.$(EXT)
...

Then run your load test:

siege --file=urls.txt

The frequency distribution of zooms will match the real data:

 0 |   2122775 █
 1 |   2216794 █
 2 |   6397943 █
 3 |  12472472 ██
 4 |  16428098 ███
 5 |  27779242 █████
 6 |  38843942 ██████
 7 |  41504547 ███████
 8 |  49778705 ████████
 9 |  56767305 █████████
10 |  72384991 ███████████
11 |  71587598 ███████████
12 |  99260380 ███████████████
13 | 135358540 ████████████████████
14 | 135036605 ████████████████████
15 | 136459409 ████████████████████
16 | 102903474 ████████████████
17 |  66522472 ██████████
18 |  37851474 ██████
19 |   6217710 █

Notes

The sequence of requests generated will not exhibit the same spatial correlation as real users panning and zooming.

You might also like...

A modern API testing tool for web applications built with Open API and GraphQL specifications.

Schemathesis Schemathesis is a modern API testing tool for web applications built with Open API and GraphQL specifications. It reads the application s

1.6k Jan 6, 2023

Sixpack is a language-agnostic a/b-testing framework

Sixpack Sixpack is a framework to enable A/B testing across multiple programming languages. It does this by exposing a simple API for client libraries

1.7k Dec 24, 2022

Automatically mock your HTTP interactions to simplify and speed up testing

VCR.py 📼 This is a Python version of Ruby's VCR library. Source code https://github.com/kevin1024/vcrpy Documentation https://vcrpy.readthedocs.io/ R

2.3k Jan 1, 2023

fsociety Hacking Tools Pack – A Penetration Testing Framework

Fsociety Hacking Tools Pack A Penetration Testing Framework, you will have every script that a hacker needs. Works with Python 2. For a Python 3 versi

8.2k Jan 3, 2023

Automatically mock your HTTP interactions to simplify and speed up testing

VCR.py 📼 This is a Python version of Ruby's VCR library. Source code https://github.com/kevin1024/vcrpy Documentation https://vcrpy.readthedocs.io/ R

1.8k Feb 7, 2021

Language-agnostic HTTP API Testing Tool

Dredd — HTTP API Testing Framework Dredd is a language-agnostic command-line tool for validating API description document against backend implementati

4k Jan 5, 2023

Web testing library for Robot Framework

SeleniumLibrary Contents Introduction Keyword Documentation Installation Browser drivers Usage Extending SeleniumLibrary Community Versions History In

1.2k Jan 3, 2023

✅ Python web automation and testing. 🚀 Fast, easy, reliable. 💠

Build fast, reliable, end-to-end tests. SeleniumBase is a Python framework for web automation, end-to-end testing, and more. Tests are run with "pytes

3k Jan 4, 2023

A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax

1.0 Release See here for details about breaking changes with the upcoming 1.0 release: https://github.com/taverntesting/tavern/issues/495 Easier API t

909 Dec 15, 2022

Comments

An actual amount of rows added to urls.txt is not equal to the number printed by the script

An actual amount of rows added to urls.txt is not equal to the number printed by the script. This is the reason why:

>>> OUTPUT_ROWS = 10000
>>> maxzoom = 19
>>> total_weight = 0
>>> distribution = [2,2,6,12,16,27,38,41,49,56,72,71,99,135,135,136,102,66,37,6]
>>> for zoom in range(maxzoom+1):
...     total_weight += distribution[zoom]
... 
>>> actual_num_of_rows = sum([int(OUTPUT_ROWS * distribution[zoom]/total_weight) for zoom in range(maxzoom+1)])
>>> assert OUTPUT_ROWS == actual_num_of_rows, "{} != {}".format(OUTPUT_ROWS, actual_num_of_rows)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AssertionError: 10000 != 9991

opened by drnextgis 2

limit generated URLs to a bounding box and zoom

When limiting to a bounding box, we need to change our sampling method, otherwise we will be biased towards low zoom levels. We should pre-calculate the target frequency distribution by zoom and then randomly do weighted samples within that zoom level.

opened by bdon 0

Owner

Brandon Liu

map stuff

GitHub

Scalable user load testing tool written in Python

Locust Locust is an easy to use, scriptable and scalable performance testing tool. You define the behaviour of your users in regular Python code, inst

15.3k Feb 8, 2021

Load Testing ML Microservices for Robustness and Scalability

The demo is aimed at getting started with load testing a microservice before taking it to production. We use FastAPI microservice (to predict weather) and Locust to load test the service (locally or on cloud). You can find detailed instructions in the Engineering MLOps book.

13 Jul 5, 2022

PENBUD is penetration testing buddy which helps you in penetration testing by making various important tools interactive.

penbud - Penetration Tester Buddy PENBUD is penetration testing buddy which helps you in penetration testing by making various important tools interac

15 Feb 1, 2022

Generates realistic traffic for load testing tile servers

Related tags

Overview

How to use

Notes

You might also like...

A modern API testing tool for web applications built with Open API and GraphQL specifications.

Sixpack is a language-agnostic a/b-testing framework

Automatically mock your HTTP interactions to simplify and speed up testing

fsociety Hacking Tools Pack – A Penetration Testing Framework

Automatically mock your HTTP interactions to simplify and speed up testing

Language-agnostic HTTP API Testing Tool

Web testing library for Robot Framework

✅ Python web automation and testing. 🚀 Fast, easy, reliable. 💠

A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax

Comments

An actual amount of rows added to urls.txt is not equal to the number printed by the script

limit generated URLs to a bounding box and zoom

Owner

Brandon Liu

Scalable user load testing tool written in Python

Load Testing ML Microservices for Robustness and Scalability

PENBUD is penetration testing buddy which helps you in penetration testing by making various important tools interactive.

pytest plugin for distributed testing and loop-on-failures testing modes.

PacketPy is an open-source solution for stress testing network devices using different testing methods

Load and performance benchmark tool

HTTP load generator, ApacheBench (ab) replacement, formerly known as rakyll/boom

Faker is a Python package that generates fake data for you.

Hypothesis is a powerful, flexible, and easy to use library for property-based testing.

Generic automation framework for acceptance testing and RPA