A comprehensive reference for all topics related to building and maintaining microservices

Overview

The-Microservices-Pandect

This pandect (πανδέκτης is Ancient Greek for encyclopedia) was created to help you find and understand almost anything related to Microservices that is available online.

Other Pandects from the series:

Essential-Reading

General Resources

Platforms

  • AWS - Amazon Web Services on-demand cloud computing platform
  • Azure - cloud computing service created by Microsoft
  • Google Cloud Platform - GCP - suite of cloud computing services from Google
  • OpenStack - free, open standard cloud computing platform
  • Digital Ocean - DigitalOcean provides developers with cloud services
  • Linode - cloud hosting company that provides virtual private servers

Stories from the Industry

Compilations & Resource Collections

Roadmaps

Podcasts

  • Cloudcast - independent Cloud Computing podcast [Years: 2011 - now, Status: active]
  • PodCTL - podcast focused on Cloud-native applications (by Red Hat) [Years: 2017 - now, Status: active]
  • Kubernetes Podcast - Kubernetes Podcast from Google [Years: 2018 - now, Status: active]
  • Data Engineering Podcast - Data management, microservices, ETL and more [Years: 2017 - now, Status: active]
  • The Secure Developer - A podcast about security for developers [Years: 2017 - now, Status: active]
  • APIs you won't hate - podcast about building and designing APIs [Years: 2019 - now, Status: active]

Youtube-Channels

  • Continuous Delivery - Continuous Delivery Pipelines and Processes [Youtube, 57k Subscribers]
  • CNCF - Cloud Native Computing Foundation - provides educational and informative content on cloud native computing [Youtube, 65k Subscribers]
  • Snyk - build cloud native applications securely [Youtube, 2k Subscribers]
  • CloudBeesTV - cloud conferences from the end-to-end automated software delivery company [Youtube, 9k Subscribers]
  • Containers from the Couch - learning resources on Container Services [Youtube, 4k Subscribers]
  • GOTO Conferences - GOTO is a software development content and events platform [Youtube, 230k Subscribers]

Observability

General Monitoring

Error Monitoring

Alerting

Logging

  • loki - horizontally-scalable, highly-available, multi-tenant log aggregation system [GitHub, 13077 stars]

Visualizing

  • grafana - observability and data visualization platform [GitHub, 42460 stars]

Deployment

General Deployment Tools

  • kubespray - Deploy a Production Ready Kubernetes Cluster [GitHub, 10705 stars]

Zero Downtime Deploys

Tools:
  • flagger - Canary, A/B Testing and Blue/Green deployments for Kubernetes [GitHub, 2950 stars]

CI/CD

General
  • Tekton - open-source framework for creating CI/CD systems
GitOps:
  • flux - The GitOps Kubernetes operator [GitHub, 6405 stars]
  • ArgoCD - A declarative, GitOps continuous delivery tool for Kubernetes

Cost-Optimization

General
AWS
  • Spot Fleet [AWS Services]
  • AutoSpotting - open source spot market automation tool for EC2 [GitHub, 1946 stars]
Autoscaling
  • keda - Kubernetes-based Event Driven Autoscaling [GitHub, 3284 stars]
General Tools
  • Komiser - Multi-cloud environment inspector for costs and security [GitHub, 2599 stars]
  • Infracost - Cloud cost estimates for Terraform in your CLI and pull requests [GitHub, 3135 stars]

Stateful-Workloads

Databases and Operators

General
  • OperatorHub.io - OperatorHub.io is a resource for the Kubernetes community to find and share Operators
In-memory
  • redis - Redis is an open source, in-memory data structure store
MySQL
  • MariaDB - MariaDB Server: The open source relational database
  • vitess - Canary, A/B Testing and Blue/Green deployments for Kubernetes [GitHub, 2950 stars]
PostgreSQL
OLAP - Online Analytical Processing
Object Storage
  • Ceph - implements object storage on a single distributed computer cluster

Serverless

General

Examples and Learning Resources

Tools & Frameworks

  • serverless - Serverless Framework using AWS Lambda, Azure Functions, Google CloudFunctions [GitHub, 39898 stars]
  • Chalice - Python Serverless Microframework for AWS [GitHub, 7972 stars]
  • OpenFaaS - Serverless Functions Made Simple [GitHub, 19866 stars]
  • Up - deploy infinitely scalable serverless apps, apis, and sites [GitHub, 8230 stars]
  • Dapr - portable, serverless, event-driven runtime for stateless and stateful microservices [GitHub, 13585 stars]
  • Nuclio - High-Performance Serverless event and data processing platform [GitHub, 3938 stars]

Security

General Tools

  • kubesploit - Cross-platform post-exploitation HTTP/2 Command & Control server [GitHub, 475 stars]
  • consul - Consul automates networking for simple and secure application delivery
  • Komiser - Multi-cloud environment inspector for costs and security [GitHub, 2599 stars]
  • tfsec - Security scanner for your Terraform code [GitHub, 2797 stars]

Security Audit Tools

  • kube-bench - Checks usage of security best practices as defined in the CIS Kubernetes Benchmark [GitHub, 3755 stars]
  • Prowler - security tool to perform AWS security best practices assessments [GitHub, 3478 stars]
  • ScoutSuite - Multi-Cloud Security Auditing Tool [GitHub, 3478 stars]

Secrets

  • sealed-secrets - A Kubernetes controller and tool for one-way encrypted Secrets [GitHub, 3490 stars]
  • Vault - Manage Secrets and Protect Sensitive Data
  • aws-vault - securely store and access AWS credentials in development environments [GitHub, 4960 stars]
  • SOPS: Secrets OPerationS - Simple and flexible tool for managing secrets on any platform [GitHub, 7611 stars]

Protocols

Auth, API Gateways etc.

  • Grant - OAuth Proxy [GitHub, 3339 stars]
  • Dex - OpenID Connect (OIDC) identity and OAuth 2.0 provider [GitHub, 5806 stars]
  • Kong - Cloud-Native API Gateway [GitHub, 29353 stars]
  • Gloo Edge - Kubernetes-native API Gateway Built on Envoy [GitHub, 2945 stars]

Other

  • Awesome WAF - Everything about web-application firewalls (WAF) [GitHub, 3598 stars]
  • PENTESTING-BIBLE - Learn ethical hacking [GitHub, 8200 stars]

Learning Resources

Kubernetes

AWS

Kafka

DevOps

  • DevOps Guide - from basic to advanced with Interview Questions and Notes [GitHub, 3680 stars]
  • DevOps Exercises - questions and exercises on technical topics related to DevOps and SRE [GitHub, 8531 stars]

Docker

  • Docker Curriculum - comprehensive tutorial on getting started with Docker [GitHub, 4244 stars]

Infrastructure as Code

Infrastructure as Code Tools

  • Terraform - open-source infrastructure as code software tool for consistent CLI workflow
  • CloudFormation - cloud provisioning with infrastructure as code for AWS
  • Azure Resource Manager - manage your app resources on Azure
  • Cloud Deployment Manager - create and manage cloud resources on GCP with simple templates
  • HashiCorp Vagrant / [GitHub, 22046 stars]
  • CFEngine - automate your infrastructure, security & compliance
  • Ansible - automation across open hybrid cloud deployments
  • CHEF - Policy-Based Configuration Management Automation Architecture
  • Pulumi - Modern Infrastructure as Code. Any cloud, any language [GitHub, 8896 stars]

Additional Tooling

  • Terraformer - CLI tool to generate terraform files from existing infrastructure (reverse Terraform) [GitHub, 4962 stars]
  • Checkov - static code analysis tool for infrastructure-as-code [GitHub, 2775 stars]

Examples and Learning Resources

Other

Streaming Frameworks / Engines

Effective Containerization

  • distroless - Language focused docker images, minus the operating system [GitHub, 9770 stars]

Testing

  • Terratest - Go library to write automated tests for your infrastructure code [GitHub, 5289 stars]
  • Serverless Offline - Emulate AWS λ and API Gateway locally [GitHub, 4131 stars]
  • Moto - easily mock out tests based on AWS infrastructure [GitHub, 4682 stars]
  • LocalStack - fully functional local AWS cloud stack [GitHub, 4682 stars]

PaaS - Platform-as-a-service

  • Empire - PaaS built on top of Amazon EC2 Container Service with Heroku like workflow [GitHub, 2644 stars]

Container Network Interface (CNI)

  • CNI - networking for Linux containers [GitHub, 3524 stars]

Kafka

  • strimzi - Apache Kafka running on Kubernetes [GitHub, 2434 stars]

License CC0

Attributions

Resources

  • All linked resources belong to original authors

Icons

Fonts

Owner
Ivan Bilan
Engineering Manager @trustyou. Technical areas of interest: Machine and Deep Learning for NLP, Microservices and Big Data
Ivan Bilan
Serverless Python

Zappa - Serverless Python About Installation and Configuration Running the Initial Setup / Settings Basic Usage Initial Deployments Updates Rollback S

Rich Jones 11.8k Oct 22, 2021
Serverless Python

Zappa - Serverless Python About Installation and Configuration Running the Initial Setup / Settings Basic Usage Initial Deployments Updates Rollback S

Rich Jones 11.7k Feb 17, 2021
Swagger/OpenAPI First framework for Python on top of Flask with automatic endpoint validation & OAuth2 support

Connexion Connexion is a framework that automagically handles HTTP requests based on OpenAPI Specification (formerly known as Swagger Spec) of your AP

Zalando SE 3.8k Oct 22, 2021
Swagger/OpenAPI First framework for Python on top of Flask with automatic endpoint validation & OAuth2 support

Connexion Connexion is a framework that automagically handles HTTP requests based on OpenAPI Specification (formerly known as Swagger Spec) of your AP

Zalando SE 3.5k Feb 17, 2021
The no-nonsense, minimalist REST and app backend framework for Python developers, with a focus on reliability, correctness, and performance at scale.

The Falcon Web Framework Falcon is a reliable, high-performance Python web framework for building large-scale app backends and microservices. It encou

Falconry 8.6k Oct 21, 2021
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.

Read Latest Documentation - Browse GitHub Code Repository hug aims to make developing Python driven APIs as simple as possible, but no simpler. As a r

Hug API Framework 6.6k Oct 18, 2021
NO LONGER MAINTAINED - A Flask extension for creating simple ReSTful JSON APIs from SQLAlchemy models.

NO LONGER MAINTAINED This repository is no longer maintained due to lack of time. You might check out the fork https://github.com/mrevutskyi/flask-res

null 1k Oct 20, 2021
NO LONGER MAINTAINED - A Flask extension for creating simple ReSTful JSON APIs from SQLAlchemy models.

NO LONGER MAINTAINED This repository is no longer maintained due to lack of time. You might check out the fork https://github.com/mrevutskyi/flask-res

null 1k Jan 15, 2021
Web APIs for Django. 🎸

Django REST framework Awesome web-browsable Web APIs. Full documentation for the project is available at https://www.django-rest-framework.org/. Fundi

Encode 22k Oct 15, 2021
A familiar HTTP Service Framework for Python.

Responder: a familiar HTTP Service Framework for Python Powered by Starlette. That async declaration is optional. View documentation. This gets you a

Taoufik 3.6k Oct 15, 2021
Sierra is a lightweight Python framework for building and integrating web applications

A lightweight Python framework for building and Integrating Web Applications. Sierra is a Python3 library for building and integrating web applications with HTML and CSS using simple enough syntax. You can develop your web applications with Python, taking advantage of its functionalities and integrating them to the fullest.

null 74 Oct 8, 2021
The comprehensive WSGI web application library.

Werkzeug werkzeug German noun: "tool". Etymology: werk ("work"), zeug ("stuff") Werkzeug is a comprehensive WSGI web application library. It began as

The Pallets Projects 5.9k Oct 15, 2021
Phoenix LiveView but for Django

Reactor, a LiveView library for Django Reactor enables you to do something similar to Phoenix framework LiveView using Django Channels. What's in the

Eddy Ernesto del Valle Pino 349 Oct 13, 2021
An abstract and extensible framework in python for building client SDKs and CLI tools for a RESTful API.

django-rest-client An abstract and extensible framework in python for building client SDKs and CLI tools for a RESTful API. Suitable for APIs made wit

Certego 2 Oct 22, 2021
The Web framework for perfectionists with deadlines.

Django Django is a high-level Python Web framework that encourages rapid development and clean, pragmatic design. Thanks for checking it out. All docu

Django 60.3k Oct 22, 2021
FastAPI framework, high performance, easy to learn, fast to code, ready for production

FastAPI framework, high performance, easy to learn, fast to code, ready for production Documentation: https://fastapi.tiangolo.com Source Code: https:

Sebastián Ramírez 37.2k Oct 23, 2021
The Modern And Developer Centric Python Web Framework. Be sure to read the documentation and join the Slack channel questions: http://slack.masoniteproject.com

NOTE: Masonite 2.3 is no longer compatible with the masonite-cli tool. Please uninstall that by running pip uninstall masonite-cli. If you do not unin

Masonite 1.7k Oct 23, 2021
easyopt is a super simple yet super powerful optuna-based Hyperparameters Optimization Framework that requires no coding.

easyopt is a super simple yet super powerful optuna-based Hyperparameters Optimization Framework that requires no coding.

Federico Galatolo 9 Sep 22, 2021
Daniel Vaz Gaspar 3.5k Oct 22, 2021