A curated list of awesome tools for SQLAlchemy

Overview

Awesome SQLAlchemy

A curated list of awesome extra libraries and resources for SQLAlchemy. Inspired by awesome-python. (See also other awesome lists!)

Licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Data Structures

SQLAlchemy-Continuum

Versioning and auditing extension for SQLAlchemy.

  • Creates versions for inserts, deletes and updates.
  • Does not store updates which don't change anything.
  • Supports alembic migrations.
  • Can revert objects data as well as all object relations at given transaction even if the object was deleted.
  • Transactions can be queried afterwards using SQLAlchemy query syntax.
  • Query for changed records at given transaction.
  • Temporal relationship reflection. Version object's relationship show the parent objects relationships as they where in that point in time.
  • Supports native versioning for PostgreSQL database (trigger based versioning).
sqlalchemy_mptt
Library for implementing MPTT (modified preorder tree traversal) with SQLAlchemy models and working with trees of model instances, like django-mptt.
SQLAlchemy-ORM-tree
An implementation for SQLAlchemy-based applications of the nested-sets/modified-pre-order-tree-traversal technique for storing hierarchical data in a relational database.
vdm
Versioned domain model. Python library for revisioning/versioning of databases.

Data Types

SQLAlchemy-Enum34
SQLAlchemy type to store standard enum.Enum values.
SQLAlchemy-Utc
SQLAlchemy type to store aware datetime.datetime values.
SQLAlchemy-Utils

Various utility functions, new data types and helpers for SQLAlchemy

  • Listeners
  • Data types: {..., ChoiceType, CountryType, JSONType, URLType, UUIDType, ...}
  • Range data types
  • Aggregated attributes
  • Generates decorator
  • Generic relationships
  • Database helpers: create_database, drop_database
  • Foreign key helpers
  • ORM helpers
  • Utility classes
  • Model mixins: Timestamp (created, updated times)

Database Migration Tools

Alembic
Alembic is a lightweight database migration tool for usage with the SQLAlchemy Database Toolkit for Python.
sqlalchemy-migrate
Inspired by Ruby on Rails' migrations, SQLAlchemy Migrate provides a way to deal with database schema changes in SQLAlchemy projects.

Dialects

https://docs.sqlalchemy.org/en/latest/dialects/

redshift_sqlalchemy
Amazon Redshift dialect for SQLAlchemy.
sphinxalchemy
SQLAlchemy dialect for iterfacing with Sphinx (search engine) via SphinxQL.
GINO
An asynchronous PostgreSQL dialect for asyncpg, providing SQLAlchemy core support and its own asynchronous ORM interface.

Documentation

File and Image Attachments

filedepot
DEPOT is a framework for easily storing and serving files in web applications. Depot features simple integration with SQLAlchemy by providing customized model field types for storing files attached to your ORM document.
SQLAlchemy-ImageAttach
SQLAlchemy-ImageAttach is a SQLAlchemy extension for attaching images to entity objects.
sqlalchemy-media
Based on SQLAlchemy-ImageAttach but using JSON type instead of relation, and SqlAlchemy's mutable facility, Also supports multiple stores per context.

Forms and Data Validations

ColanderAlchemy

ColanderAlchemy helps you to auto-generate Colander schemas that are based on SQLAlchemy mapped classes.

Such Colander schemas can be used with libraries like Deform and helps remove the need for duplication of schema definitions.

Flask-Validator
Data validator for Flask and SQL-Alchemy, working at Model component with events, preventing invalid data in the columns. The extension works with event listeners from SQLAlchemy.
FormAlchemy
FormAlchemy eliminates boilerplate by autogenerating HTML input fields from a given model. FormAlchemy will try to figure out what kind of HTML code should be returned by introspecting the model's properties and generate ready-to-use HTML code that will fit the developer's application.
WTForms-Alchemy
WTForms-Alchemy is a WTForms extension toolkit for easier creation of model based forms. Strongly influenced by Django ModelForm.
Sprox
Sprox provides an easy way to create forms for web content which are: automatically generated, easy to customize, and validated. Sprox also has powerful tools to help you display your content the way you want to with table and record viewers. Sprox provides a way to fill your widgets, whether they are forms or other content with customizable data.

Full-text Searching

SQLAlchemy-Searchable
Full-text searchable models for SQLAlchemy. Only supports PostgreSQL.
SQLAlchemy-FullText-Search
Fulltext search support with MySQL & SQLAlchemy.

GIS and Spatial Databases

GeoAlchemy

GeoAlchemy provides extensions to SQLAlchemy to work with spatial databases.

The current supported spatial database systems are PostGIS, Spatialite, MySQL, Oracle, and MS SQL Server 2008.

GeoAlchemy 2

GeoAlchemy 2 provides extensions to SQLAlchemy for working with spatial databases.

GeoAlchemy 2 focuses on PostGIS. PostGIS 1.5 and PostGIS 2 are supported. Spatialite is also supported, but using GeoAlchemy 2 with Spatialite requires some specific configuration on the application side.

GeoAlchemy 2 aims to be simpler than its predecessor, GeoAlchemy. Simpler to use, and simpler to maintain.

Internationalizations

SQLAlchemy-i18n

Internationalization extension for SQLAlchemy models.

  • Stores translations in separate tables.
  • Reflects translation table structures based on parent model table structure.
  • Supports forcing of given locale.
  • Good performance (uses proxy dicts and other advanced SQLAlchemy concepts for performance optimization).

Profilers

flask_debugtoolbar
Debug toolbar with SQLAlchemy query information for Flask.
pyramid_debugtoolbar
Debug toolbar with SQLAlchemy query information for Pyramid.
SQLTap

SQLTap is a library that allows you to profile and introspect the queries that your application makes using SQLAlchemy.

SQLTap helps you understand:

  • how many times a sql query is executed
  • how much time your sql queries take
  • where your application is issuing sql queries from
nplusone

Auto-detect the n+1 queries problem in SQLAlchemy (and other Python ORMs)

nplusone detects unnecessary queries caused by lazy loading and unused eager loading. Integrates with Flask-SQLAlchemy.

Query helpers

sqlakeyset

This library implements keyset-based paging for SQLAlchemy (both ORM and core).

This library has been tested with PostgreSQL and MariaDB/MySQL. It should work with other SQLAlchemy-supported databases to provided they support row( syntax.

Recipes

Serialization and deserialization

marshmallow-sqlalchemy
SQLAlchemy integration with the marshmallow (de)serialization library.
sqlalchemy-dict
SQLAlchemy extension for interacting models with python dictionary.

Testing

charlatan
Fixtures management for SQLAlchemy and other systems.
factory_boy
Generate fake data and create random fixtures for testing in SQLAlchemy and many other Python ORM systems.
mixer
Generate fake data and create random fixtures for testing in SQLAlchemy and many other Python ORM systems.

Thin Abstractions

Dataset
Easy-to-use data handling for SQL data stores in Python with support for implicit table creation, bulk loading, and transaction. Dataset also includes support for freezing data to CSV and JSON flat files.
rdflib-sqlalchemy
RDFLib store using SQLAlchemy dbapi as back-end.
SQLSoup
SQLSoup provides a convenient way to map Python objects to relational database tables, with no declarative code of any kind. It's built on top of the SQLAlchemy ORM and provides a super-minimalistic interface to an existing database.

Vendor-specific Extensions

PostgreSQL

Flask-SQLAlchemy-PGEvents
Flask extension that uses SQLAlchemy and psycopg2-pgevents to enable event listeners tied into database-layer triggers.
sqlalchemy-crosstab-postgresql
New grammar for SQLAlchemy to make handling the crosstab() tablefunc (i.e. pivot tables) in PostgreSQL easy peasy.
sqlalchemy-postgres-copy
Wrapper for using PostgreSQL COPY with SQLAlchemy for efficient bulk data imports and exports.

Visualizations

sadisplay
Simple package for describing SQLAlchemy schema and display raw database tables by reflecting feature.
sqlalchemy_schemadisplay
This module generates images from SQLAlchemy models.
eralchemy
ERAlchemy generates Entity Relation (ER) diagram from databases or from SQLAlchemy models.

Web

Framework Integrations

bottle-sqlalchemy
A Bottle plugin to manage SQLAlchemy session to your application.
filteralchemy
Declarative query builder that auto-generates filter parameters from models and parses request parameters using marshmallow-sqlalchemy and webargs.
Flask-SQLAlchemy
Flask-SQLAlchemy is an extension for Flask that adds support for SQLAlchemy to your application.
Flask-Admin
The admin interface framework for Flask. With scaffolding for SQLAlchemy, MongoEngine, pymongo and Peewee.
pyramid_sqlalchemy
pyramid_sqlalchemy provides everything needed to use SQLAlchemy in Pyramid applications.
pyramid_restler
pyramid_restler is a somewhat-opinionated toolkit for building RESTful Web services and applications on top of the Pyramid framework (with SQLAlchemy models).
sacrud
SACRUD will solve your problem of CRUD interface for SQLAlchemy, by providing extension for Pyramid (yet) or use it in pure form. Unlike classical CRUD interface, pyramid_sacrud allows override and flexibly customize interface (that is closer to django.contrib.admin).
SQLA-wrapper

A light and framework-independent wrapper for SQLAlchemy that makes it really easy to setup and use.

  • Doesn't change the SQLAlchemy syntax.
  • Can paginate the results of the queries.
  • Support for muliple databases at the same time.
zope.sqlalchemy
The aim of this package is to unify the plethora of existing packages integrating SQLAlchemy with Zope's transaction management. As such it seeks only to provide a data manager and makes no attempt to define a zopeish way to configure engines.

Other

paginate_sqlalchemy
This module helps dividing large lists of items into pages. The user is shown one page at a time and can navigate to other pages.
sandman2
Generate a curl-able REST HTTP API with searching and filtering for all tables in a database and an admin UI with Flask-SQLAlchemy and HTTP Basic Authentication.
sqlalchemy_mixins
A set of well-tested mixins that brings Active Record, Django-like queries, nested eager load and beauty __repr__ to your SQLAlchemy.
Comments
  • Validate pull requests with Travis

    Validate pull requests with Travis

    Hello, I wrote a tool that can validate README links (valid URLs, not duplicate). It can be run when someone submits a pull request.

    It is currently being used by

    • https://github.com/vsouza/awesome-ios
    • https://github.com/matteocrippa/awesome-swift
    • https://github.com/dkhamsing/open-source-ios-apps

    Examples

    • https://travis-ci.org/matteocrippa/awesome-swift/builds/96526196 ok ✅
    • https://travis-ci.org/matteocrippa/awesome-swift/builds/96722421 link redirected / rename 🔴
    • https://travis-ci.org/dkhamsing/open-source-ios-apps/builds/96763135 bad link / project deleted 🔴
    • https://travis-ci.org/dkhamsing/open-source-ios-apps/builds/95754715 dupe 🔴

    If you are interested, connect this repo to https://travis-ci.org/ and add a .travis.yml file to the project.

    See https://github.com/dkhamsing/awesome_bot for options, more information Feel free to leave a comment :smile:

    opened by awesome-bot 1
  • SQLAlchemy-Wrapper

    SQLAlchemy-Wrapper

    Awesome list. Can i suggest one more item? SQLAlchemy-Wrapper https://github.com/lucuma/sqlalchemy-wrapper is light wrapper, similar to Flask-SQLAlchemy but independent of any specific web framework. It doesn't hide SQLAlchemy but make it easier to get started with it.

    opened by ghost 1
  • Update README URLs based on HTTP redirects

    Update README URLs based on HTTP redirects

    Created with https://github.com/dkhamsing/frankenstein

    GitHub Corrected URLs

    | Was | Now | | --- | --- | | https://github.com/rbarrois/factory_boy | https://github.com/FactoryBoy/factory_boy |

    HTTPS Corrected URLs

    | Was | Now | | --- | --- | | http://creativecommons.org/licenses/by-sa/4.0/ | https://creativecommons.org/licenses/by-sa/4.0/ |

    opened by ReadmeCritic 0
  • SQLAlchemy-file

    SQLAlchemy-file

    SQLAlchemy-file is a SQLAlchemy extension for attaching files to SQLAlchemy model and uploading them to various storage such as Amazon S3, Rackspace CloudFiles, Google Storage and others using Apache Libcloud.

    https://github.com/jowilf/sqlalchemy-file

    opened by jowilf 0
  • docs: Fix a few typos

    docs: Fix a few typos

    There are small typos in:

    • README.rst

    Fixes:

    • Should read multiple rather than muliple.
    • Should read interfacing rather than iterfacing.

    Semi-automated pull request generated by https://github.com/timgates42/meticulous/blob/master/docs/NOTE.md

    opened by timgates42 0
  • FastAlchemy - Testing and Prototyping tool

    FastAlchemy - Testing and Prototyping tool

    Hi,

    I'm the author of https://github.com/maarten-dp/fast-alchemy which is a tool to create SQLA models and instances using YAML.

    Its main goals are:

    • Building fast testcases for libraries that build on, or extend, SQLA, but don't necessarily have a fixed model implementation.
    • Preventing hundreds of lines of test models clutter in your testfiles.
    • Building and instantiating models that cater to your specific usecases, instead of forcing you to "work with what you have"
    • Being a good prototyping tool for PoCs, as datamodels are often subject to a lot of change in these projects.

    I'm not sure where you draw the line between nice libraries and useful libraries. Hence me opening this issue to ask for your feedback. I'd be honored to have FastAlchemy included in this list, but understand and accept if it doesn't fit the scope.

    Thanks for your time.

    Kind regards, Maarten

    opened by maarten-dp 0
Owner
Hong Minhee (洪 民憙)
A software engineer from Seoul. An advocate of F/OSS, Open Web, and Cypherpunk. Hack into East Asian languages.
Hong Minhee (洪 民憙)
Adds SQLAlchemy support to Flask

Flask-SQLAlchemy Flask-SQLAlchemy is an extension for Flask that adds support for SQLAlchemy to your application. It aims to simplify using SQLAlchemy

The Pallets Projects 3.9k Jan 9, 2023
SQLAlchemy support for aiohttp.

aiohttp-sqlalchemy SQLAlchemy 1.4 / 2.0 support for AIOHTTP. The library provides the next features: initializing asynchronous sessions through a midd

Ruslan Ilyasovich Gilfanov 5 Dec 11, 2022
Global base classes for Pyramid SQLAlchemy applications.

pyramid_basemodel pyramid_basemodel is a thin, low level package that provides an SQLAlchemy declarative Base and a thread local scoped Session that c

Grzegorz Śliwiński 15 Jan 3, 2023
Sqlalchemy seeder that supports nested relationships.

sqlalchemyseed Sqlalchemy seeder that supports nested relationships. Supported file types json yaml csv Installation Default installation pip install

Jedy Matt Tabasco 10 Aug 13, 2022
A curated list of awesome tools for Sphinx Python Documentation Generator

Awesome Sphinx (Python Documentation Generator) A curated list of awesome extra libraries, software and resources for Sphinx (Python Documentation Gen

Hyunjun Kim 831 Dec 27, 2022
🔬 A curated list of awesome machine learning strategies & tools in financial market.

?? A curated list of awesome machine learning strategies & tools in financial market.

GeorgeZou 1.6k Dec 30, 2022
A curated list of awesome DataOps tools

Awesome DataOps A curated list of awesome DataOps tools. Awesome DataOps Data Catalog Data Exploration Data Ingestion Data Lake Data Processing Data Q

Kelvin S. do Prado 40 Dec 23, 2022
A curated list of awesome Python asyncio frameworks, libraries, software and resources

Awesome asyncio A carefully curated list of awesome Python asyncio frameworks, libraries, software and resources. The Python asyncio module introduced

Timo Furrer 3.8k Jan 8, 2023
A curated list of awesome Dash (plotly) resources

Awesome Dash A curated list of awesome Dash (plotly) resources Dash is a productive Python framework for building web applications. Written on top of

Luke Singham 1.7k Dec 26, 2022
A curated list of awesome Jupyter projects, libraries and resources

Awesome Jupyter A curated list of awesome Jupyter projects, libraries and resources. Jupyter is an open-source web application that allows you to crea

Markus Schanta 3.1k Dec 30, 2022
A curated list of awesome synthetic data for text location and recognition

awesome-SynthText A curated list of awesome synthetic data for text location and recognition and OCR datasets. Text location SynthText SynthText_Chine

Tianzhong 283 Jan 5, 2023
A curated list of awesome things related to Pydantic! 🌪️

Awesome Pydantic A curated list of awesome things related to Pydantic. These packages have not been vetted or approved by the pydantic team. Feel free

Marcelo Trylesinski 186 Jan 5, 2023
A curated list of awesome packages, articles, and other cool resources from the Wagtail community.

Awesome Wagtail A curated list of awesome packages, articles, and other cool resources from the Wagtail community. Wagtail is a Python CMS powered by

Springload 1.7k Jan 3, 2023
A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.

A curated list of awesome resources related to Semantic Search?? and Semantic Similarity tasks.

null 224 Jan 4, 2023
A curated list of amazingly awesome Cybersecurity datasets

A curated list of amazingly awesome Cybersecurity datasets

null 758 Dec 28, 2022
A curated list of awesome mathematics resources

A curated list of awesome mathematics resources

Cyrille Rossant 6.7k Jan 5, 2023
A curated list of awesome things related to Textual

Awesome Textual | A curated list of awesome things related to Textual. Textual is a TUI (Text User Interface) framework for Python inspired by modern

Marcelo Trylesinski 5 May 8, 2022
A curated list of FOSS tools to improve the Hacker News experience

Awesome-Hackernews Hacker News is a social news website focusing on computer technologies, hacking and startups. It promotes any content likely to "gr

Bryton Lacquement 141 Dec 27, 2022
An ongoing curated list of OS X best applications, libraries, frameworks and tools to help developers set up their macOS Laptop.

macOS Development Setup Welcome to MacOS Local Development & Setup. An ongoing curated list of OS X best applications, libraries, frameworks and tools

Paul Veillard 3 Apr 3, 2022
PEP-484 typing stubs for SQLAlchemy 1.4 and SQLAlchemy 2.0

SQLAlchemy 2 Stubs These are PEP-484 typing stubs for SQLAlchemy 1.4 and 2.0. They are released concurrently along with a Mypy extension which is desi

SQLAlchemy 139 Dec 30, 2022