Project issue to website data transformation toolkit

Related tags

Miscellaneous braintransform
Overview

braintransform

Build Status

Project issue to website data transformation toolkit.

Introduction

The purpose of these scripts is to be able to dynamically generate the project pages used by the Brainhack Global website. Given a GitHub issues URL, the scripts/transform_issues_to_pages.py script obtains the list of issues, filters those that correspond to projects, and scrapes the relevant data to generate project Markdown files that are written to an output folder. These files can then be processed by the Brainhack Global website generator framework to fill the contents of the project page.

The automation of the project page generation can be seen in the .github/workflows/issue-to-page.yml GitHub workflow of the Brainhack Global 2021 repository.

This tool was introduced for the Brainhack Global 2020, and was refactored and moved into a separate repository for the Brainhack Global 2021.

Comments
  • ENH: Install `flake8` for development

    ENH: Install `flake8` for development

    Install flake8 for development.

    Fixes

    /home/runner/work/_temp/ce560110-851d-4e53-92fc-94953f39c780.sh: line 3: flake8: command not found

    raised in: https://github.com/brainhackorg/braintransform/runs/5175981961?check_suite_focus=true#step:5:110

    Take advantage of the commit to:

    • Use the previously required package version.
    • Remove the docstring checking package as it was not previously present.
    opened by jhlegarreta 0
  • ENH: Remove unnecessary workflow steps

    ENH: Remove unnecessary workflow steps

    Remove unnecessary workflow steps:

    • Remove the unnecessary minimal version step: no required packages have a greater than or equal to version specification. This also avoids the weak substitution of the sign to make the workflow fail because a different Python version is being required, i.e.:
    ERROR: Package 'braintransform' requires a different Python: 3.8.12 not in '==3.8'

    in https://github.com/brainhackorg/braintransform/runs/5175935193?check_suite_focus=true#step:7:58

    • Remove caching the pip installation: this might be useful when the number of required packages is large. It also avoids needing to specify a file for the hash (requirements.txt no longer exists).
    opened by jhlegarreta 0
  • BUG: Fix required Python version in package setup

    BUG: Fix required Python version in package setup

    Fix required Python version in package setup.

    Fixes:

    ERROR: Package 'braintransform' requires a different Python: 3.8.12 not in '==3.6'

    raised in: https://github.com/brainhackorg/braintransform/runs/5175901365?check_suite_focus=true#step:7:58

    opened by jhlegarreta 0
  • ENH: Modernize package setup

    ENH: Modernize package setup

    Modernize package setup:

    • Adopt PEP518 to specify minimum build system requirements for the package. Documentation: https://www.python.org/dev/peps/pep-0518/

    • Transition to setuptools_scm versioning system:

      • Host package static metadata in setup.cfg.
      • Host package dependiencies in setup.cfg.

    Allows to reduce the number of files containing package configuration data:

    • Requirements are directly hosted in setup.cfg and thus requirements*.txt files are no longer necessary.
    • Project-specific info.py and setup_helpers.py scripts are no longer necessary.
    • The script setup.py is no longer necessary: pyproject.toml and setup.cfg contain the necessary information for the package set up.

    Change the package testing worfklow accordingly.

    Add the automatically generated version file to .gitignore.

    opened by jhlegarreta 0
  • BUG: Remove `scripts/__init__.py` file

    BUG: Remove `scripts/__init__.py` file

    Remove scripts/__init__.py file.

    Prevents a failure when building the package through a requirements file, i.e.

    pip install -r requirements.txt

    containing

    git+https://github.com/brainhackorg/braintransform@main

    Fixes:

        warning: build_scripts: scripts/__init__.py is an empty file (skipping)

    copying and adjusting scripts/transform_issues_to_pages.py -> build/scripts-3.8
    error: [Errno 2] No such file or directory: 'build/scripts-3.8/__init__.py'
    opened by jhlegarreta 0
  • Add issue template?

    Add issue template?

    This is really not urgent but it might be good to add some of the issue template (yml and or markdow) to the repo so that it gives an easy way to set this up for other repos.

    More as some sort of documentation than as test data.

    opened by Remi-Gau 0
Owner
Brainhack
Brainhack
GitHub
Tool for running a high throughput data ingestion/transformation workload with MongoDB

Mongo Mangler The mongo-mangler tool is a lightweight Python utility, which you can run from a low-powered machine to execute a high throughput data i

Paul Done 9 Jan 2, 2023
Purge all transformation orientations addon for Blender 2.8 and newer versions

CTO Purge This add-on adds a new button to Blender's Transformation Orientation panel which empowers the user to purge all of his/her custom transform

MMMrqs 10 Dec 29, 2022
Simple application that does transformation with HPF and LPFs.

Simple application that applies Butterworth, Gaussian & Ideal kernels on HPF and LPFs -aka Frequency Domain Filtering- Upload image from sidebar, set

Merve Noyan 3 Jul 6, 2022
Doom o’clock is a website/project that features a countdown of “when will the earth end” and a greenhouse gas effect emission prediction that’s predicted

Doom o’clock is a website/project that features a countdown of “when will the earth end” and a greenhouse gas effect emission prediction that’s predicted

shironeko(Hazel) 4 Jan 1, 2022
Process RunGap output file of a workout and load data into Apple Numbers Spreadsheet and my website with API calls

BSD 3-Clause License Copyright (c) 2020, Mike Bromberek All rights reserved. ProcessWorkout Exercise data is exported in JSON format to iCloud using

Mike Bromberek 1 Jan 3, 2022
Council Data Project is an open-source project dedicated to providing journalists, activists, researchers, and all members of each community we serve with the tools they need to stay informed and hold their Council Members accountable.

CDP - Self Council Data Project Council Data Project is an open-source project dedicated to providing journalists, activists, researchers, and all mem

null 1 May 12, 2022
An OpenSource crowd-sourced cooking recipes website

An OpenSource crowd-sourced cooking recipes website

null 21 Jul 31, 2022
Checks for Vaccine Availability at your district and notifies you using E-mail, subscribe to our website.

Vaccine Availability Notifier Project Description Checks for Vaccine Availability at your district and notifies you using E-mail every 10 mins. Kindly

Farhan Hai Khan 19 Jun 3, 2021
Find the remote website version based on a git repository

versionshaker Versionshaker is a tool to find a remote website version based on a git repository This tool will help you to find the website version o

Orange Cyberdefense 110 Oct 23, 2022
A free website that keeps the people informed about housing and evictions.

Eviction Tracker Currently helping verify detainer warrant data for middle Tennessee - via Middle TN DSA - Red Door Collective Features Presents data

Red Door Collective 7 Dec 14, 2022
A website to collect vintage 4 tracks cassette recorders.

Vintage 4tk cassette recorders A website to collect vintage 4 tracks cassette recorders. Local development setup Copy and customize Django settings (e

null 1 May 1, 2022
Developed a website to analyze and generate report of students based on the curriculum that represents student’s academic performance.

Developed a website to analyze and generate report of students based on the curriculum that represents student’s academic performance. We have developed the system such that, it will automatically parse data onto the database from excel file, which will in return reduce time consumption of analysis of data.

VIJETA CHAVHAN 3 Nov 8, 2022
Tool to automate the enumeration of a website (CTF)

had4ctf Tool to automate the enumeration of a website (CTF) DISCLAIMER: THE TOOL HAS BEEN DEVELOPED SOLELY FOR EDUCATIONAL PURPOSE ,I WILL NOT BE LIAB

Had 2 Oct 24, 2021
Bring A Trailer(BAT) is a popular online auction website for enthusiast cars. This traverse auction results and saves them as CSV

BaT Data Grabber Bring A Trailer(BAT) is a popular online auction website for enthusiast cars. This traverse auction results and saves them as CSV Bri

Elliot Weil 2 Oct 31, 2021
WriteAIr is a website which allows users to stream their writing.

WriteAIr is a website which allows users to stream their writing. It uses HSV masking to detect a pen which the user writes with. Plus, users can select a wide range of options through hand gestures! The notes created can then be saved as images and uploaded on the server.

Atharva Patil 1 Nov 1, 2021
Youtube Channel Website

Videos-By-Sanjeevi Youtube Channel Website YouTube Channel Website Features: Free Hosting using GitHub Pages and open-source code base in GitHub. It c

Sanjeevi Subramani 5 Mar 26, 2022
This is the accompanying repository for the Bloomberg Global Coal Countdown website.

This is the accompanying repository for the Bloomberg Global Coal Countdown (BGCC) website. Data Sources Dashboard Data Schema and Validation License

null 7 Jun 1, 2022
Chess bot can play automatically as white or black on lichess.com, chess.com and any website using drag and drop to move pieces

Chessbot "Why create another chessbot ?" The explanation is simple : I did not find a free bot I liked online : all the bots I saw on internet are par

Dhimas Bagus Prayoga 2 Nov 11, 2021
Nick Craig-Wood's Website

Nick Craig-Wood's public website This directory tree is used to build all the different docs for Nick Craig-Wood's website. The content here is (c) Ni

Nick Craig-Wood 2 Sep 2, 2022