Repo 4 basic seminar §How to make human machine readable"

Related tags

Deep Learning how-to-make-human-machine-readable

Overview

WORK IN PROGRESS...

Notebooks from the Seminar:

Human Machine Readable < WS21/22

Introduction into programming

Georg Trogemann, Christian Heck, Mattis Kuhn, Ting Chun Liu

Basic Seminar Material/Sculpture/Code

Compact seminar 11 - 4 pm | 31.01.2022 until 11.02.2022

Online @ BigBlueButton

Experimental Informatics

Academy of Media Arts Cologne

Email: [email protected], [email protected], [email protected]

Description

The generation of text by means of deep neural nets (NLG) has spread rapidly. Among other things, text-based dialog systems such as chatbots, assistance systems (Alexa/Siri) or robot journalism are increasingly used in news portals, e-commerce and social media; wherever context-based, natural language or reader-friendly texts are to be generated from structured data. Deep writing techniques have also found their way into the arts and literature with the help of models such as ELMo (Embeddings from Language Models), BERT (Bidirectional Encoder Representations from Transformers) or GPT-2/3 (Generative Pre-Training Transformer).

The goal of the seminar is that at the end each student has produced (a) text based on one of the neural language models mentioned above. No matter if poem, prose, novella, essay, manifesto, shopping list or social bot.

The course is intended as a general introduction to programming. It will not only teach skills to generate texts, but also the basics of Python, a universal programming language that can be used to program images, PDFs or web applications. Furthermore, Python is the most widely used language in programming Artificial Intelligences, especially Deep Neural Nets.

We ask for registration at [email protected] until 20.09.2021. No prior knowledge of programming is required to participate in the basic seminar.

Course

Week 1 (31.1. - 4.2.)

Hands on Python

files
...

Week 2 (7.2. - 11.2.)

Hands on Markov Chains

link??? n_order_text_generation.ipynb < text generation from zero-order (pure random) via first-order (probability through quantity) and second-order (markov-chain based on one token) to n-order (markov chain based on n token)
link??? markov_simple.ipynb < a simple ready to use version of n-order markov chains based on n_order_text_generation.ipynb
link??? interactive_text_generation.ipynb < next word recommendation via markov chain
link??? markov_basic.ipynb < word-level markov chain
link??? markov_n-grams.ipynb < word-level markov chain based on n-grams
link??? dictionary_list.ipynb < dictionairies & lists...

Hands on RNN/LSTM's

link??? Text generation with LSTM < notebook

Hands on GPT-2/3

GPT-2

Copilot

AI-Dungeon

General Info

Executing the Notebooks:

You can run, execute and work on the following Notebooks here:

Folder in KHM-Cloud:

??Here?? you can find some material for the seminar

Anaconda & Jupyter Notebooks

Hands on Jupyter Notebooks

little-helpers-in-jupyter-notebooks.ipynb < Introduction to Jupyter Notebooks (general info, Installation & Help-Functions)

Hands on Markdown

Jupyter-Notebook: Markdown-basics.ipynb

Datasets

scraper_wikipedia.ipynb < extract text of specific wikipedia articles
scrape-load_textcorpora.ipynb < some basic examples and code-snippets to srape, load and walk through datasets
dataset-list.md < just some resources of datasets & archives

Cheat Sheets

Title	URL
Python Beginner Cheat Sheet	https://github.com/ehmatthes/pcc/releases/download/v1.0.0/beginners_python_cheat_sheet_pcc_all.pdf
Markdown Syntax	https://help.github.com/articles/basic-writing-and-formatting-syntax/
Jupyter Notebook	https://cheatography.com/weidadeyue/cheat-sheets/jupyter-notebook/pdf_bw/
Conda	https://docs.conda.io/projects/conda/en/latest/_downloads/843d9e0198f2a193a3484886fa28163c/conda-cheatsheet.pdf

StyleGAN-Human: A Data-Centric Odyssey of Human Generation

StyleGAN-Human: A Data-Centric Odyssey of Human Generation Abstract: Unconditional human image generation is an important task in vision and graphics,

762 Jan 8, 2023

Pytorch implementation of Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors

Make-A-Scene - PyTorch Pytorch implementation (inofficial) of Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors (https://arxiv.org/

259 Dec 28, 2022

This repo holds code for TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation

TransUNet This repo holds code for TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation Usage

1.4k Jan 4, 2023

Repo for CVPR2021 paper "QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information"

QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information by Masato Tamura, Hiroki Ohashi, and Tomoaki Yosh

105 Dec 23, 2022

Repo for "Event-Stream Representation for Human Gaits Identification Using Deep Neural Networks"

Summary This is the code for the paper Event-Stream Representation for Human Gaits Identification Using Deep Neural Networks by Yanxiang Wang, Xian Zh

54 Jan 3, 2023

This repo is official PyTorch implementation of MobileHumanPose: Toward real-time 3D human pose estimation in mobile devices(CVPRW 2021).

Github Code of "MobileHumanPose: Toward real-time 3D human pose estimation in mobile devices" Introduction This repo is official PyTorch implementatio

203 Jan 5, 2023

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

H2O H2O is an in-memory platform for distributed, scalable machine learning. H2O uses familiar interfaces like R, Python, Scala, Java, JSON and the Fl

6.1k Jan 5, 2023

In this work, we will implement some basic but important algorithm of machine learning step by step.

WoRkS continued English 中文 Français Probability Density Estimation-Non-Parametric Methods(概率密度估计-非参数方法) 1. Kernel / k-Nearest Neighborhood Density Est

1 Dec 30, 2021

BasicNeuralNetwork - This project looks over the basic structure of a neural network and how machine learning training algorithms work

BasicNeuralNetwork - This project looks over the basic structure of a neural network and how machine learning training algorithms work. For this project, I used the sigmoid function as an activation function along with stochastic gradient descent to adjust the weights and biases.

1 Jan 22, 2022