Outreachy TFX custom component project

Overview

Schema Curation Custom Component

Outreachy TFX custom component project

This repo contains the code for Schema Curation Custom Component made as a part of TFX-Addons through the Outreachy program. You may view the linked Pull Request in TFX-Addons here and the issue here for relevant discussions related to the project.

The Team:

Mentors:

  • Robert Crowe
  • Thea Lamkin
  • Josh Gordon

Interns:

Comments
  • Working example added

    Working example added

    Added two examples demonstrating the use of schema curation component.

    1. taxi_example_local.py (to run locally)
    2. taxi_example_colab.ipynb (to run on colab)

    closes #11

    opened by Nirzu97 0
  • defining input and output basics

    defining input and output basics

    Added a basic working according to our component. Currently, It accepts a schema and returns it without changes. The component.py , executor.py and component_test.py files have been changed accordingly.

    opened by pratishtha-abrol 0
  • Executor class : Create the Do function

    Executor class : Create the Do function

    Has to be a subclass of base_executor.BaseExecutor (ref. https://www.tensorflow.org/tfx/api_docs/python/tfx/dsl/components/base/base_executor/BaseExecutor), created with its Do function overridden.

    opened by pratishtha-abrol 0
  • Added boilerplate code from Hello World example

    Added boilerplate code from Hello World example

    Closes #2 To merge the following changes into main:

    • Boilerplate code
    • README.md with project overview and instructions to setup etc.
    • CONTRIBUTING.md with contributing guidelines
    • PROPOSAL.md with the project proposal
    opened by deutranium 0
  • Add black configuration for consistent formatting

    Add black configuration for consistent formatting

    Adding black would ensure that the same formatting in terms of spaces etc. is followed by every contributor. It would also make sure that the code is following PEP 8 style guidelines for python

    enhancement 
    opened by deutranium 0
Owner
Robert Crowe
I'm a TensorFlow Developer Advocate at Google, focused on TensorFlow Extended (TFX). I'm also a recovering data scientist.
Robert Crowe
Pre-training BERT masked language models with custom vocabulary

Pre-training BERT Masked Language Models (MLM) This repository contains the method to pre-train a BERT model using custom vocabulary. It was used to p

Stella Douka 14 Nov 2, 2022
Generate custom detailed survey paper with topic clustered sections and proper citations, from just a single query in just under 30 mins !!

Auto-Research A no-code utility to generate a detailed well-cited survey with topic clustered sections (draft paper format) and other interesting arti

Sidharth Pal 20 Dec 14, 2022
MiCECo - Misskey Custom Emoji Counter

MiCECo Misskey Custom Emoji Counter Introduction This little script counts custo

null 7 Dec 25, 2022
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

Texar is a toolkit aiming to support a broad set of machine learning, especially natural language processing and text generation tasks. Texar provides

ASYML 2.3k Jan 7, 2023
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

Texar is a toolkit aiming to support a broad set of machine learning, especially natural language processing and text generation tasks. Texar provides

ASYML 2.1k Feb 17, 2021
Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

Texar-PyTorch is a toolkit aiming to support a broad set of machine learning, especially natural language processing and text generation tasks. Texar

ASYML 726 Dec 30, 2022
Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

GPT2-NewsTitle 带有超详细注释的GPT2新闻标题生成项目 UpDate 01.02.2021 从网上收集数据,将清华新闻数据、搜狗新闻数据等新闻数据集,以及开源的一些摘要数据进行整理清洗,构建一个较完善的中文摘要数据集。 数据集清洗时,仅进行了简单地规则清洗。

logCong 785 Dec 29, 2022
Demo programs for the Talking Head Anime from a Single Image 2: More Expressive project.

Demo Code for "Talking Head Anime from a Single Image 2: More Expressive" This repository contains demo programs for the Talking Head Anime

Pramook Khungurn 901 Jan 6, 2023
This project is part of Eleuther AI's quest to create a massive repository of high quality text data for training language models.

This project is part of Eleuther AI's quest to create a massive repository of high quality text data for training language models.

EleutherAI 42 Dec 13, 2022
NLPretext packages in a unique library all the text preprocessing functions you need to ease your NLP project.

NLPretext packages in a unique library all the text preprocessing functions you need to ease your NLP project.

Artefact 114 Dec 15, 2022
Mirco Ravanelli 2.3k Dec 27, 2022
This repository contains all the source code that is needed for the project : An Efficient Pipeline For Bloom’s Taxonomy Using Natural Language Processing and Deep Learning

Pipeline For NLP with Bloom's Taxonomy Using Improved Question Classification and Question Generation using Deep Learning This repository contains all

Rohan Mathur 9 Jul 17, 2021
Learn meanings behind words is a key element in NLP. This project concentrates on the disambiguation of preposition senses. Therefore, we train a bert-transformer model and surpass the state-of-the-art.

New State-of-the-Art in Preposition Sense Disambiguation Supervisor: Prof. Dr. Alexander Mehler Alexander Henlein Institutions: Goethe University TTLa

Dirk Neuhäuser 4 Apr 6, 2022
The simple project to separate mixed voice (2 clean voices) to 2 separate voices.

Speech Separation The simple project to separate mixed voice (2 clean voices) to 2 separate voices. Result Example (Clisk to hear the voices): mix ||

vuthede 31 Oct 30, 2022
This project converts your human voice input to its text transcript and to an automated voice too.

Human Voice to Automated Voice & Text Introduction: In this project, whenever you'll speak, it will turn your voice into a robot voice and furthermore

Hassan Shahzad 3 Oct 15, 2021
A Non-Autoregressive Transformer based TTS, supporting a family of SOTA transformers with supervised and unsupervised duration modelings. This project grows with the research community, aiming to achieve the ultimate TTS.

A Non-Autoregressive Transformer based TTS, supporting a family of SOTA transformers with supervised and unsupervised duration modelings. This project grows with the research community, aiming to achieve the ultimate TTS.

Keon Lee 237 Jan 2, 2023