A repository for all ZenML projects that are specific production use-cases.

Overview

ZenFiles

Original Image source: https://www.goodfon.com/wallpaper/x-files-sekretnye-materialy.html And naturally, all credits to the awesome X-Files show for this repo's theme!

A collection of ZenFiles: Production-grade ML use-cases powered by ZenML.

Overview

Here is a list of updated and maintained ZenFiles:

Name Link Tags
NBA Predictor README drift, predictions

Generate a project template

To generate a ZenFile project folder:

python generate_zenfile.py ZENFILE_NAME  # no requirements needed
Comments
  • ModuleNotFoundError: No module named 'zenml.integrations.mlflow.mlflow_utils'

    ModuleNotFoundError: No module named 'zenml.integrations.mlflow.mlflow_utils'

    I am trying to implement customer satisfaction using zenml: While I execute this script: python run_deployment.py, I face below error

    zenfiles-main/customer-satisfaction/venv/lib/python3.6/site-packages/zenml/integrations/mlflow/services/mlflow_deployment.py:5: FutureWarning: MLflow support for Python 3.6 is deprecated and will be dropped in an upcoming release. At that point, existing Python 3.6 workflows that use MLflow will continue to work without modification, but Python 3.6 users will no longer get access to the latest MLflow features and bugfixes. We recommend that you upgrade to Python 3.7 or newer. from mlflow.pyfunc.backend import PyFuncBackend # type: ignore [import] ╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ │ │zenfiles-main/customer-satisfaction/run_deployment.py:18 in │ │ │ │ 15 from steps.evaluation import evaluation │ │ 16 from steps.ingest_data import ingest_data │ │ 17 from steps.model_train import train_model │ │ ❱ 18 from zenml.integrations.mlflow.mlflow_utils import get_tracking_uri │ │ 19 from zenml.integrations.mlflow.steps import MLFlowDeployerConfig │ │ 20 from zenml.services import load_last_service_from_step │ │ 21 from zenml.integrations.mlflow.steps import mlflow_model_deployer_step │ │ │ │ ╭─────────────────────────────────────────── locals ───────────────────────────────────────────╮ │ │ │ annotations = {} │ │ │ │ builtins = <module 'builtins' (built-in)> │ │ │ │ cached = None │ │ │ │ doc = None │ │ │ │ file = 'run_deployment.py' │ │ │ │ loader = <_frozen_importlib_external.SourceFileLoader object at │ │ │ │ 0x7f900afdc1d0> │ │ │ │ name = 'main' │ │ │ │ package = None │ │ │ │ spec = None │ │ │ │ clean_data = <class 'steps.clean_data.clean_data'> │ │ │ │ click = <module 'click' from │ │ │ │ '/home/laiml/Downloads/zenfiles-main/customer-satisfacti… │ │ │ │ continuous_deployment_pipeline = <class │ │ │ │ 'zenml.pipelines.base_pipeline.continuous_deployment_pip… │ │ │ │ cs_materializer = <class │ │ │ │ 'materializer.custom_materializer.cs_materializer'> │ │ │ │ deployment_trigger = <class │ │ │ │ 'pipelines.deployment_pipeline.deployment_trigger'> │ │ │ │ DeploymentTriggerConfig = <class │ │ │ │ 'pipelines.deployment_pipeline.DeploymentTriggerConfig'> │ │ │ │ dynamic_importer = <class 'pipelines.deployment_pipeline.dynamic_importer'> │ │ │ │ evaluation = <class 'steps.evaluation.evaluation'> │ │ │ │ inference_pipeline = <class │ │ │ │ 'zenml.pipelines.base_pipeline.inference_pipeline'> │ │ │ │ ingest_data = <class 'steps.ingest_data.ingest_data'> │ │ │ │ MLFlowDeploymentLoaderStepConfig = <class │ │ │ │ 'pipelines.deployment_pipeline.MLFlowDeploymentLoaderSte… │ │ │ │ prediction_service_loader = <class │ │ │ │ 'pipelines.deployment_pipeline.prediction_service_loader… │ │ │ │ predictor = <class 'pipelines.deployment_pipeline.predictor'> │ │ │ │ print = <function print at 0x7f8f98e2bd08> │ │ │ │ train_model = <class 'steps.model_train.train_model'> │ │ │ ╰──────────────────────────────────────────────────────────────────────────────────────────────╯ │ ╰──────────────────────────────────────────────────────────────────────────────────────────────────╯ ModuleNotFoundError: No module named 'zenml.integrations.mlflow.mlflow_utils'

    opened by Coder-Vishali 8
  • Time-series Forecast ZenFile

    Time-series Forecast ZenFile

    Predict electricity power generation from wind forecast using ZenML:

    • Load data directly from Google Cloud BigQuery
    • Train a model remotely in Vertex AI

    Also contains a thorough description on how to set up and configure a google cloud project together with a zenml stack.

    enhancement 
    opened by lukyrasocha 7
  • Update Yolov5 Sign langauge Zenfile

    Update Yolov5 Sign langauge Zenfile

    Description

    This is an update for the signed language ZenFile (project)! The new update redefined the whole project from splitting each process to a standalone pipeline (Training, Deployment, Inference) to adding a video that shows the actual model working on a real-time image using the webcam + creating a BentoML deployed bento which can be served in any environment! (Only Video recording left, which will be added to readme once it's uploaded to youtube)

    opened by safoinme 3
  • TypeError: pipeline() got an unexpected keyword argument 'requirements_file'

    TypeError: pipeline() got an unexpected keyword argument 'requirements_file'

    I was trying to implement "Predicting how a customer will feel about a product before they even ordered it". I face this issue while running the below script:

    python run_deployment.py

    Error: C:\Users\vsriniva\Desktop\zenml\zenfiles\customer-satisfaction\py_venv\lib\site-packages\xgboost\compat.py:36: FutureWarning: pandas.Int64Index is deprecated and will be removed from pand as in a future version. Use pandas.Index with the appropriate dtype instead. from pandas import MultiIndex, Int64Index ┌─────────────────────────────── Traceback (most recent call last) ────────────────────────────────┐ │ C:\Users\vsriniva\Desktop\zenml\zenfiles\customer-satisfaction\run_deployment.py:3 in │ │ │ │ 1 import click │ │ 2 from materializer.custom_materializer import cs_materializer │ │ > 3 from pipelines.deployment_pipeline import ( │ │ 4 │ DeploymentTriggerConfig, │ │ 5 │ MLFlowDeploymentLoaderStepConfig, │ │ 6 │ continuous_deployment_pipeline, │ │ │ │ C:\Users\vsriniva\Desktop\zenml\zenfiles\customer-satisfaction\pipelines\deployment_pipeline.py: │ │ 107 in │ │ │ │ 104 │ return prediction │ │ 105 │ │ 106 │ │ > 107 @pipeline(enable_cache=True, requirements_file=requirements_file) │ │ 108 def continuous_deployment_pipeline( │ │ 109 │ ingest_data, │ │ 110 │ clean_data, │ └──────────────────────────────────────────────────────────────────────────────────────────────────┘ TypeError: pipeline() got an unexpected keyword argument 'requirements_file'

    opened by Coder-Vishali 3
  • Remove Atari ZenFile

    Remove Atari ZenFile

    Seems like the base ROMs (i.e. the games) for the Atari games used in the Atari ZenFile are no longer distributed by OpenAI or ALE (which we were using in the ZenFile). (Last time I ran the ZenFile it worked fine, now it can't be loaded.).

    Removing this ZenFile accordingly, since it doesn't work without the ROMs.

    internal 
    opened by strickvl 1
  • Update NBA Pipeline ZenFile to ZenML 0.20.0

    Update NBA Pipeline ZenFile to ZenML 0.20.0

    Describe changes

    Update NBA Pipeline ZenFile to work with ZenML 0.20.2!

    Pre-requisites

    Please ensure you have done the following:

    • [X] If my change requires a change to docs, I have updated the documentation accordingly.

    Types of changes

    • [x] Bug fix (non-breaking change which fixes an issue)
    • [ ] Other (add details above)
    opened by safoinme 1
  • Update Time Series Forecast ZenFile to ZenML 0.20.2

    Update Time Series Forecast ZenFile to ZenML 0.20.2

    Describe changes

    Update theTime Series Forecast ZenFile to work with ZenML 0.20.2!

    Pre-requisites

    Please ensure you have done the following:

    • [X] If my change requires a change to docs, I have updated the documentation accordingly.

    Types of changes

    • [x] Bug fix (non-breaking change which fixes an issue)
    • [ ] Other (add details above)
    opened by safoinme 1
  • Update Customer Churn ZenFile to ZenML 0.20.2

    Update Customer Churn ZenFile to ZenML 0.20.2

    Describe changes

    Update the Custom Churn ZenFile to work with ZenML 0.20.2!

    Pre-requisites

    Please ensure you have done the following:

    • [X] If my change requires a change to docs, I have updated the documentation accordingly.

    Types of changes

    • [x] Bug fix (non-breaking change which fixes an issue)
    • [ ] Other (add details above)
    opened by safoinme 1
  • Update Atari Game Play to ZenML 0.20.2

    Update Atari Game Play to ZenML 0.20.2

    Describe changes

    Update the Atari Game ZenFile to work with ZenML 0.20.2! This PR will be open till fixing an error due to dependency changes

    Pre-requisites

    Please ensure you have done the following:

    • [X] If my change requires a change to docs, I have updated the documentation accordingly.

    Types of changes

    • [x] Bug fix (non-breaking change which fixes an issue)
    • [ ] Other (add details above)
    opened by safoinme 1
  • Update Customer Satisfaction to ZenML 0.20.2

    Update Customer Satisfaction to ZenML 0.20.2

    Describe changes

    Update the custom satisfaction ZenFile to work with ZenML 0.20.2!

    Pre-requisites

    Please ensure you have done the following:

    • [X] If my change requires a change to docs, I have updated the documentation accordingly.

    Types of changes

    • [x] Bug fix (non-breaking change which fixes an issue)
    • [ ] Other (add details above)
    opened by safoinme 1
Owner
ZenML
Building production MLOps tooling.
ZenML
Wrappers around the most common maya.cmds and maya.api use cases

Maya FunctionSet (maya_fn) A package that decompose core maya.cmds and maya.api features to a set of simple functions. Tests The recommended approach

Ryan Porter 9 Mar 12, 2022
A python script to run any executable and pass test cases to it's stdin and compare stdout with correct output.

quera_testcase_checker A python script to run any executable and pass test cases to it's stdin and compare stdout with correct output. proper way to u

k3y1 1 Nov 15, 2021
We are building an open database of COVID-19 cases with chest X-ray or CT images.

?? Note: please do not claim diagnostic performance of a model without a clinical study! This is not a kaggle competition dataset. Please read this pa

Joseph Paul Cohen 2.9k Dec 30, 2022
The earliest beta version of pytgcalls on Linux x86_64 and ARM64! Use in production at your own risk!

Public beta test. Use in production at your own risk! tgcalls - a python binding for tgcalls (c++ lib by Telegram); pytgcalls - library connecting pyt

Il'ya 21 Jan 13, 2022
Beginner Projects A couple of beginner projects here

Beginner Projects A couple of beginner projects here, listed from easiest to hardest :) selector.py: simply a random selector to tell me who to faceti

Kylie 272 Jan 7, 2023
Donatus Prince 6 Feb 25, 2022
This repository contains Python Projects for Beginners as well as for Intermediate Developers built by Contributors.

Python Projects {Open Source} Introduction The repository was built with a tree-like structure in mind, it contains collections of Python Projects. Mo

Gaurav Pandey 115 Apr 30, 2022
Sathal's Python Projects Repository

Sathal's Python Projects Repository Purpose and Motivation I come from a mainly C Programming Language background and have previous classroom experien

Sam 1 Oct 20, 2021
This repository contains completed Python projects

My Python projects This repository contains completed Python projects: 1) Build projects Guide for building projects into executable files 2) Calculat

Igor Yunusov 8 Nov 4, 2021
A minimalist production ready plugin system

pluggy - A minimalist production ready plugin system This is the core framework used by the pytest, tox, and devpi projects. Please read the docs to l

pytest-dev 876 Jan 5, 2023
Connect Playground - easy way to fill in your account with production-like objects

Just set of scripts to initialise accpunt with production-like data: A - Basic Distributor Account Initialization INPUT Distributor Account Token ACTI

CloudBlue 5 Jun 25, 2021
A class to draw curves expressed as L-System production rules

A class to draw curves expressed as L-System production rules

Juna Salviati 6 Sep 9, 2022
Estimating the potential photovoltaic production of buildings (in Berlin)

The following people contributed equally to this repository (in alphabetical order): Daniel Bumke JJX Corstiaen Versteegh This repository is forked on

Daniel Bumke 6 Feb 18, 2022
Identify unused production dependencies and avoid a bloated virtual environment.

creosote Identify unused production dependencies and avoid a bloated virtual environment. Quickstart # Install creosote in separate virtual environmen

Fredrik Averpil 7 Dec 29, 2022
Vita Specific Patches and Application for Doki Doki Literature Club (Steam Version) using Ren'Py PSVita

Doki-Doki-Literature-Club-Vita Vita Specific Patches and Application for Doki Doki Literature Club (Steam Version) using Ren'Py PSVita Contains: Modif

Jaylon Gowie 25 Dec 30, 2022
Fixes your Microphone Level to one specific value.

MicLeveler Fixes your Microphone Level to one specific value. Intention A friend of mine has the problem that some programs are setting his microphone

Moritz Timpe 2 Oct 14, 2021
The purpose of this tool is to check RDP capabilities of a user on specific targets.

RDPChecker The purpose of this tool is to check RDP capabilities of a user on specific targets. Programming concept was taken from RDPassSpray and thu

Hypnoze57 57 Aug 4, 2022
This is a Saleae Logic custom high level analyzer that allows you to search and mark specific packets.

SaleaePacketParser This is a Saleae Logic custom high level analyzer that allows you to search and mark specific packets. Field "Search For" is used f

null 1 Dec 16, 2021
A tool to help calculate how to split conveyors in Satisfactory into specific ratios.

Satisfactory Splitter Calculator A tool to help calculate how to split conveyors in Satisfactory into specific ratios. Dependencies Python 3.9 PyYAML

RobotiCat 5 Dec 22, 2022