🤖 ⚡ scikit-learn tips

Kevin Markham

Last update: Jan 3, 2023

Related tags

Overview

🤖 ⚡ scikit-learn tips

New tips are posted on LinkedIn, Twitter, and Facebook.

👉 Sign up to receive 2 video tips by email every week! 👈

List of all tips

Click to discuss the tip on LinkedIn, click to view the Jupyter notebook for a tip, or click to watch the tip video on YouTube:

#	Description	Links
1	Use `ColumnTransformer` to apply different preprocessing to different columns
2	Seven ways to select columns using `ColumnTransformer`
3	What is the difference between "fit" and "transform"?
4	Use "fit_transform" on training data, but "transform" (only) on testing/new data
5	Four reasons to use scikit-learn (not pandas) for ML preprocessing
6	Encode categorical features using `OneHotEncoder` or `OrdinalEncoder`
7	Handle unknown categories with `OneHotEncoder` by encoding them as zeros
8	Use `Pipeline` to chain together multiple steps
9	Add a missing indicator to encode "missingness" as a feature
10	Set a "random_state" to make your code reproducible
11	Impute missing values using `KNNImputer` or `IterativeImputer`
12	What is the difference between `Pipeline` and `make_pipeline`?
13	Examine the intermediate steps in a `Pipeline`
14	`HistGradientBoostingClassifier` natively supports missing values
15	Three reasons not to use drop='first' with `OneHotEncoder`
16	Use `cross_val_score` and `GridSearchCV` on a `Pipeline`
17	Try `RandomizedSearchCV` if `GridSearchCV` is taking too long
18	Display `GridSearchCV` or `RandomizedSearchCV` results in a DataFrame
19	Important tuning parameters for `LogisticRegression`
20	Plot a confusion matrix
21	Compare multiple ROC curves in a single plot
22	Use the correct methods for each type of `Pipeline`
23	Display the intercept and coefficients for a linear model
24	Visualize a decision tree two different ways
25	Prune a decision tree to avoid overfitting
26	Use stratified sampling with `train_test_split`
27	Two ways to impute missing values for a categorical feature
28	Save a model or `Pipeline` using joblib
29	Vectorize two text columns in a `ColumnTransformer`
30	Four ways to examine the steps of a `Pipeline`
31	Shuffle your dataset when using `cross_val_score`
32	Use AUC to evaluate multiclass problems
33	Use `FunctionTransformer` to convert functions into transformers
34	Add feature selection to a `Pipeline`
35	Don't use `.values` when passing a pandas object to scikit-learn
36	Most parameters should be passed as keyword arguments
37	Create an interactive diagram of a `Pipeline` in Jupyter
38	Get the feature names output by a `ColumnTransformer`
39	Load a toy dataset into a DataFrame
40	Estimators only print parameters that have been changed
41	Drop the first category from binary features (only) with `OneHotEncoder`
42	Passthrough some columns and drop others in a `ColumnTransformer`
43	Use `OrdinalEncoder` instead of `OneHotEncoder` with tree-based models
44	Speed up `GridSearchCV` using parallel processing
45	Create feature interactions using `PolynomialFeatures`
46	Ensemble multiple models using `VotingClassifer` or `VotingRegressor`
47	Tune the parameters of a `VotingClassifer` or `VotingRegressor`
48	Access part of a `Pipeline` using slicing
49	Tune multiple models simultaneously with `GridSearchCV`
50	Adapt this pattern to solve many Machine Learning problems

You can interact with all of these notebooks online using Binder:

Note: Some of the tips do not include any code, and can only be viewed on LinkedIn.

Who creates these tips?

Hi! I'm Kevin Markham, the founder of Data School. I've been teaching data science in Python since 2014. I create these tips because I love using scikit-learn and I want to help others use it more effectively.

How can I get better at scikit-learn?

I teach three courses:

Course 1: Introduction to Machine Learning in Python with scikit-learn (4 hours, free)
Course 2: Building an Effective Machine Learning Workflow with scikit-learn (8 hours, paid)
Course 3: Machine Learning with Text in Python (14 hours, paid)

👉 Find out which course is right for you! 👈

Do you have any other tips?

Yes! In 2019, I posted 100 pandas tricks. I also created a video featuring my top 25 pandas tricks.

You might also like...

K-Means clusternig example with Python and Scikit-learn

Unsupervised-Machine-Learning Flat Clustering K-Means clusternig example with Python and Scikit-learn Flat clustering Clustering algorithms group a se

1 Dec 13, 2021

Scikit-Learn useful pre-defined Pipelines Hub

Scikit-Pipes Scikit-Learn useful pre-defined Pipelines Hub Usage: Install scikit-pipes It's advised to install sklearn-genetic using a virtual env, in

1 Apr 26, 2022

Predicting Baseball Metric Clusters: Clustering Application in Python Using scikit-learn

Clustering Clustering Application in Python Using scikit-learn This repository contains the prediction of baseball metric clusters using MLB Statcast

2 Apr 18, 2022

To design and implement the Identification of Iris Flower species using machine learning using Python and the tool Scikit-Learn.

1 Jan 11, 2022

Comments

scikit-learn tip #37: issue with set_config() function

Dear all,

Thanks to the fantastic work from Kevin to spread his data science knowledges accross the web, I discovered this new pipeline interactive diagramm in sklearn v0.23. I tried to use it on one of my jupyter notebook after ruing a conda update --all, to ensure no compatibility issues, and I am really struggeling with it. I can import the package. But when I just try to set display parameter to 'diagram', it is just telling me "set_config() got an unexpected keyword argument 'display'"

I am searching to fix this issue on my notebook since nearly 1 h, but impossible to find what went wrong. Does anyone have an idea on how to run this new function?

Thanks a lot for your support, and take good care!

opened by Xavier-F 4

🤖 ⚡ scikit-learn tips

Related tags

Overview

🤖 ⚡ scikit-learn tips

List of all tips

Who creates these tips?

How can I get better at scikit-learn?

Do you have any other tips?

You might also like...

K-Means clusternig example with Python and Scikit-learn

Scikit-Learn useful pre-defined Pipelines Hub

Predicting Baseball Metric Clusters: Clustering Application in Python Using scikit-learn

To design and implement the Identification of Iris Flower species using machine learning using Python and the tool Scikit-Learn.

Painless Machine Learning for python based on scikit-learn

icepickle is to allow a safe way to serialize and deserialize linear scikit-learn models

scikit-multimodallearn is a Python package implementing algorithms multimodal data.

scikit-fem is a lightweight Python 3.7+ library for performing finite element assembly.

Learn how to responsibly deliver value with ML.

Comments

scikit-learn tip #37: issue with set_config() function

Owner

Kevin Markham

A scikit-learn based module for multi-label et. al. classification

Highly interpretable classifiers for scikit learn, producing easily understood decision rules instead of black box models

Automated Machine Learning with scikit-learn

Relevance Vector Machine implementation using the scikit-learn API.

Distributed scikit-learn meta-estimators in PySpark

Iris species predictor app is used to classify iris species created using python's scikit-learn, fastapi, numpy and joblib packages.

A collection of Scikit-Learn compatible time series transformers and tools.

Penguins species predictor app is used to classify penguins species created using python's scikit-learn, fastapi, numpy and joblib packages.

Scikit learn library models to account for data and concept drift.

Interactive Web App with Streamlit and Scikit-learn that applies different Classification algorithms to popular datasets