9 Best Articles in 2021
Towards Data Science
Build pipelines with Pandas using “pdpipe”
Towards Data Science
10 min read · 2019-11-30 · We show how to build intuitive and useful pipelines with Pandas DataFrame using a wonderful little library called pdpipe.
Towards Data Science
The ultimate guide to building maintainable Machine Learning pipelines using DVC
Towards Data Science
~19 min read · 2020-07-07 · Learn the principles for building maintainable Machine Learning pipelines using DVC
github.com
spotify/luigi
github.com
From 2016 · luigi - Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support bu...
Harvard Business Review
Pipelines, Platforms, and the New Rules of Strategy
Harvard Business Review
~18 min read · From 2016 · Scale now trumps differentiation.
Machine Learning Mastery
Automated Machine Learning (AutoML) Libraries for Python
Machine Learning Mastery
~14 min read · 2020-09-17 · AutoML provides tools to automatically discover good machine learning model pipelines for a dataset with very little user intervention. It is ideal for domain experts new to machine learning or…
github.com
quantumblacklabs/kedro
github.com
From 2019 · A Python library for building robust production-ready data and analytics pipelines - quantumblacklabs/kedro
Insight Data Science
How to start automating your data pipelines with Airflow
Insight Data Science
7 min read · From 2018 · In this blog, I cover the main concepts behind pipeline automation with Airflow and go through the code (and a few gotchas) to create your…
Machine Learning Mastery
A Gentle Introduction to Machine Learning Modeling Pipelines
Machine Learning Mastery
6 min read · Jan 5th · Applied machine learning is typically focused on finding a single model that performs well or best on a given dataset. Effective use of the model will require appropriate preparation of the input data…
The Washington Post
Six maps that show the anatomy of America's vast infrastructure
The Washington Post
10 min read · From 2016 · A look at the United States’s bridges, electrical grid, pipelines, railroads, airports and waterways
Trending
The New York Times
Private Equity Funds, Sensing Profit in Tumult, Are Propping Up Oil
The New York Times
6 min read · Oct 13th · These secretive investment companies have pumped billions of dollars into fossil fuel projects, buying up offshore platforms, building new pipelines and extending lifelines to coal power plants.
Towards Data Science
How I Redesigned over 100 ETL into ELT Data Pipelines
Towards Data Science
~14 min read · Oct 5th · Level up your Data Pipelines!
Project Jupyter
Ploomber: Maintainable and Collaborative Pipelines in Jupyter
Project Jupyter
~11 min read · Sep 2nd · Ploomber is an open-source framework that allows teams to develop maintainable pipelines in Jupyter.
medium.com
Applying Modern Go Concurrency Patterns to Data Pipelines
medium.com
~19 min read · Sep 25th · Resilient, fast, efficient and concise? Pick all four! How to apply old and new concurrency patterns to pipelines in Golang
More like this
devcenter.heroku.com
Pipelines | Heroku Dev Center
devcenter.heroku.com
7 min read · From 2015 · A pipeline is a group of Heroku apps that share the same codebase.
nature
Neuroimaging results altered by varying analysis pipelines
nature
5 min read · 2020-05-21 · High variability in pipelines for neuroimaging analysis.
KDnuggets
Managing Machine Learning Workflows with Scikit-learn Pipelines Part 1: A Gentle Introduction
KDnuggets
4 min read · From 2017 · By Matthew Mayo, KDnuggets. comments Are you familiar with Scikit-learn Pipelines? They are an extremely simple yet very useful tool for managing machine learning workflows. A typical machine learning…
How to Save a Planet
The Fight to Stop Oil Pipelines: "For Water. For Treaties. For Climate."
How to Save a Planet
20+ min read · Apr 21st · This week, we’re talking about oil pipelines. From the fight against Keystone XL to Standing Rock, pipeline protests have been central to the climate movement in the U.S. But they’ve always been about…
TechCrunch
Google Cloud launches new tools for deploying ML pipelines
TechCrunch
1 min read · 2020-03-11 · Google Cloud today announced the beta launch of Cloud AI Platform Pipelines, a new enterprise-grade service that is meant to give developers a single tool to deploy their machine learning pipelines,…
github.com
cgarciae/pypeln
github.com
From 2018 · Concurrent data pipelines made easy. Contribute to cgarciae/pypeln development by creating an account on GitHub.
github.com
koaning/scikit-lego
github.com
2020-11-18 · Extra blocks for scikit-learn pipelines. Contribute to koaning/scikit-lego development by creating an account on GitHub.
highops.com
Continuous Delivery: GoCD vs Jenkins
highops.com
6 min read · From 2014 · Not all pipelines are created equal: they need to be first class built-in concepts
github.com
GitHub - rhiever/tpot: A Python tool that automatically creates and optimizes machine learning pipelines using genetic programming.
github.com
From 2015 · tpot - A Python tool that automatically creates and optimizes machine learning pipelines using genetic programming.
