9 Best Articles in 2022
Towards Data Science
Build pipelines with Pandas using “pdpipe”
Towards Data Science
10 min read · From 2019 · We show how to build intuitive and useful pipelines with Pandas DataFrame using a wonderful little library called pdpipe.
Reader View · Shared by 47, including Dr. Ganapathi Pulipaka 🇺🇸, Carla Gentry, Linus Basig
Towards Data Science
The ultimate guide to building maintainable Machine Learning pipelines using DVC
Towards Data Science
~19 min read · 2020-07-07 · Learn the principles for building maintainable Machine Learning pipelines using DVC
Reader View · Shared by 30, including rohit
Harvard Business Review
Pipelines, Platforms, and the New Rules of Strategy
Harvard Business Review
~18 min read · From 2016 · Scale now trumps differentiation.
Reader View · Shared by 97, including Twitty, Scott Brinker, William El Kaim, Dominik Grolimund, Thomas Euler, Klaus Eck, shishir das, Chung Chen, Wilko S. Wolters 🇩🇪🇪🇺 See you at #HM22 ⚙️, Christian P. Stobbe, Luzius Meisser, Grégoire Japiot 🌻, Stephanie A Kowalski, Bram Kanstein, Thomas Pleil, Chris Messina,
Machine Learning Mastery
Automated Machine Learning (AutoML) Libraries for Python
Machine Learning Mastery
~14 min read · 2020-09-17 · AutoML provides tools to automatically discover good machine learning model pipelines for a dataset with very little user intervention. It is ideal for domain experts new to machine learning or…
Reader View · Shared by 108, including Dr. Ganapathi Pulipaka 🇺🇸, Carla Gentry, Yves Mulkers
VentureBeat
Microsoft open-sources SynapseML for developing AI pipelines
VentureBeat
3 min read · 2021-11-17 · Microsoft has released SynapseML, a new open source project designed to make it easier to create AI model pipelines.
Reader View · Shared by 22, including Bob E. Hayes
Fast Company
Offshore wind farms could do double duty as carbon capture devices
Fast Company
2 min read · Jan 26th · Built together, these two technologies could reduce the energy costs of carbon capture and minimize the need for onshore pipelines.
Reader View · Shared by 79, including James Gingerich, @Expeflow #WorkEasier #RPA, Theodora (Theo) Lau - 劉䂀曼 🌻
Machine Learning Mastery
A Gentle Introduction to Machine Learning Modeling Pipelines
Machine Learning Mastery
6 min read · 2021-01-05 · Applied machine learning is typically focused on finding a single model that performs well or best on a given dataset. Effective use of the model will require appropriate preparation of the input data…
Reader View · Shared by 66, including Dr. Ganapathi Pulipaka 🇺🇸, Carla Gentry, rogerverhoeven, Bob E. Hayes
research.nccgroup.com
10 real-world stories of how we’ve compromised CI/CD pipelines
research.nccgroup.com
6 min read · Jan 14th · Mainstream appreciation for cyberattacks targeting continuous integration and continuous delivery/continuous deployment (CI/CD) pipelines has been gaining momentum. Attackers and defenders…
Reader View · Shared by 18, including Matthew Green
github.com
spotify/luigi
github.com
From 2016 · luigi - Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support bu...
Shared by 31, including Mark Needham, Ludovic Claude, Nico Müller 🇺🇦, yawniek, Alexander Seifert, Jesús Torres 👩💻, Real Python
Trending
dagger.io
dagger.io | Introducing Dagger: a new way to create CI/CD pipelines
dagger.io
Mar 30th
Shared by 40, including William (Bill) Kennedy, Paul Graham, Kaushik Gopal
Visual Capitalist
Interactive Map: Crude Oil Pipelines and Refineries of the U.S. and Canada
Visual Capitalist
10 min read · Mar 28th · Pipelines are the primary method of transporting crude oil around the world, delivering oil and its derivative products swiftly to refineries and empowering reliant businesses. And North America is a…
Reader View · Shared by 15, including Evan Kirstel the $B2B Techfluencer
Kathimerini English Edition
Focus on LNG, not pipelines, US official tells Kathimerini
Kathimerini English Edition
7 min read · Apr 7th · Any questions that may have lingered about Washington’s intention to support the construction of the EastMed or other pipelines in the Eastern Mediterranean have been put to rest by US Under Secretary…
Reader View · Shared by 7
Datadog, Inc.
Run Synthetic tests in your CI/CD pipelines with the Datadog CircleCI orb
Datadog, Inc.
5 min read · May 6th · Automate Synthetic testing and monitor the results in your CI/CD pipelines, preempting issues arising from faulty code deployments.
Reader View · Shared by 9, including Software Daily
More like this
airbyte.io
ETL Pipelines with Airflow: the Good, the Bad and the Ugly
airbyte.io
7 min read · 2021-10-08 · Many data teams use Airflow for their ETL pipelines. But is using Airflow for your ETL pipelines a good practice today? Learn about the challenges of using Airflow transfer and transformation…
Reader View · Shared by 14, including Marcus Borba, Mike Tamir, PhD
Visual Capitalist
Interactive Map: Crude Oil Pipelines and Refineries of the U.S. and Canada
Visual Capitalist
10 min read · Mar 28th · Pipelines are the primary method of transporting crude oil around the world, delivering oil and its derivative products swiftly to refineries and empowering reliant businesses. And North America is a…
Reader View · Shared by 15, including Evan Kirstel the $B2B Techfluencer
The Washington Post
Six maps that show the anatomy of America's vast infrastructure
The Washington Post
10 min read · From 2016 · A look at the United States’s bridges, electrical grid, pipelines, railroads, airports and waterways
Shared by 50, including Courtney Bolton ★, Howard Getson, Mark Bao, Gideonro, David Bauer, Data Science Renee, Thomas Power, Dominic Grzbielok, hiten.eth
dagger.io
dagger.io | Introducing Dagger: a new way to create CI/CD pipelines
dagger.io
Mar 30th
Shared by 40, including William (Bill) Kennedy, Paul Graham, Kaushik Gopal
github.com
quantumblacklabs/kedro
github.com
From 2019 · A Python library for building robust production-ready data and analytics pipelines - quantumblacklabs/kedro
Shared by 23, including Marco Unternaehrer, Thomas Spreng, Nico Müller 🇺🇦, Data Science Renee, Dr. Ganapathi Pulipaka 🇺🇸, Linus Basig
Towards Data Science
How I Redesigned over 100 ETL into ELT Data Pipelines
Towards Data Science
~14 min read · 2021-10-05 · Level up your Data Pipelines!
Reader View · Shared by 13, including Scott Brinker
KDnuggets
Managing Machine Learning Workflows with Scikit-learn Pipelines Part 1: A Gentle Introduction
KDnuggets
4 min read · From 2017 · By Matthew Mayo, KDnuggets. comments Are you familiar with Scikit-learn Pipelines? They are an extremely simple yet very useful tool for managing machine learning workflows. A typical machine learning…
Reader View · Shared by 13, including Jacob du Toit, Chung Chen
How to Save a Planet
The Fight to Stop Oil Pipelines: "For Water. For Treaties. For Climate."
How to Save a Planet
20+ min read · 2021-04-21 · This week, we’re talking about oil pipelines. From the fight against Keystone XL to Standing Rock, pipeline protests have been central to the climate movement in the U.S. But they’ve always been about…
Reader View · Shared by 13, including Jonathan Overpeck, Kendra "Gloom is My Beat" Pierre-Louis
TechCrunch
Google Cloud launches new tools for deploying ML pipelines
TechCrunch
1 min read · From 2020 · Google Cloud today announced the beta launch of Cloud AI Platform Pipelines, a new enterprise-grade service that is meant to give developers a single tool to deploy their machine learning pipelines,…
Reader View · Shared by 14, including Chris Isak , Dr. Ganapathi Pulipaka 🇺🇸, Yves Mulkers
