Pipelines

Discover Refind’s best articles, videos, and resources on Pipelines. Follow along to get the most relevant new links picked for you.
9 Best Articles in 2021
In Data Science
Towards Data Science
Build pipelines with Pandas using “pdpipe”Towards Data Science
10 min read · 47 saves · 2019-11-30 · Tirthajyoti Sarkar · We show how to build intuitive and useful pipelines with Pandas DataFrame using a wonderful little library called pdpipe.
data science
pandas
python
In Machine Learning
Towards Data Science
The ultimate guide to building maintainable Machine Learning pipelines using DVCTowards Data Science
~19 min read · 30 saves · 2020-07-06 · Déborah Mesquita · Learn the principles for building maintainable Machine Learning pipelines using DVC
machine learning
In Startups
Harvard Business Review
Pipelines, Platforms, and the New Rules of StrategyHarvard Business Review
~17 min read · 91 saves · From 2016 · Scale now trumps differentiation.
platforms
network effects
 
github.com
spotify/luigigithub.com
26 saves · From 2016 · luigi - Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support bu...
stream processing
pipelines
dag
 
devcenter.heroku.com
Pipelines | Heroku Dev Centerdevcenter.heroku.com
7 min read · 11 saves · From 2015 · A pipeline is a group of Heroku apps that share the same codebase.
heroku
pipelines
 
Nature
Neuroimaging results altered by varying analysis pipelinesNature
4 min read · 10 saves · 2020-05-20 · Martin Lindquist · High variability in pipelines for neuroimaging analysis.
 
Insight Data Science
How to start automating your data pipelines with AirflowInsight Data Science
7 min read · 18 saves · From 2018 · Sriram Baskaran · In this blog, I cover the main concepts behind pipeline automation with Airflow and go through the code (and a few gotchas) to create your…
data
etl
pipelines
In Data Visualization
The Washington Post
Six maps that show the anatomy of America's vast infrastructureThe Washington Post
10 min read · 50 saves · From 2016 · A look at the United States’s bridges, electrical grid, pipelines, railroads, airports and waterways
data journalism
 
github.com
quantumblacklabs/kedrogithub.com
21 saves · 2019-06-05 · A Python library for building robust production-ready data and analytics pipelines - quantumblacklabs/kedro
machine learning
data science
python
Trending
In Machine Learning
Machine Learning Mastery
A Gentle Introduction to Machine Learning Modeling PipelinesMachine Learning Mastery
6 min read · 49 saves · Jan 5th · Jason Brownlee · Applied machine learning is typically focused on finding a single model that performs well or best on a given dataset. Effective use of the model will require appropriate preparation of the input data…
machine learning
 
github.com
maiot-io/zenmlgithub.com
16 saves · 2020-12-24 · ZenML: Bring Zen to your ML with reproducible pipelines - maiot-io/zenml
 
Towards Data Science
Practical Machine Learning with Scikit-LearnTowards Data Science
~11 min read · 2020-12-23 · Soner Yıldırım · EDA, feature engineering and preprocessing, pipelines
 
Towards Data Science
Step by step tutorial of Sci-kit Learn PipelineTowards Data Science
8 min read · Jan 10th · James Ho · Use Pipelines to streamline your data science project right now!
More like this
 
prithu.xyz
The beauty of Unix pipelinesprithu.xyz
7 min read · 26 saves · 2020-06-04 · Some examples of using unix tools in a pipeline
In Machine Learning
Machine Learning Mastery
Automated Machine Learning (AutoML) Libraries for PythonMachine Learning Mastery
~14 min read · 109 saves · 2020-09-17 · Jason Brownlee · AutoML provides tools to automatically discover good machine learning model pipelines for a dataset with very little user intervention. It is ideal for domain experts new to machine learning or…
machine learning
data science
 
highops.com
Continuous Delivery: GoCD vs Jenkinshighops.com
6 min read · 10 saves · From 2014 · Not all pipelines are created equal: they need to be first class built-in concepts
pipelines
cd
 
github.com
cgarciae/pypelngithub.com
12 saves · From 2018 · Concurrent data pipelines made easy. Contribute to cgarciae/pypeln development by creating an account on GitHub.
python
data
pipelines
In Machine Learning
Machine Learning Mastery
A Gentle Introduction to Machine Learning Modeling PipelinesMachine Learning Mastery
6 min read · 49 saves · Jan 5th · Jason Brownlee · Applied machine learning is typically focused on finding a single model that performs well or best on a given dataset. Effective use of the model will require appropriate preparation of the input data…
machine learning
 
github.com
gaia-pipeline/gaiagithub.com
18 saves · From 2018 · gaia - Build powerful pipelines in any programming language.
golang
ci-cd
 
medium.com
Trump, Putin and the Pipelines to Nowheremedium.com
10 min read · 29 saves · From 2016 · You can’t understand what Trump’s doing to America without understanding the “Carbon Bubble”
climate crisis
oil
 
github.com
GitHub - rhiever/tpot: A Python tool that automatically creates and optimizes machine learning pipelines using genetic programming.github.com
10 saves · From 2015 · tpot - A Python tool that automatically creates and optimizes machine learning pipelines using genetic programming.
machine learning
In Math
Tomasz Tunguz
The Essential Go To Market Math for Beating Your SaaS Startup's Growth TargetsTomasz Tunguz
2 min read · 32 saves · From 2015 · How big is your SaaS startup’s sales pipeline? How big does it need to be to achieve next month’s bookings target? What is the ratio of the sales pipeline to bookings? What should it be? When asked…
sales
saas
pipelines