medium.com
How to build a scaleable crawler to crawl million pages with a single machine in just 2 hours
There are lots of articles about how to build a python crawler . If you are a newbie in python and not familiar with multiprocessing or…
202 saves
Recently shared by
Take a deep dive
More like this
crawly.diffbot.com
Web Crawler That Automatically Extracts Site Content
crawly.diffbot.com
From 2016 · Crawly automatically extracts the correct content from any web page. No rules required.
jacques.nreality.com
Essential software engineering reading list
jacques.nreality.com
From 2016 · Here is a list of classic articles and books that have informed my thinking on software engineering.
siliconangle.com
Agile software development is dead. Deal with it
siliconangle.com
7 min read · 2020-02-04 · Agile software development is dead. Deal with it - SiliconANGLE
exceptionnotfound.net
15 Fundamental Laws of Software Development
exceptionnotfound.net
7 min read · From 2016 · From Occam's Razor to Parkinson's Law of Triviality, let's discuss some of the most useful adages and quotes in the world of software development.
chriskiehl.com
Software development topics I've changed my mind on after 6 years in the industry
chriskiehl.com
1 min read · Jan 24th · Published: 2021-01-23Things I've changed my mind on:Things I now believe, which past me would've squabbled with:Typed languages are better when you're working on a team of people with various…
thevaluable.dev
8 Cognitive Biases in Software Development
thevaluable.dev
~16 min read · 2020-06-07 · Cognitive biases can bring mistakes, bugs, and wrong implementations. Knowing what cognitive biases are, what are the most common ones in software development, and how to fight them, can help you…
blogs.microsoft.com
Software development in 2021 and beyond
blogs.microsoft.com
8 min read · Jan 14th · 2020 is now – finally – hindsight. It was a year of unprecedented disruption – how businesses connected with their employees and customers transformed nearly overnight. We saw organizations rapidly…
CIO.com
Rethinking software development in the AI era
CIO.com
1 min read · 2019-09-11 · Data is fast replacing code as the foundation of software development. Here’s how leading organizations anticipate processes and tools transforming as developers navigate this paradigm shift.
bitlog.com
Why are we so bad at software engineering?
bitlog.com
~12 min read · 2020-02-12 · Our industry's mindset grew in an environment where failure is cheap and we are incentivized to move quickly. Our processes are poorly applied when the cost of a redo is high or a redo is impossible.
