From Engineering Deep Learning Systems by Chi Wang and Donald Szeto
This article presents what prospective readers can expect to learn from this book and why you should learn it.
Read it if you’re a software developer interested in transitioning your skills to the field of deep learning system design or an engineering-minded data scientist who want to build more effective delivery pipelines.
From Distributed Machine Learning Patterns by Yuan Tang
In this article, we introduce the collective communication pattern, which is a great alternative to parameter servers when the machine learning model we are building is not too large without having to tune the ratio between the number of workers and parameter servers.
From Distributed Machine Learning Patterns by Yuan Tang
In this article, we introduce the parameter server pattern which comes handy for situations where the model is too large to fit in a single machine such as one we would have to build for tagging entities in the 8 millions of YouTube videos.