Simon Mo – Medium

Published in Distributed Computing with Ray

·Jul 20, 2020

Machine Learning Serving is Broken

And How Ray Serve Can Fix it — NOTE: As of Ray 1.4, Ray Serve has a new-and-improve API focused around the concept of "Deployments" (replacing "Backends" in this post). This change was made to make use cases like the one in this blog post easier than ever! Please see the latest documentation at rayserve.org for details. TL;DR…

Machine Learning

7 min read

Machine Learning

7 min read

Published in Distributed Computing with Ray

·Mar 2, 2020

Scaling Python Asyncio with Ray

TL;DR: Scale your existing asyncio application to thousands of cores with 20 lines of code. Ray added two features to enable seamless integration with Python asyncio ecosystem. Both features help to scale your existing asyncio application to multi-core and multi-node. You can try it out today! This post explains how…

Distributed Systems

4 min read

Distributed Systems

4 min read