#547: Parallel Python at Anyscale with Ray

#547: Parallel Python at Anyscale with Ray

When OpenAI trained GPT-3, they didn't roll their own orchestration layer. They used Ray, an open source Python framework born out of the same Berkeley research lab lineage that gave us Apache Spark. And here's the twist: Ray was originally built for reinforcement learning research, then quietly faded as RL hit a wall. Until ChatGPT showed up. Suddenly reinforcement learning was back, as the post-training step that turns a raw language model into something genuinely useful. Edward Oakes and Richard Liaw, two founding engineers behind Ray and Anyscale, join me on Talk Python to tell that story. We'll trace Ray from its RISE Lab origins at UC Berkeley to powering some of the largest training runs in the world. We'll talk about what Ray actually is, a distributed execution engine for AI workloads, and how a few lines of Python become work running across hundreds of GPUs. We'll cover Ray Data for multimodal pipelines, the dashboard, the VS Code remote debugger, KubRay for Kubernetes, and where Ray fits alongside Dask, multiprocessing, and asyncio. If you've ever stared at a single-machine Python script and thought, "there has to be a better way to scale this", this one's for you

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(558)

#559: 12 Things You Should (and Shouldn't) Do in AWS

#559: 12 Things You Should (and Shouldn't) Do in AWS

Your site is down. It's 3am. Is it a bug, a bill, or a breach? You can't tell yet, and everyone is watching you find out. Matt Lea has spent fifteen years being the person companies call when an outag...

19 Aug 1h 7min

#558: Hyper-Personal Software with Python

#558: Hyper-Personal Software with Python

Every company has one. The little internal tool that Jane built back in 2021, and then Jane left. Nobody understands it, nobody will touch it. There are two unwritten rules around it: don't change it,...

10 Aug 1h 2min

#557: Security of everything at PyCon 2026

#557: Security of everything at PyCon 2026

Security has always been the vegetables of software. Everyone agrees it matters, and somehow it never quite makes it onto the plate. At PyCon US this year, that changed. For the first time ever, secur...

2 Aug 1h 8min

#556: Updates on Django's Async Story

#556: Updates on Django's Async Story

For years, "Django and async" came with an asterisk. The docs themselves warned you off it. Scary performance notes, a story that felt half-finished. Well, that story just got rewritten, literally, an...

26 Juli 1h 4min

#555: Marimo Pair - A Canvas for Agent + Developers Collaboration

#555: Marimo Pair - A Canvas for Agent + Developers Collaboration

Coding agents have gotten really good at one kind of work. You scope a feature, edit some files, run the tests, ship it. It all happens on disk. But that is not how data work feels. You load something...

13 Juli 1h 4min

#554: Trustworthy AI in Healthcare and Longevity

#554: Trustworthy AI in Healthcare and Longevity

You ask an AI a question and it answers with total confidence. Most of the time, a confidently wrong answer is just an annoyance. But what if the question is medical, and there's a real patient on the...

10 Juli 1h

#553: All of our tools

#553: All of our tools

This episode is a fun crossover from our Python news and tips podcast, Python Bytes. We have had some big changes over there. Brian Okken has moved on and Calvin Hendryx-Parker has joined the show as ...

26 Juni 55min

#552: Astral joins OpenAI

#552: Astral joins OpenAI

OpenAI just acquired Astral, the company behind uv, Ruff, and ty. And if your first thought was "wait, is uv toast?", you are not alone. But here's the twist Charlie Marsh shared with me: he thinks th...

17 Juni 1h 5min

Populärt inom Teknik

uppgang-och-fall
market-makers
rss-elektrikerpodden
rss-laddstationen-med-elbilen-i-sverige
skogsforum-podcast
 och-bilen-gar-bra
rss-en-ai-till-kaffet
rss-uppgang-och-fall
bli-saker-podden
rss-technokratin
hej-bruksbil
bilar-med-sladd
gubbar-som-tjotar-om-bilar
rss-veckans-ai
under-femton
klocksnack-tillsammans-med-nymans-ur-1851
rss-milpodden
bosse-bildoktorn-och-hasse-p
elbilsveckan
natets-morka-sida