ML 021: Grokking Deep Reinforcement Learning with Miguel Morales

Rishal Hurbans is the author of Grokking Artificial Intelligence Algorithms. He walks us through how to learn different Machine Learning algorithms. He also then walks us through the different types of algorithms based on different natural systems and processes.LinksKaggle: Your Machine Learning and Data Science CommunityRishal HurbansInktoberBook giveaway linkPicksChuck- Hero with a thousand faces by Joseph CampbellChuck- Masterbuilt smokerRishal-Learn something new everydayRishal- Building a StoryBrand by Donald MillerBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

9 Joulu 202440min

In today’s episode, Michael and Ben are joined by industry expert Barzan Mozafari, the CEO and co-founder at Keebo. He delves deep into the evolving landscape of data learning and cloud optimization. They explore how understanding data distribution can lead to early detection of anomalies and how optimizing data workflows can result in significant cost savings and unintended business growth. Barzan sheds light on leveraging existing cloud technologies and the role of automated tools in enhancing system interactions, while Ben talks about the intricacies of platform migration and tech debt.They dig into the challenges and strategies for optimizing complex data pipelines, the economic pressures faced by data teams, and insights into innovation stemming from academic research. The conversation also covers the importance of maintaining customer trust without compromising data security and the iterative nature of both academic and industrial approaches to problem-solving. Join them as they navigate the intersection of technical debt, AI-driven optimization, and the dynamic collaboration between researchers and engineers, all aimed at driving continuous improvement and innovation in the world of data.So, gear up for an episode packed with insights on shrinking pie data learning, cloud costs, automated optimization tools, and much more. Let’s dive right in!SocialsLinkedIn: Barzan MozafariBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

28 Marras 202455min

Today, join Michael and Ben as they delve into crucial topics surrounding code security and the safe execution of machine learning models. This episode focuses on preventing accidental key leaks in notebooks, creating secure environments for code execution, and the pros and cons of various isolation methods like VMs, containers, and micro VMs.They explore the challenges of evaluating and executing generated code, highlighting the risks of running arbitrary Python code and the importance of secure evaluation processes. Ben shares his experiences and best practices, emphasizing human evaluation and secure virtual environments to mitigate risks.The episode also includes an in-depth discussion on developing new projects with a focus on proper engineering procedures, and the sophisticated efforts behind Databricks' Genie service and MLflow's RunLLM. Finally, Ben and Michael explore the potential of fine-tuning machine learning models, creating high-quality datasets, and the complexities of managing code execution with AI.Tune in for all this and more as we navigate the secure pathways to responsible and effective machine learning development.SocialsLinkedIn: Michael BerkLinkedIn: Ben WilsonBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

21 Marras 202451min

They delve into the journeys and insights of distinguished leaders in the development world. In today's episode, Michael engages with  Brian Vallelunga, the visionary CEO of Doppler. Brian shares his compelling journey from early tech innovations to leading multiple startups and eventually founding Doppler, a centralized cloud secret management tool.Brian emphasizes the importance of making security tools enticing for developers, comparing it to making vegetables taste like candy, to boost productivity. His team’s strategy revolves around seamless integration into developers’ workflows, featuring a VS Code extension and automatic syncing akin to Dropbox, enhancing efficiency and ease of use.They explore Doppler's competitive edge and how it partners with major cloud resource managers, making two-click integrations effortless. Brian also discusses their customer-centric development approach and the release of enterprise features like two-person approval and config inheritance, designed for complex organizational needs.Brian's entrepreneurial journey is marked by significant pivots driven by frustration and market demand, rather than strategic planning alone. He shares candid thoughts on the impact of founders and success, cautioning against the allure of celebrity status and emphasizing team contributions.Join them as they dive into insightful discussions on building developer-friendly security tools, the nuances of secret management, and Brian's perspectives on startup growth and innovation. Discover how Doppler is revolutionizing secret management, one integration at a time.SocialsLinkedIn: Brian VallelungaBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

14 Marras 202458min

In today's episode, Michael and Ben discuss peer review, specifically Michael's experiences. Michael explains his unconventional path, starting with advanced math as a child, then struggling with a math-heavy computer science program in college. He pivoted to environmental studies, focusing on side projects and extracurriculars. These projects led to his first job, and later to a role at a boxing streaming service (2B) with a rigorous peer review process. Ben asks about the importance of the peer review process, and Michael highlights its value in catching errors and ensuring code quality, especially when working under pressure. Moreover, Ben discusses the learning experience at different career stages, noting that junior developers learn from senior developers' code and feedback. Ben discusses the differences in peer review for different types of code changes. They discuss the importance of thorough review for critical code changes and many more!SocialsLinkedIn: Ben WilsonLinkedIn: Michael Berk Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

7 Marras 20241h 8min

In today's episode, Ben and Michael discuss how to handle situations involving individuals lacking expertise in machine learning projects. They explore scenarios where a team lacks expertise, considering approaches for consultants or team members. They discuss various personality types encountered in such situations, including those overly suspicious or resistant to change. Moreover, they discuss how to convince a boss that a proposed project is a bad idea, suggesting a structured approach with clear estimates, risk assessment, and alternative solutions. They emphasize the importance of honesty, transparency, and presenting options with clear pros and cons. The discussion then returns to the Gen AI time-series case study, suggesting a presentation of multiple options, including established algorithms and the Gen AI approach, to facilitate a data-driven decision.Finally, the episode addresses the scenario of a teammate being untrained about a system they built, suggesting a combination of direct but constructive feedback and a collaborative approach to identify the root cause of the issue.SocialsLinkedIn Ben WilsonLinkedIn Michael BerkBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

31 Loka 20241h 16min

In this episode, Michael and Ben dive deep into the intersection of education and technology with their insightful guest, Daniel Hiterer.Michael, a data engineering and machine learning expert, and Ben, an integrator of Gen AI tools, navigate through Danny's unique perspective on the impact of nurturing educational environments. Currently working at Cornell’s Studio entrepreneurship program, Danny brings a multidisciplinary background, combining history and instructional technology, and shares his vision for the future of learning.This episode explores the transformative power of nurture in education, the evolving role of Gen AI in fostering curiosity, and the challenges and opportunities in integrating AI into the learning process. Danny provides thought-provoking insights on emotional access points, curiosity-driven learning, and the delicate balance between educational goals and productivity tools.Listen in as they discuss personalized education, the promise of AI-assisted learning, and the future trajectory of superintelligence in education. Plus, hear personal anecdotes from Ben and Michael about their own learning journeys and the evolving landscape of curiosity and knowledge.SocialsLinkedIn: Daniel HitererBecome a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

24 Loka 20241h 8min

Today, they dive deep into the fascinating intersection of open-source development and machine learning.  Michael and Ben are joined by distinguished guest, Görkem Erkan, CTO and seasoned engineer at Jozu.Görkem shares his illustrious career journey from Nokia to Red Hat, his contributions to the Eclipse Foundation, and his current focus on MLOps. They explore his passion for open-source projects, the cultural and communication impacts on software design, and the unique challenges posed by integrating open-source frameworks with proprietary systems. Ben provides critical insights on the complexities of managing scalable backend services and the hurdles in translating SaaS offerings to open-source platforms.Tune in to learn about the innovative practices at Jozu, the role of open communication in team success, and the nuanced debate on maintaining separate proprietary and open-source codebases. This episode is packed with valuable lessons for developers, tech leaders, and anyone interested in the future of machine learning and open-source development. SocialsLinkedIn: Görkem Ercan Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

17 Loka 20241h 2min