Sid Anand on Building Agari’s Cloud-native Data Pipelines with AWS Kinesis and Serverless

Sid Anand on Building Agari’s Cloud-native Data Pipelines with AWS Kinesis and Serverless

Wesley Reisz talks to Sid Anand, a data architect at cybersecurity company Agari, about building cloud-native data pipelines. The focus of their discussion is around a solution Agari uses that is built from Amazon Kinesis Streams, serverless functions, and auto scaling groups. Sid Anand is an architect at Agari, and a former technical architect at eBay, Netflix, and LinkedIn. He has 15 years of data infrastructure experience at scale, is a PMC for Apache Airflow, and is also a program committee chair for QCon San Francisco and QCon London. Why listen to this podcast - Real-time data pipeline processing is very latency sensitive - Micro-batching allows much smaller amounts of data to be processed - Use the appropriate data store (or stores) to support the use of the dataIngesting data quickly into a clean database with minimal indexes can be fast - Communicate using a messaging system that supports schema evolution More on this: Quick scan our curated show notes on InfoQ http://bit.ly/2rJU9nB You can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. bit.ly/24x3IVq Subscribe: www.youtube.com/infoq Like InfoQ on Facebook: bit.ly/2jmlyG8 Follow on Twitter: twitter.com/InfoQ Follow on LinkedIn: www.linkedin.com/company/infoq Want to see extented shownotes? Check the landing page on InfoQ: http://bit.ly/2rJU9nB

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(386)

Will Agentic AI Bring Fantasia’s Sorcerer's Apprentice to Life?: A Conversation with Tracy Bannon

Will Agentic AI Bring Fantasia’s Sorcerer's Apprentice to Life?: A Conversation with Tracy Bannon

In this podcast, Michael Stiefel spoke to Tracy Bannon about the role of artificial intelligence in software and the attendant risks in the areas of security, software development, and society at larg...

17 Aug 49min

Cloud and DevOps InfoQ Trends Report 2026: AI, Resilience, Platforms, FinOps, and Sovereignty

Cloud and DevOps InfoQ Trends Report 2026: AI, Resilience, Platforms, FinOps, and Sovereignty

In this episode of the podcast, members of the InfoQ editorial staff and friends of InfoQ will discuss current trends in the cloud and DevOps domains as part of our annual trends report. These reports...

12 Aug 50min

WebAssembly on the JVM: Feature Evolution, Performance, and the Transition to Endive

WebAssembly on the JVM: Feature Evolution, Performance, and the Transition to Endive

Andrea Peruffo discusses the evolution of WebAssembly beyond the browser and its growing role on the server-side JVM. He covers performance advancements in Wasm runtimes, moving from interpreters to e...

3 Aug 34min

Rethinking Data: Moving From the Traditional Three-Tier Web Stack to Client-Side Event Sourcing

Rethinking Data: Moving From the Traditional Three-Tier Web Stack to Client-Side Event Sourcing

Johannes Schickling explores how he moved beyond the traditional three-tier web stack to a local-first approach. He shares his experience transitioning from Prisma to developing Overtone—a music curat...

27 Juli 43min

Strands Agents with Clare Liguori

Strands Agents with Clare Liguori

In this episode, Thomas Betts talks with Clare Liguori, the technical lead on the open source Strands Agents SDK. The conversation covers how Strands Agents has grown from a Python SDK to a full agent...

20 Juli 38min

Governance in the Age of AI: A Conversation with Sarah Wells

Governance in the Age of AI: A Conversation with Sarah Wells

In this podcast Michael Stiefel spoke to Sarah Wells about the relationship of governance to software architecture. Governance enables teams to work effectively by establishing procedures that minimiz...

13 Juli 48min

Spite-Driven Engineering: A New Blueprint for Cloud Security in the AI Native Era

Spite-Driven Engineering: A New Blueprint for Cloud Security in the AI Native Era

In this episode, Alex Zenla (CTO/Co-founder, Edera) challenges the "laissez-faire" attitude toward modern infrastructure. She promotes "spite-driven development", building software to solve genuine te...

6 Juli 40min

Architectural Patterns: Moving Beyond Cloud-Native to Local-First - Insights from Adam Wiggins

Architectural Patterns: Moving Beyond Cloud-Native to Local-First - Insights from Adam Wiggins

In this episode, Heroku co-founder and Ink & Switch founder Adam Wiggins argues for a 'local-first' architecture that reconciles cloud-based collaboration with the performance and data ownership of lo...

29 Juni 38min

Populärt inom Teknik

uppgang-och-fall
market-makers
rss-elektrikerpodden
rss-laddstationen-med-elbilen-i-sverige
skogsforum-podcast
 och-bilen-gar-bra
rss-en-ai-till-kaffet
rss-uppgang-och-fall
bli-saker-podden
rss-technokratin
hej-bruksbil
bilar-med-sladd
gubbar-som-tjotar-om-bilar
rss-veckans-ai
under-femton
klocksnack-tillsammans-med-nymans-ur-1851
rss-milpodden
bosse-bildoktorn-och-hasse-p
elbilsveckan
natets-morka-sida