Artwork

Inhoud geleverd door Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka®. Alle podcastinhoud, inclusief afleveringen, afbeeldingen en podcastbeschrijvingen, wordt rechtstreeks geüpload en geleverd door Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka® of hun podcastplatformpartner. Als u denkt dat iemand uw auteursrechtelijk beschermde werk zonder uw toestemming gebruikt, kunt u het hier beschreven proces https://nl.player.fm/legal volgen.
Player FM - Podcast-app
Ga offline met de app Player FM !

The Present and Future of Stream Processing

31:19
 
Delen
 

Manage episode 424666718 series 2510642
Inhoud geleverd door Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka®. Alle podcastinhoud, inclusief afleveringen, afbeeldingen en podcastbeschrijvingen, wordt rechtstreeks geüpload en geleverd door Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka® of hun podcastplatformpartner. Als u denkt dat iemand uw auteursrechtelijk beschermde werk zonder uw toestemming gebruikt, kunt u het hier beschreven proces https://nl.player.fm/legal volgen.

The past year saw new trends emerge in the world of data streaming technologies, as well as some unexpected and novel use cases for Apache Kafka®. New reflections on the future of stream processing and when companies should adopt microservice architecture inspired several talks at this year’s industry conferences. In this episode, Kris is joined by his colleagues Danica Fine, Senior Developer Advocate, and Robin Moffatt, Principal Developer Advocate, for an end-of-year roundtable on this year’s developments and what they want to see in the year to come.
Robin and Danica kick things off with a discussion of the year’s memorable conferences. Talk submissions for Kafka Summit London and Current 2022 featuring topics were noticeably more varied than previous years, with fewer talks focused on the basics of Kafka implementation. Many abstracts featured interesting and unusual use cases, in addition to detailed explanations on what went wrong and how others could avoid the same issues.
The conferences also made clear that a lot of companies are adopting or considering stream-processing solutions. Are we close to a future where streaming is a part of everything we do? Is there anything helping streaming become more mainstream? Will stream processing replace batch?
On the other hand, a lot of in-demand talks focused on the importance of understanding the best practices supporting data mesh and understanding the nuances of the system and configurations. Danica identifies this as her big hope for next year: No more Kafka developers pursuing quick fixes. “No more band aid fixes. I want as many people as possible to understand the nuances of the levers that they're pulling for Kafka, whatever project they're building.”
Kris and Robin agree that what will make them happy in 2023 is seeing broader, more diverse client libraries for Kafka. “Getting away from this idea that Kafka is largely a Java shop, which is nonsense, but there is that perception.”
Streaming Audio returns in January 2023.
EPISODE LINKS

  continue reading

Hoofdstukken

1. Intro (00:00:00)

2. What's it like being a program chair for conferences? (00:02:30)

3. What data streaming trends emerged from conferences this year? (00:04:14)

4. Is stream processing becoming mainstream? (00:06:28)

5. What KIP features have helped make stream processing more mainstream? (00:08:28)

6. Getting to stage two of Kafka adoption (00:14:08)

7. The future of data mesh (00:18:16)

8. IoT projects (00:22:20)

9. What innovations in stream processing do you hope to see in 2023? (00:26:17)

10. It's a wrap! (00:30:05)

265 afleveringen

Artwork
iconDelen
 
Manage episode 424666718 series 2510642
Inhoud geleverd door Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka®. Alle podcastinhoud, inclusief afleveringen, afbeeldingen en podcastbeschrijvingen, wordt rechtstreeks geüpload en geleverd door Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka® of hun podcastplatformpartner. Als u denkt dat iemand uw auteursrechtelijk beschermde werk zonder uw toestemming gebruikt, kunt u het hier beschreven proces https://nl.player.fm/legal volgen.

The past year saw new trends emerge in the world of data streaming technologies, as well as some unexpected and novel use cases for Apache Kafka®. New reflections on the future of stream processing and when companies should adopt microservice architecture inspired several talks at this year’s industry conferences. In this episode, Kris is joined by his colleagues Danica Fine, Senior Developer Advocate, and Robin Moffatt, Principal Developer Advocate, for an end-of-year roundtable on this year’s developments and what they want to see in the year to come.
Robin and Danica kick things off with a discussion of the year’s memorable conferences. Talk submissions for Kafka Summit London and Current 2022 featuring topics were noticeably more varied than previous years, with fewer talks focused on the basics of Kafka implementation. Many abstracts featured interesting and unusual use cases, in addition to detailed explanations on what went wrong and how others could avoid the same issues.
The conferences also made clear that a lot of companies are adopting or considering stream-processing solutions. Are we close to a future where streaming is a part of everything we do? Is there anything helping streaming become more mainstream? Will stream processing replace batch?
On the other hand, a lot of in-demand talks focused on the importance of understanding the best practices supporting data mesh and understanding the nuances of the system and configurations. Danica identifies this as her big hope for next year: No more Kafka developers pursuing quick fixes. “No more band aid fixes. I want as many people as possible to understand the nuances of the levers that they're pulling for Kafka, whatever project they're building.”
Kris and Robin agree that what will make them happy in 2023 is seeing broader, more diverse client libraries for Kafka. “Getting away from this idea that Kafka is largely a Java shop, which is nonsense, but there is that perception.”
Streaming Audio returns in January 2023.
EPISODE LINKS

  continue reading

Hoofdstukken

1. Intro (00:00:00)

2. What's it like being a program chair for conferences? (00:02:30)

3. What data streaming trends emerged from conferences this year? (00:04:14)

4. Is stream processing becoming mainstream? (00:06:28)

5. What KIP features have helped make stream processing more mainstream? (00:08:28)

6. Getting to stage two of Kafka adoption (00:14:08)

7. The future of data mesh (00:18:16)

8. IoT projects (00:22:20)

9. What innovations in stream processing do you hope to see in 2023? (00:26:17)

10. It's a wrap! (00:30:05)

265 afleveringen

Alle afleveringen

×
 
Loading …

Welkom op Player FM!

Player FM scant het web op podcasts van hoge kwaliteit waarvan u nu kunt genieten. Het is de beste podcast-app en werkt op Android, iPhone en internet. Aanmelden om abonnementen op verschillende apparaten te synchroniseren.

 

Korte handleiding