InfoQ Homepage Event Stream Processing Content on InfoQ
-
Infinite Storage & Retention for Apache Kafka in Confluent Cloud
Confluent, Inc. recently announced the Infinite Storage option for its standard and dedicated clusters. This offering is a part of the Project Metamorphosis initiative, which is focused on enabling Kafka with modern cloud properties. Organizations can have a centralized platform for all event data for real-time actioning and historical analysis with limitless storage and retention.
-
CamundaCon Live 2020: Highlights
Earlier this year, Camunda hosted CamundaCon, an online conference on process automation revolving around Camunda's open-source products. The conference featured multiple use-case sessions on process automation, virtual panels on automation and digital transformation, and technical sessions on microservices orchestration and integrating Camunda products with other technologies.
-
Amazon EventBridge Schema Registry Now Generally Available on AWS
Recently Amazon announced the general availability of the Schema Registry capability in the Amazon EventBridge service. With Amazon EventBridge Schema Registry, developers can store the event structure - or schema - in a shared central location and map those schemas to code for Java, Python, and Typescript, meaning that they can use events as objects in their code.
-
KSQL Now Available on Confluent Cloud
KSQL is the streaming SQL engine for Apache Kafka, and it is currently available as a fully-managed service on the Confluent Cloud Platform for all its customers on usage-based billing plans. In a recent blog post, Confluent announced the availability of Confluent Cloud KSQL.
-
Confluent Offers Apache Kafka as a Service on the Azure Marketplace
In a recent blog post, Confluent announced the general availability of Confluent Cloud on Microsoft Azure. Confluent Cloud is a fully managed Apache Kafka service that removes the burden of operationally managing Kafka for engineers.
-
Experience Using Event Streams, Kafka and the Confluent Platform at Deutsche Bahn
To provide trip information to their rail passengers, Deutsche Bahn (DB) has created the RI-Plattform (Passenger Information Application) based on Apache Kafka and Kafka Streams with a plan to feed all information channels through the system. In a blog post, Axel Löhn and Uwe Eisele describe the microservices based design, how they build and run the system, and their experience from production.
-
Change Data Capture Tool Debezium 1.0 Final Released
The open source change data capture (CDC) tool Debezium 1.0 Final was recently released with an event format clean-up, increased test coverage of databases, and 96 issues addressed. In a blog post Gunnar Morling describes Debezium's basic concepts and some common use cases, and details about both the current release and what to expect in future releases.
-
Confluent Offers Apache Kafka as a Service on the GCP Marketplace
In a recent blog post, Confluent announced the general availability of Confluent Cloud on the Google Cloud Platform (GCP) Marketplace. Confluent Cloud is a fully managed Apache Kafka service, which removes the burden of its users to manage Kafka themselves.
-
Experience Running Spotify’s Event Delivery System in the Cloud
Event delivery is a key component at Spotify; the events contain important data about users, actions they take, and operational logs. After running the event delivery system in the cloud for 2 ½ years, Bartosz Janota and Robert Stephenson have written a blog post discussing what they have achieved and how they have been able to evolve and simplify the system by moving up the stack in the cloud.
-
Pull Queries and Connector Management Added to ksqlDB (KSQL) Event Streaming Database for Kafka
The new release of KSQL, an event streaming database for Kafka, includes pull queries to allow for data to be read at a specific point in time using a SQL syntax, and connector management that enables direct control and execution of connectors built to work with Kafka Connect. The Confluent team behind KSQL believes it's a significant release, and has decided to rename the tool to ksqlDB.
-
Recap of AWS re:Invent 2019
Last week in Las Vegas, AWS held their annual re:Invent conference and unveiled a slew of new products, while updating many existing ones. Here's a review of announcements impacting compute, data and storage, app integration, networking, machine learning, identity management, enterprise services, and development.
-
Ahead of re:Invent, Amazon Updates AWS Lambda
A series of updates to AWS Lambda aim to improve how the function-as-a-service platform handles asynchronous workflows and processes data streams. These newly announced features arrived the week before the annual mega-conference, AWS re:Invent.
-
Jay Kreps: Events, Event Streams and Their Importance in a Digital Business
Organizations are moving more and more processes into software, Jay Kreps notes in a blog post, and adds that in an accompanying change businesses are increasingly defined in software – the core processes are specified and executed in software. To support this transition, he believes we have to move away from traditional databases into working with the concepts of events and events streams.
-
Delta – a Data Synchronization and Enrichment Platform by Netflix
Large systems often utilize numerous data stores. There is sometimes a need to keep some of these data stores in sync, and to enrich data in a store by calling external services. To address these needs, Netflix has created Delta, an eventual consistent, event-driven data synchronization and enrichment platform. In a blog post, the team behind Delta gives an overview of their design.
-
Oleg Zhurakousky on Spring Based Event-Driven Microservices
Spring Cloud Stream and Spring Cloud Function technologies support the implementation of event-driven microservices for diverse use cases, ranging from application integration to data streaming. Oleg Zhurakousky, project lead for Spring Cloud Stream and Spring Cloud Function, spoke at SpringOne Platform 2019 Conference about the recent developments and features in both of these projects.