InfoQ Homepage Event Driven Architecture Content on InfoQ
-
Netflix Studio Search: Using Elasticsearch and Apache Flink to Index Federated GraphQL Data
Netflix engineers recently published how they built Studio Search, using Apache Kafka streams, an Apache Flink-based Data Mesh process, and Elasticsearch to manage the index. They designed the platform to take a portion of Netflix's federated GraphQL graph and make it searchable. Today, Studio Search powers a significant portion of the user experience for many applications within the organisation.
-
AWS Increases the Availability and Reliability of Amazon EventBridge with Global Endpoints
Recently, AWS introduced a new capability called global endpoints for its serverless event bus service Amazon EventBridge to improve availability and reliability.
-
Fauna Transactional Database Introduces Event Streaming
Fauna, the company behind the Fauna transactional database, recently announced the general availability of event streaming, a push-based stream that sends changes at both the document and collection levels to subscribed clients.
-
Quine Aims to Simplify Event Processing on Data in Motion
Developed at thatDot, Quine is an open source streaming graph solution aimed at high-volume event processing. Quine combines graph data and streaming technologies to enable the creation of real-time, complex event processing workflows at scale, says thatDot.
-
Google Updates its Eventarc Service with New UI, Event Destination, and Storage Trigger
Recently, Google announced several new features for its eventing platform Eventarc. The new features are a new UI, Cloud Run for Anthos services as an event destination, and a generally available (GA) Storage Cloud trigger.
-
Airbnb Streamlines the Development Process with a Unified Architecture for Collaborative Hosting
Airbnb recently detailed how it designed and built a unified architecture for collaborative hosting. This architecture streamlines the development process of new products, as engineers only need to know about one central framework that will cover all hosting use cases. This framework encapsulates the specific types of collaborative hosting, freeing the engineers from the need to worry about them.
-
AWS Launches Amazon Kinesis Data Streams On-Demand
Amazon Kinesis Data Streams is a fully-managed, serverless service on AWS for real-time processing of streamed data at a massive scale. Recently, the company released a new capacity mode On-demand for the service, which eliminates capacity provisioning and management for streaming workloads.
-
AWS Introduces Amazon S3 Event Notifications with Amazon EventBridge
During the annual re:Invent, AWS introduced Amazon S3 Event Notifications for its serverless event bus service Amazon EventBridge. With S3 notifications, developers can leverage a more reliable and faster “directly wired” model.
-
AWS Step Functions Gains Integrations with over 200 Additional Services
Amazon Web Services (AWS) recently announced that AWS Step Functions supports over 200 AWS services via an AWS SDK integration, thereby expanding the number of supported API actions from 46 to over 9,000. The new integration type can support most existing and future services and API actions going forward.
-
Real-Time Exactly-Once Event Processing at Uber with Apache Flink, Kafka, and Pinot
Uber faced some challenges after introducing ads on UberEats. The events they generated had to be processed quickly, reliably and accurately. These requirements were fulfilled by a system based on Apache Flink, Kafka, and Pinot that can process streams of ad events in real-time with exactly-once semantics. An article describing its architecture was published recently in the Uber Engineering blog.
-
TriggerMesh Cloud Native Integration Platform Released as Open Source
Recently TriggerMesh, a cloud native integration platform provider, announced that their Cloud Native Integration Platform is now open source and available under the Apache Software License 2.0. It allows cloud operators and DevOps practitioners to freely deploy integrations as code.
-
Netflix Builds a Reliable, Scalable Platform with Event Sourcing, MQTT and Alpakka-Kafka
Netflix recently published a blog post detailing how it built a reliable device management platform using an MQTT-based event sourcing implementation. To scale its solution, Netflix utilizes Apache Kafka, Alpakka-Kafka and CockroachDB.
-
Email Classification at Slack: Designing an Eventually Consistent Custom Classifier
Slack recently published the details of how it built an email address classification engine that can determine if an email address is internal or external. Slack engineers utilized an eventually consistent near real-time representation of the data in its system and implemented a drift detection mechanism to fix erroneous data, keeping the engine's operation in order.
-
Microsoft Announces Event Hubs Premium in Preview
Azure Event Hubs is Microsoft’s managed real-time event ingestion service designed to serve demanding big data streaming and event ingestion needs in the Cloud. Microsoft announced the public preview of Event Hubs Premium during the annual Build conference as a new product SKU tailor-made for high-end event streaming scenarios requiring elastic, superior performance with predictable latency.
-
Amazon SNS Gains Message Archiving and Analytics via Amazon Kinesis Data Firehose
Amazon Web Services (AWS) recently announced that Amazon SNS supports Amazon Kinesis Data Firehose subscriptions to send messages to "data lakes, data stores, and analytics services [...] without writing custom code". The new event destination also simplifies the integration of third-party service providers.