InfoQ Homepage ElasticSearch Content on InfoQ
-
Netflix Builds a Custom High-Throughput Priority Queue Backed by Redis, Kafka and Elasticsearch
Netflix recently published how it built Timestone, a custom high-throughput, low-latency priority queueing system. They built it using open-source components such as Redis, Apache Kafka, Apache Flink and Elasticsearch. Engineers state that they made Timestone since they could not find an off-the-shelf solution that met all of its requirements.
-
Content Discovery at Scale with Hexagons and Elasticsearch at DoorDash
DoorDash recently published an article on how it is solving scaling challenges with content discovery using Elasticsearch and H3, a geospatial indexing system that partitions the world into hexagonal cells.
-
Netflix Studio Search: Using Elasticsearch and Apache Flink to Index Federated GraphQL Data
Netflix engineers recently published how they built Studio Search, using Apache Kafka streams, an Apache Flink-based Data Mesh process, and Elasticsearch to manage the index. They designed the platform to take a portion of Netflix's federated GraphQL graph and make it searchable. Today, Studio Search powers a significant portion of the user experience for many applications within the organisation.
-
Amazon OpenSearch Adds Anomaly Detection for Historical Data
Amazon OpenSearch recently introduced the support of anomaly detection for historical data. The machine learning based feature helps identifying trends, patterns, and seasonality in OpenSearch data.
-
Elastic Releases Terraform Providers for the Elastic Stack and Elastic Cloud
Elastic has released their official Terraform provider for configuring the Elastic Stack. The provider enables configuring ElasticSearch, Kibana, Fleet, and other Elastic Stack components. This follows closely on their release of the Elastic Cloud Terraform provider.
-
Airbnb Streamlines the Development Process with a Unified Architecture for Collaborative Hosting
Airbnb recently detailed how it designed and built a unified architecture for collaborative hosting. This architecture streamlines the development process of new products, as engineers only need to know about one central framework that will cover all hosting use cases. This framework encapsulates the specific types of collaborative hosting, freeing the engineers from the need to worry about them.
-
AWS Renames Amazon Elasticsearch Service to Amazon OpenSearch Service
Recently AWS announced that it would rename Amazon Elasticsearch Service to Amazon OpenSearch Service. With the renaming, the company releases the service with OpenSearch 1.0 support and makes it the successor to Amazon Elasticsearch Service.
-
ElasticSearch Fork OpenSearch is Generally Available
Amazon has recently announced the general availability of OpenSearch 1.0, the Apache 2.0-licensed fork of Elasticsearch that was created after Elastic changed their license.
-
Microsoft and Elastic Partner to Offer Elastic Stack on Azure
Microsoft and Elastic have recently announced Elastic on Azure, a preview service that offers managed Elastic, Logstash, and Kibana to search, analyze, and visualize data in real time on Azure.
-
Amazon Updates Its Elasticsearch Service, Begins Embrace of New Fork
Amazon recently released several enhancements to Amazon Elasticsearch Service. The new capabilities stem from two different sources: Elasticsearch, the project long associated with the service, and Open Distro for Elasticsearch, a new fork.
-
Amazon Forks Elasticsearch Rebranding It as OpenSearch
Amazon recently announced the release of OpenSearch, a fork derived from versions 7.10.2 of ElasticSearch and Kibana. OpenSearch is licensed under the Apache License, V2 (ALv2). Elastic recently made adjustments to their Elastic License to simplify the usage of their code for non-commercial purposes.
-
Amazon Elasticsearch Service Introduces Auto-Tune
Amazon has recently announced the Auto-Tune feature in Amazon Elasticsearch Service, a closed-loop control system that adapts the Elasticsearch cluster to the running workload. The new automated memory management provides better ingestion throughput for log analytics workloads and reduced tail latencies for search queries.
-
AWS Adds Distributed Tracing to Their Elasticsearch Service
Amazon has announced the addition of Trace Analytics to their Amazon Elasticsearch Service. Trace Analytics adds distributed tracing to their service with support for OpenTelemetry. This new feature also integrates with the AWS Distro for OpenTelemetry.
-
Pinterest Describes an Architecture for Efficient Retrieval of Hierarchical Documents
In a recent blog post, Pinterest engineers describe how they implemented an efficient two-stage retrieval architecture to retrieve hierarchical documents in a home-grown search engine. They accomplished it by combining index flattening, index normalization, and index denormalization.
-
Elastic Changes Licences for Elasticsearch and Kibana: AWS Forks Both
Elastic recently announced licensing changes to Elasticsearch and Kibana, with the company moving away from Apache 2.0 and adopting the Server Side Public License (SSPL) and the Elastic License. Amazon reacted with a plan to maintain a fork of both Elasticsearch and Kibana under the previous license.