InfoQ Homepage OpenSearch Content on InfoQ
-
Amazon S3 Vectors Reaches GA, Introducing "Storage-First" Architecture for RAG
AWS has announced the general availability of Amazon S3 Vectors, increasing per-index capacity forty-fold to 2 billion vectors. By natively integrating vector search into the S3 storage engine, the service introduces a "Storage-First" architecture that decouples compute from storage, reducing total cost of ownership by up to 90% for large-scale RAG workloads.
-
Uber Adopts Amazon OpenSearch for Semantic Search to Better Capture User Intent
To improve search and recommendation user experiences, Uber migrated from Apache Lucene to Amazon OpenSearch to support large-scale vector search and better capture search intent. This transition introduced several infrastructure challenges, which Uber engineers addressed with targeted solutions.
-
AWS Introduces Vector Capabilities on Amazon S3
At the recent AWS Summit in New York City, AWS announced the preview of Amazon S3 Vectors, claiming to be the first cloud object store with native support for storing large vector datasets. The new option offers subsecond query performance, reducing the cost of storing AI-ready data compared to traditional vector databases.
-
OpenSearch 3.0 Now Generally Available, with a Focus on Vector Database Performance and Scalability
The OpenSearch Software Foundation has announced the general availability of OpenSearch 3.0, the first major release in three years and the first since the project joined the Linux Foundation. This version introduces native support for the Model Context Protocol (MCP), along with pull-based data ingestion and gRPC support, aimed at improving scalability and integration.
-
Scaling OpenSearch Clusters for Cost Efficiency Talk by Amitai Stern at QCon San Francisco
Amitai Stern, engineering manager at Logz.io and OpenSearch Leadership Committee member delivered practical insights on efficient OpenSearch cluster management at QCon San Francisco. His session highlighted strategies for scaling effectively amidst fluctuating workloads, focusing on optimal shard management and resource allocation to minimize costs without compromising performance.
-
Elastic Returns to Open Source: Will the Community Follow?
In a surprising move for both the open-source and Elastic communities, Shay Banon, founder and CEO of Elastic, recently announced that Elasticsearch and Kibana will once again be open source. The two products will soon be licensed under the AGPL, an OSI-approved license.
-
Netflix Uses Elasticsearch Percolate Queries to Implement Reverse Searches Efficiently
Netflix engineers recently published how they use Elasticsearch Percolate Queries to "reverse search" entities in a connected graph. Reverse search means that instead of searching for documents that match a query, they search for queries that match a document, powering dynamic subscription scenarios where there is no direct association between the subscriber and the subscribed entities.
-
Amazon OpenSearch Zero ETL with S3 and New OR1 Instances
Amazon has announced the preview of the Amazon OpenSearch Service's zero-extraction, transformation, and loading (ETL) integration with Amazon S3, offering a novel method to analyze operational logs in Amazon S3 and S3-based data lakes without the need to switch between services. Amazon also announced the new OR1 instances for Amazon OpenSearch Service.
-
Vector Engine for Amazon Opensearch Serverless Now in Preview
AWS announced the preview release of vector storage and search capability within Amazon OpenSearch Serverless. The capability is intended to support machine learning augmented search experiences and generative AI applications.
-
AWS Adds Multi-AZ with Standby Support to OpenSearch Service
OpenSearch Service recently introduced support for Multi-AZ with Standby, a new deployment option for the search and analytics engine that provides 99.99% availability and better performance for business-critical workloads.
-
AWS Announces Amazon OpenSearch Ingestion for Streamlined Data Ingestion
AWS recently announced Amazon OpenSearch Ingestion, a capability of Amazon OpenSearch Service that provides a serverless, auto-scaled, managed data collector that receives, transforms, and delivers data to Amazon OpenSearch Service domains or Amazon OpenSearch Serverless collections.
-
Amazon OpenSearch Service Introduces Security Analytics
Amazon recently announced the general availability of security analytics for OpenSearch Service. The new capability of the successor of ElasticSearch Service provides threat monitoring, detection, and alerting features to help manage security threats.
-
AWS OpenSearch Serverless Now Generally Available
Amazon recently announced the general availability of OpenSearch Serverless, a new serverless option for Amazon OpenSearch service, which automatically provisions and scales the underlying resources for faster data ingestion and query responses.
-
Amazon Announces Preview of OpenSearch Serverless
AWS recently announced the preview of OpenSearch Serverless, a new option of OpenSearch service that automatically provisions and scales the resources for data ingestion and query responses. The minimum capacity required for the serverless option raised some concerns in the community.
-
Amazon OpenSearch Adds Anomaly Detection for Historical Data
Amazon OpenSearch recently introduced the support of anomaly detection for historical data. The machine learning based feature helps identifying trends, patterns, and seasonality in OpenSearch data.