InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
Multi-Region Data Streaming with Redpanda
Michał Maślanka introduces the design of Redpanda’s Multi-Region feature, and describes how they leveraged Raft’s properties, a constraint solver, automatic data balancing, and tiered storage.
/presentations/redpanda-raft/en/mediumimage/MichałMaślanka-medium-1709028430357.jpg)
-
In-Process Analytical Data Management with DuckDB
Hannes Mühleisen discusses DuckDB, an analytical data management system that is built for an in-process use case. DuckDB speaks SQL, is integrated as a library, and uses query processing techniques.
/presentations/duckdb/en/mediumimage/HannesMühleisen-medium-1708430227541.jpg)
-
Going beyond the Case of Black Box AutoML
Kiran Kate covers the basics of AutoML and then presents Lale (https://github.com/IBM/lale), an open-source scikit-learn compatible AutoML library which implements Gradual AutoML.
/presentations/automl-lale/en/mediumimage/KiranKate-medium-1707823246301.jpg)
-
Graph Learning at the Scale of Modern Data Warehouses
Subramanya Dulloor outlines an approach to addressing the challenges of warehouses and shows how to build an efficient and scalable end-to-end system for graph learning in data warehouses.
/presentations/warehouse-graph-data/en/mediumimage/SubramanyaDulloor-medium-1706611576282.jpg)
-
How Netflix Ensures Highly-Reliable Online Stateful Systems
Joseph Lynch discusses the architecture of Netflix's stateful caches and databases, including how they capacity plan, bulkhead, and deploy software to their global, full-active, data topology.
/presentations/netflix-stateful-cache/en/mediumimage/JosephLynch-medium-1707229310588.jpg)
-
PRQL: a Simple, Powerful, Pipelined SQL Replacement
Aljaž Mur Eržen discusses PRQL, a language that can be compiled to most SQL dialects, which makes it portable and reusable, important factors of OLAP.
/presentations/PRQL/en/mediumimage/AljažMurEržen-medium-1706775748156.jpg)
-
Ephemeral Execution is the Future of Computing, but What about the Data?
Jerop Kipruto and Christie Warwick use Tekton to explore challenges of data gravity in ephemeral execution, discussing clean container injection mechanisms and a secure server interface.
/presentations/tekton-data/en/mediumimage/JeropKiprutoChristieWarwick-medium-1706604937722.jpg)
-
Simplifying Real-Time ML Pipelines with Quix Streams
Tomáš Neubauer discusses Quix Streams, an open-source Python library that helps data scientists and ML engineers to build real-time ML pipelines.
/presentations/quix/en/mediumimage/TomášNeubauer-medium-1705999549605.jpg)
-
Improve Feature Freshness in Large Scale ML Data Processing
Zhongliang Liang covers the impact of feature freshness on model performance, discussing various strategies and techniques that can be used to improve feature freshness.
/presentations/feature-freshness-data-ml/en/mediumimage/ZhongliangLiang-medium-1705421884922.jpg)
-
The Rise of the Serverless Data Architectures
Gwen Shapira explores the implications of serverless workloads on the design of data stores, and the evolution of data architectures toward more flexible scalability.
/presentations/serverless-data-architectures/en/mediumimage/GwenShapira-medium-1705421033456.jpg)
-
Amazon DynamoDB Distributed Transactions at Scale
Akshat Vig explains how transactions were added to Amazon DynamoDB using a timestamp-based ordering protocol to achieve low latency for both transactional and non-transactional operations.
/presentations/dynamodb-transactions/en/mediumimage/medium-1704799657381.jpg)
-
Responsible AI: from Principle to Practice!
Mehrnoosh Sameki discusses Responsible AI best practices to apply in a machine learning lifecycle and shares open source tools to incorporate to implement Responsible AI in practice.
/presentations/responsible-ai/en/mediumimage/MehrnooshSameki-medium-1702376946205.jpg)