InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
Relational Data at the Edge
Justin Kwan and Vignesh Ravichandran discuss Cloudflare’s edge database architecture, unique challenges and practices for data replication, failover and recovery, and custom performance techniques.
/presentations/cloudflare-edge-database/en/mediumimage/JustinKwanVigneshRavichandran-medium-1711534097169.jpg)
-
Redesigning OLTP for a New Order of Magnitude
Joran Greef discusses TigerBeetle, a new database, and why OLTP has a growing impedance mismatch, why the OLTP workload is becoming more contentious, why row locks, why storage faults, write stalls.
/presentations/redesign-oltp/en/mediumimage/JoranGreef-medium-1710241211897.jpg)
-
Enabling Remote Query Execution through DuckDB Extensions
Stephanie Wang focuses on DuckDB’s extension model, and on query execution and planning, which is a use case of this DuckDB extension model.
/presentations/DuckDB-extensions/en/mediumimage/StephanieWang-mediu-1709638545233.jpg)
-
Multi-Region Data Streaming with Redpanda
Michał Maślanka introduces the design of Redpanda’s Multi-Region feature, and describes how they leveraged Raft’s properties, a constraint solver, automatic data balancing, and tiered storage.
/presentations/redpanda-raft/en/mediumimage/MichałMaślanka-medium-1709028430357.jpg)
-
In-Process Analytical Data Management with DuckDB
Hannes Mühleisen discusses DuckDB, an analytical data management system that is built for an in-process use case. DuckDB speaks SQL, is integrated as a library, and uses query processing techniques.
/presentations/duckdb/en/mediumimage/HannesMühleisen-medium-1708430227541.jpg)
-
Going beyond the Case of Black Box AutoML
Kiran Kate covers the basics of AutoML and then presents Lale (https://github.com/IBM/lale), an open-source scikit-learn compatible AutoML library which implements Gradual AutoML.
/presentations/automl-lale/en/mediumimage/KiranKate-medium-1707823246301.jpg)
-
Graph Learning at the Scale of Modern Data Warehouses
Subramanya Dulloor outlines an approach to addressing the challenges of warehouses and shows how to build an efficient and scalable end-to-end system for graph learning in data warehouses.
/presentations/warehouse-graph-data/en/mediumimage/SubramanyaDulloor-medium-1706611576282.jpg)
-
How Netflix Ensures Highly-Reliable Online Stateful Systems
Joseph Lynch discusses the architecture of Netflix's stateful caches and databases, including how they capacity plan, bulkhead, and deploy software to their global, full-active, data topology.
/presentations/netflix-stateful-cache/en/mediumimage/JosephLynch-medium-1707229310588.jpg)
-
PRQL: a Simple, Powerful, Pipelined SQL Replacement
Aljaž Mur Eržen discusses PRQL, a language that can be compiled to most SQL dialects, which makes it portable and reusable, important factors of OLAP.
/presentations/PRQL/en/mediumimage/AljažMurEržen-medium-1706775748156.jpg)
-
Ephemeral Execution is the Future of Computing, but What about the Data?
Jerop Kipruto and Christie Warwick use Tekton to explore challenges of data gravity in ephemeral execution, discussing clean container injection mechanisms and a secure server interface.
/presentations/tekton-data/en/mediumimage/JeropKiprutoChristieWarwick-medium-1706604937722.jpg)
-
Simplifying Real-Time ML Pipelines with Quix Streams
Tomáš Neubauer discusses Quix Streams, an open-source Python library that helps data scientists and ML engineers to build real-time ML pipelines.
/presentations/quix/en/mediumimage/TomášNeubauer-medium-1705999549605.jpg)
-
Improve Feature Freshness in Large Scale ML Data Processing
Zhongliang Liang covers the impact of feature freshness on model performance, discussing various strategies and techniques that can be used to improve feature freshness.
/presentations/feature-freshness-data-ml/en/mediumimage/ZhongliangLiang-medium-1705421884922.jpg)