InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
Data Mesh: an Architectural Deep Dive
Zhamak Dehghani introduces the architecture of new Data Mesh concepts such as data products, as well as the planes of the data platform in support of computational governance and distribution.
-
From Batch to Streams: Building Value from Data In-Motion
Ricardo Ferreira discusses the risks of designing siloed-based systems and how streaming data architectures can become a solution to address competitiveness.
-
Designing Better ML Systems: Learnings from Netflix
Savin Goyal shares lessons learned by Netflix building their ML infrastructure, and some of the tradeoffs to consider when designing or buying a machine learning system.
-
Data-driven Development in the Automotive Field
Toshika Srivastava offers insight into how they in the automotive field are developing products with data and what their challenges are.
-
Designing IoT Data Pipelines for Deep Observability
Shrijeet Paliwal discusses how Tesla deals with large data ingestion and processing, the challenges with IoT data collecting and processing, and how to deal with them.
-
Evolving Analytics in the Data Platform
Blanca Garcia-Gil discusses the BBC’s analytics platform architecture, the failure modes they designed for, and the investigation of the new unknowns and how they automated them away.
-
Scaling & Optimizing the Training of Predictive Models
Nicholas Mitchell presents the core building blocks of an entire toolchain able to deal with challenges of large amounts of data in an industrial scalable system.
-
Using DevEx to Accelerate GraphQL Federation Adoption @Netflix
Paul Bakker and Kavitha Srinivasan discuss how they made certain Build vs Buy (open source) trade-offs and the socio-technical aspects of working with many teams on a single shared schema.
-
Building Latency Sensitive User Facing Analytics via Apache Pinot
Chinmay Soman discusses how LinkedIn, Uber and other companies managed to have low latency for analytical database queries in spite of high throughput.
-
A Functional Tour of Automatic Differentiation
Oliver Strickson discusses automatic differentiation, a family of algorithms for taking derivatives of functions implemented by computer programs, offering the ability to compute gradients of values.
-
BERT for Sentiment Analysis on Sustainability Reporting
Susanne Groothuis discusses how KPMG created a custom sentiment analysis model capable of detecting subtleties, and provides them with a metric indicating the balance of a report.
-
Applying Machine Learning to Financial Payments
Tamsin Crossland discusses how ML can be applied to Payments to respond rapidly to known and emerging patterns of fraud, and to detect patterns of fraud that may not otherwise be identified.