BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Register Sign in

Unlock the full InfoQ experience

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources.

Log In

or

Don't have an InfoQ account?

Stay updated on topics and peers that matter to youReceive instant alerts on the latest insights and trends.
Quickly access free resources for continuous learningMinibooks, videos with transcripts, and training materials.
Save articles and read at anytimeBookmark articles to read whenever youre ready.

Logo - Back to homepage

News Articles Presentations Podcasts Guides

Topics

Development

Featured in Development

How to Use Apache Spark to Craft a Multi-Year Data Regression Testing and Simulations Framework

Vivek Yadav, an engineering manager from Stripe, shares his experience in building a testing system based on multi-year worth of data. He shares insights into why Apache Spark was the choice for creating such a system and how it fits in the "traditional" engineering practices.

All in development

Architecture & Design

Featured in Architecture & Design

Spec Driven Development: When Architecture Becomes Executable

Spec-Driven Development inverts traditional architecture by making specifications executable and authoritative. It transforms declared intent into validated code through AI generation and provides architectural determinism. It eliminates drift through continuous enforcement, but demands new engineering discipline in schema design and contract-first reasoning.

All in architecture-design

AI Infrastructure

Featured in AI, ML & Data Engineering

Somtochi Onyekwere on Distributed Data Systems, Eventual Consistency and Conflict-free Replicated Data Types

In this podcast, InfoQ spoke with Somtochi Onyekwere on recent developments in distributed data systems, how to achieve fast, eventually consistent replication across distributed nodes, and how Conflict-free Replicated Data Type (CRDTs) can help with conflict resolution when managing data.

All in ai-ml-data-eng

Culture & Methods

Featured in Culture & Methods

Holistic Engineering: Organic Problem Solving for Complex Evolving Systems

Vanessa Formicola discusses how "invisible" forces shape our code and architecture. She shares patterns like "Cirque du Soleil coding" and "Shared Kitchen Sinks," explaining why technical problems often have social roots. Architects and leaders will learn how to use Social Decision Records (SDRs) and holistic modeling to make the implicit explicit and drive success.

All in culture-methods

DevOps

Featured in DevOps

Platform-as-a-Product: Declarative Infrastructure for Developer Velocity

Declarative infrastructure config hides complexity, enabling developers to focus on application code. Unified YAML per service allows early cost validation, while independent CI with centralized CD balances team autonomy and deployment consistency. This standardized approach scales across organizations, making infrastructure invisible and operations automatic.

All in devops

Events

Helpful links

Choose your language

InfoQ Architect Certification

Join Luca Mezzalira for this 5-week online cohort. Master socio-technical architecture leadership.

Save your spot.

QCon London 2026

Learn what works in AI, architecture, data, security & FinTech.

Early Bird ends Jan 13.

Learn how leading engineering teams run AI in production—reliably, securely, and at scale.

Early Bird ends Jan 13.

InfoQ Homepage Interviews Chris Mattmann on Big Data Infrastructure for Scientific Data Processing

Chris Mattmann on Big Data Infrastructure for Scientific Data Processing

Download

19:59

Bio

Chris Mattmann has a wealth of experience in software design, and in the construction of large-scale data-intensive systems. His work has infected a broad set of communities, ranging from helping NASA unlock data from its next generation of earth science system satellites, all the way to helping industry and open source as a member and Director at the Apache Software Foundation.

About the conference

Software is Changing the World. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.

Apr 15, 2014

BT