InfoQ Homepage Scalability Content on InfoQ

Articles

RSS Feed

Newer Older

Architecture & Design

Architecting for High Availability in the Cloud with Cellular Architecture

Cellular architecture is a design pattern that helps achieve high availability in multi-tenant applications. The goal is to design your application so that you can deploy all of its components into an isolated "cell" that is fully self-sufficient. It can benefit your customers regarding availability and ensure you hit your SLAs.

Chris Price
on Mar 22, 2024
AI, ML & Data Engineering

Design Pattern Proposal for Autoscaling Stateful Systems

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator.

Rogerio Robetti
on Jan 25, 2023
Development

Build, Test, and Deploy Scalable REST APIs in Go

In this article, we'll look at how to use the gin framework to create a simple Go application. We will also learn how to use CircleCI, a continuous deployment tool, to automate testing and deployment.

Oghenevwede Emeni
on Nov 02, 2022
Architecture & Design

Building & Operating High-Fidelity Data Streams

At QCon Plus 2021 last November, Sid Anand, chief architect at Datazoom and PMC Member at Apache Airflow, presented on building high-fidelity nearline data streams as a service within a lean team. In this talk, Anand provides a master class on building high-fidelity data streams from the ground up.

Sid Anand
on Sep 30, 2022
Cloud

A Recipe to Migrate and Scale Monoliths in the Cloud

In this article, I want to present a simple cloud architecture that can allow an organization to take monolithic applications to the cloud incrementally without a dramatic change in the architecture. We will discuss the minimal requirements and basic components to take advantage of the scalability of the cloud.

Luciano Mammino
on May 13, 2022
AI, ML & Data Engineering

The Next Evolution of the Database Sharding Architecture

In this article, author Juan Pan discusses the data sharding architecture patterns in a distributed database system. She explains how Apache ShardingSphere project solves the data sharding challenges. Also discussed are two practical examples of how to create a distributed database and an encrypted table with DistSQL.

Trista Pan
on Jan 12, 2022
Development

Picking an Active-Active Geo Distribution Strategy: Comparing Merge Replication and CRDT

Modern distributed applications are fuelling the growing demand for distributed active-active, multi-master databases. While most popular databases support multi-master deployment, different databases employ different techniques. LWW, MVCC, merge replication and CRDTs deliver eventual consistency, offering read and write access with local latency and remaining available during network partitions.

Roshan Kumar
on Jun 12, 2018
Architecture & Design

Microservices and the Economics of Small Things

In this article Mark Burgess explores the process of "decentralizing intent" and the effect it has on the predictability of our systems including what we can know as we scale systems.

Mark Burgess
on May 25, 2018
Development

A Comparison between Rust and Erlang

This article will focus on a comparison between Erlang and Rust, detailing their similarities and differences. It may be interesting to both Erlang developers looking into Rust and Rust developers looking into Erlang. A final section will detail more about each of the language capabilities and shortcomings and argue for the possibility of leveraging both languages' strengths in the same project.

Krishna Kumar Thokala
on Mar 13, 2018
DevOps

Five Lessons Security Can Learn from DevOps

Just as DevOps emerged to meet new business needs, new approaches in security are now needed to address the challenges of a DevOps-driven world. These new security approaches themselves must incorporate DevOps practices that rely on modularity, automation, standardization, auditability, and mirrored systems.

Wei Lien Dang
on Nov 30, 2016
Book Review and Q&A - The Art of Scalability

The Art of Scalability is a book on scaling organisations to adapt to web scale growth of their products and services. As well as having technical and architectural implications, scale needs to be dealt with on the organizational level. The goal is to show the reader how to organize technology, people and processes to result in a virtuous circle, a path of continuous improvement to scalability.

Grischa Ekart
on Aug 16, 2015
Storm Applied Review and Q&A with the Authors

Storm is a distributed, fault-tolerant, real-time computation system that was originally developed at BackType and later open sourced by Twitter. Storm Applied is a new book from Manning that aims to provide a practical guide on using Storm, both in a development and in a production setting. InfoQ has spoken with two of the book’s authors, Sean T. Allen and Matthew Jankowski.

Sergio De Simone
on Jul 27, 2015