InfoQ Homepage Database Content on InfoQ

Articles

RSS Feed

Newer Older

Development

Virtual Panel: the New US-EU Data Privacy Framework

Recent rulings by several European courts have set important precedents for restricting personal data transmission from the EU to the US. As a consequence, the US and EU have started working on a new agreement. In this virtual panel, three knowledgeable experts discuss where the existing agreements fall short, and whether a new privacy agreement could improve the current situation.

Chris McLellan Jeff Jockisch Stephen Bailey Sergio De Simone
on Oct 13, 2022
AI, ML & Data Engineering

How to Migrate an Oracle Database to MySQL Using AWS Database Migration Service

Data migration efforts are typically taken up for database consolidation, cost considerations, or migrating on-prem databases to a cloud platform. In this article, author Deepak Vohra discusses the details of migrating a local database to MySQL database on the cloud, using AWS Database Migration Service.

Deepak Vohra
on Sep 07, 2022
Architecture & Design

Business Systems Integration is about to Get a Whole Lot Easier

A new breed of integration software is arising that syncs business data into a simplified data hub and then syncs that data to the destination system. The benefit of this integration pattern is that it reduces the number of manual transformations required (often to zero) and makes it easier to write manual transformations when you have to.

Doug Hudgeon
on Aug 24, 2022
Architecture & Design

Creating a Secure Distributed Database Cluster Leveraging Your Existing Database Management System

The emergence of Big Data and data lakes doesn't necessarily mean the disappearance of the trusted relational database. The two can coexist, relational databases just need to adjust. For the transition we propose Database Plus, a new technology & concept applicable to any database, that answers these challenges and eliminates switching costs and vendor lock-in.

Trista Pan
on Aug 17, 2022
AI, ML & Data Engineering

API Friction Complicates Hunting for Cloud Vulnerabilities. SQL Makes it Simple

APIs can tell you everything about your cloud infrastructure, but they're hard to use and work in different ways. What if you could write simple SQL queries that call APIs for you and put results into a database? Steampipe, an open-source project that maps APIs to Postgres foreign tables, makes that dream come true. It's hard enough to reason over data. Acquiring it should be easy, and now it is.

Jon Udell
on Jul 06, 2022
DevOps

Embracing Cloud-Native for Apache DolphinScheduler with Kubernetes: a Case Study

This article shares how Apache DolphinScheduler was updated to use a more modern, cloud-native architecture. This includes moving to Kubernetes and integrating with Argo CD and Prometheus. This improves substantially the user experience of deploying, operating, and monitoring DolphinScheduler.

Yang Dian
on Jun 24, 2022
Cloud

Developing a Cloud-Native Application on Microsoft Azure Using Open Source Technologies

Cloud native is a development approach that improves building, maintainability, scalability, and deployment of applications. My intention with this article is to explain, in a pragmatic way, how to build, deploy, run, and monitor a simple cloud-native application on Microsoft Azure using open-source technologies.

Andrea Grillo
on Jun 22, 2022
Cloud

A Recipe to Migrate and Scale Monoliths in the Cloud

In this article, I want to present a simple cloud architecture that can allow an organization to take monolithic applications to the cloud incrementally without a dramatic change in the architecture. We will discuss the minimal requirements and basic components to take advantage of the scalability of the cloud.

Luciano Mammino
on May 13, 2022
AI, ML & Data Engineering

Raft Engine: a Log-Structured Embedded Storage Engine for Multi-Raft Logs in TiKV

In this article, authors discuss the design and implementation of Raft Engine, a log-structured embedded storage engine introduced in TiDB distributed, NewSQL database version 5.4. They also discuss the performance benefits of the engine compared to the previous implementation based on RocksDB.

Xinye Tao Chenhao Huang
on May 12, 2022
Architecture & Design

Designing Secure Tenant Isolation in Python for Serverless Apps

Software as a Service (SaaS) has become a very common way to deliver software today. While providing the benefits of easy access to users without the overhead of having to manage the operations themselves, this flips the paradigm and places the responsibility on software providers for maintaining ironclad SLAs, as well as all of the security and data privacy requirements.

Avichay Attlan
on Apr 20, 2022
Java

Two Must-Have Tools for Jakarta EE Developers

The wildfly-jar-maven-plugin and the brand new wildfly-datasources-preview-galleon-pack from the WildFly project are worthy of your attention. These tools add on-the-fly generation of an Uber JAR including configuration for containerization and datasources, and make it a pleasure to write applications for Jakarta EE and WildFly.

Dennis Gesker
on Apr 01, 2022
Cloud

Data Patterns for the Edge: Data Localization, Privacy Laws, and Performance

With growing competition to get data that power experiences to the end-user closer and closer and the advent of local data privacy laws, let's look at different enterprise data patterns like “synchronous data retrieval”, “subsequent data retrieval” and “prefetch data retrieval” on data center.

Anoop Koloth
on Mar 21, 2022