InfoQ Homepage Distributed Programming Content on InfoQ
-
Microsoft Releases DeepSpeed-FastGen for High-Throughput Text Generation
Microsoft has announced the alpha release of DeepSpeed-FastGen, a system designed to improve the deployment and serving of large language models (LLMs). DeepSpeed-FastGen is the synergistic composition of DeepSpeed-MII and DeepSpeed-Inference . DeepSpeed-FastGen is based on the Dynamic SplitFuse technique. The system currently supports several model architectures.
-
A Distributed System is Knowable: an Impossible Thing for Developers
Failure in distributed systems is normal. Distributed systems can provide only two of the three guarantees in consistency, availability, and partition tolerance. According to Kevlin Henney, this limits how much you can know about how a distributed system will behave. He gave a keynote about Six Impossible Things at QCon London 2022 and at QCon Plus May 10-20, 2022.
-
Swift Experimentally Introduces Support for Distributed Actors
The new Swift Distributed Actors package provides a glimpse into what the future distributed actor language feature could look like in Swift.
-
Jolie - a Service-Oriented Programming Language for Distributed Applications
The Jolie programming language recently attracted the attention of developers on Hacker News. Jolie is a service-oriented language that encourages developers to model distributed software as composable services whose orchestration is described separately from communication protocols (SOAP, HTTP, XML-RPC) and deployment architecture. Jolie adopts services as a first-class concept.
-
How Dropbox Created a Distributed Async Task Framework at Scale
Engineers at Dropbox designed a distributed async task framework (ATF) that can handle tens of thousands of async tasks scheduled per second. ATF's main feature is its ability to enable developers to define callbacks and schedule tasks that execute against these pre-defined callbacks.
-
Rust 1.46.0 Released
The latest Rust stable release, 1.46.0, extends the number of core language constructs that are allowed in const fn. Also, a couple of features are stabilised.
-
Concurnas: the New Language on the JVM for Concurrent and GPU Computing
Concurnas is a new open source JVM programming language designed for building concurrent and distributed systems. Concurnas is a statically typed language with object oriented, functional, and reactive programming constructs. With native support for GPU computing and vectorization, Concurnas allows for building machine learning applications and high performance parallel applications.
-
Bringing Blockchain Developer Tools to the Enterprise, Truffle and Microsoft Announce Partnership
In a recent blogpost, Microsoft and Truffle announced a partnership to bring blockchain developer tools and experiences to the Microsoft Azure ecosystem. The investments the organizations are making include local blockchain nodes for testing, with test data, smart contract authoring and continuous deployment, debugging and testing.
-
Hazelcast Releases Jet 0.6 for Stream and Fast Batch Processing
Hazelcast, maker of distributing computing technologies and tools, have released a new major version (version 0.6) of Jet, their open-source streaming processing engine.
-
Q&A with Kubernetes Founder Brendan Burns on Containers and Distributed System Patterns
InfoQ caught up with Brendan Burns, author of Designing Distributed Systems, Patterns and Paradigms for Scaleable Microservices. He talks about Distributed Systems patterns and how Containers enable it.
-
Concurrent and Distributed Programming in the Future
The world is concurrent with everything around us asynchronous and event oriented. Concurrency and the cloud are things every developer will have to deal with in the future, Joe Duffy claimed in his keynote at the recent QCon London conference. At the heart of this is communication, which is essential both for concurrent and distributed systems.
-
Apache Eagle, Originally from eBay, Graduates to top-level project
Apache Eagle, an open-source solution for identifying security and performance issues on big data platforms, graduates to Apache top level project on January 10, 2017. Firstly open-sourced by eBay on October 2015, Eagle was created to instantly detect access to sensitive data or malicious activities and, to take actions in a timely fashion.
-
Julien Nioche on StormCrawler, Open-Source Crawler Pipelines Backed by Apache Storm
Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.
-
Q&A on Akka.NET 1.1 with Aaron Stannard
Akka.NET 1.1 was recently released, bringing new features and performance improvements. InfoQ reached out to Aaron Stannard, maintainer of Akka.net, to learn more about Akka.Streams and Akka.Cluster. Stannard also explains how the roadmap is planned with regards to the JVM implementation of Akka.
-
Apache Storm Reaches 1.0, Brings Improved Performance, Many New Features
Version 1.0 is "a major milestone in the evolution of Apache Storm", writes Apache Software Foundation VP for Apache Storm P. Taylor Goetz, and it includes many new features and improvements. In particular, Goetz claims a 3x–16x boost in performance.