InfoQ Homepage News
-
AI and ML Tracks at QCon San Francisco 2024 – a Deep Dive into GenAI & Practical Applications
At QCon San Francisco 2024, explore two AI/ML-focused tracks highlighting real-world applications and innovations. Learn from industry experts on deploying LLMs, GenAI, and recommendation systems, gaining practical strategies for integrating AI into software development.
-
Logic App Standard Hybrid Deployment Model Public Preview: More Flexibility and Control On-Premise
Microsoft's Logic Apps Hybrid Deployment Model offers unparalleled flexibility for organizations, enabling the execution of workflows on-premises or in private/public clouds. With enhanced local processing, regulatory compliance, and dynamic scalability, businesses can optimize their infrastructure while ensuring data integrity- ideal for sectors like Government, Healthcare, and Manufacturing.
-
Meta Optimizes Data Center Sustainability with Reinforcement Learning
In a recent blog post, Meta describes how its engineers use reinforcement learning (RL), to optimize environmental controls in Meta’s data centers, reducing energy consumption and water usage while addressing broader challenges such as climate change.
-
Managing High-Performing Software Teams
High-performing teams expect their leader to enable them to make things better, Gillard-Moss said at QCon London. Independence in software teams can enable decision-making for faster delivery. Teams need empathy, understanding, and guidance from their managers.
-
Microsoft Unveils Azure Cobalt 100-Based Virtual Machines: Enhanced Performance and Sustainability
Microsoft's Azure Cobalt 100 VMs are now generally available. They deliver up to 50% improved price performance with energy-efficient Arm architecture. Tailored for diverse workloads, these VMs offer various configurations, including general-purpose and memory-optimized options. Their release supports sustainable computing, aligning with Microsoft's commitment to lower carbon footprints.
-
Kotlin HTTP Toolkit Ktor 3.0 Improves Performance and Adds Support for Server-Sent Events
Ktor, Kotlin's native framework to create asynchronous HTTP server and client applications, has reached version 3. It adopts kotlinx-io, which brings improved performance albeit at the cost of breaking changes, and adds support for Server-Sent events, CSFR, serving static resources from ZIP files, and more.
-
Microsoft Launches Azure Confidential VMs with NVIDIA Tensor Core GPUs for Enhanced Secure Workloads
Microsoft's Azure has launched the NCC H100 v5 virtual machines, now equipped with NVIDIA Tensor Core GPUs, enhancing secure computing for high-performance workloads. These VMs leverage AMD EPYC processors for robust data protection, making them ideal for tasks like AI model training and inferencing, while ensuring a trusted execution environment for sensitive applications.
-
Distill Your LLMs and Surpass Their Performance: spaCy's Creator at InfoQ DevSummit Munich
In her presentation at the inaugural edition of InfoQ Dev Summit Munich, Ines Montani built on top of the presentation she had earlier this year at QCon London and provided the audience with practical solutions for using the latest state-of-the-art models in real-world applications and distilling their knowledge into smaller and faster components that you can run and maintain in-house.
-
University Researchers Publish Analysis of Chain-of-Thought Reasoning in LLMs
Researchers from Princeton University and Yale University published a case study of Chain-of-Thought (CoT) reasoning in LLMs which shows evidence of both memorization and true reasoning. They also found that CoT can work even when examples given in the prompt are incorrect.
-
Java News Roundup: WildFly 34, Stream Gatherers, Oracle CPU, Quarkiverse Release Process
This week's Java roundup for October 14th, 2024, features news highlighting: the release of WildFly 34; JEP 485, Stream Gatherers, proposed to target for JDK 24; Oracle Critical Patch Update for October 2024; and a potential leak in the SmallRye and Quarkiverse release processes.
-
Microsoft and Tsinghua University Present DIFF Transformer for LLMs
Researchers from Microsoft AI and Tsinghua University have introduced a new architecture called the Differential Transformer (DIFF Transformer), aimed at improving the performance of large language models. This model enhances attention mechanisms by refining how models handle context and minimizing distractions from irrelevant information.
-
OpenAI Releases Swarm, an Experimental Open-Source Framework for Multi-Agent Orchestration
Recently released as an experimental tool, Swarm aims to allow developers to investigate how they can have multiple agents coordinate with one another to execute tasks using routines and handoffs.
-
General-Purpose and Compute-Intensive Amazon EC2 Graviton4 Instances Now Available
AWS has recently released the EC2 C8g and M8g instances, powered by the latest Graviton4 processors. The general-purpose M8g and compute-intensive C8g instances are designed to deliver up to 30% better performance compared to Graviton3-based instances, with a cost increase of approximately 10% over the previous M7g and C7g generations.
-
Google Cloud Adds Scalable Vector Search to Memorystore for Valkey & Redis Cluster
Google Cloud has introduced scalable vector-search capabilities to its Memorystore for Valkey and Redis Cluster. This update allows developers to perform vector searches at ultra-low latencies over billions of vectors.
-
Podman Desktop 1.13 Launches with Hyper-V Support and Additional Enhancements
Podman Desktop 1.13 introduces key updates, including Hyper-V support for managing Podman machines on Windows, an integrated image search feature, and redesigned empty state pages for containers, images, pods, and Kubernetes. The release also includes a reorganized Kubernetes navigation and an Image Layer Explorer extension.