Microsoft Fabric Updates Blog

Securely Accessing External and On-Premises Data Sources with Fabric Data Engineering Workloads

Managed Private Endpoints support for connecting to Private Link Services is now available in Microsoft Fabric (Public REST APIs). This has been one of the top requests from our customers and the community: the ability to securely connect Fabric Spark compute to on-premises and network-isolated data sources using the option to allowlist Fully Qualified Domain … Continue reading “Securely Accessing External and On-Premises Data Sources with Fabric Data Engineering Workloads”

Introducing the Job-Level Bursting Switch in Microsoft Fabric

We’re introducing a new feature that gives you more granular control over your Spark compute resources in Microsoft Fabric: The Job-Level Bursting Switch. This highly anticipated addition empowers capacity administrators to fine-tune how Spark jobs utilize burst capacity, optimizing for either peak performance or higher concurrency based on your specific workload needs. Microsoft Fabric’s Compute … Continue reading “Introducing the Job-Level Bursting Switch in Microsoft Fabric”

Autoscale Billing for Spark in Microsoft Fabric (Generally Available)

We’re thrilled to announce the general availability (GA) of Autoscale Billing for Apache Spark in Microsoft Fabric — a serverless billing model designed to offer greater flexibility, transparency, and cost efficiency for running Spark workloads at scale. With this model now fully supported, Spark Jobs can run independently of your Fabric capacity and are billed … Continue reading “Autoscale Billing for Spark in Microsoft Fabric (Generally Available)”

Boost performance effortlessly with Automated Table Statistics in Microsoft Fabric

We’re thrilled to introduce Automated Table Statistics in Microsoft Fabric Data Engineering — a major upgrade that helps you get blazing-fast query performance with zero manual effort. Whether you’re running complex joins, large aggregations, or heavy filtering workloads, Fabric’s new automated statistics will help Spark make smarter decisions, saving you time, compute, and money. What … Continue reading “Boost performance effortlessly with Automated Table Statistics in Microsoft Fabric”

Microsoft Fabric Data Engineering: Native Execution Engine now generally available

The Native Execution Engine for Fabric Data Engineering workloads is now generally available (GA) as part of Fabric Runtime 1.3. This C++-based vectorized engine (built on Apache Gluten and Velox) runs Spark workloads directly on the lakehouse, requiring no code changes or new libraries. It supports Spark 3.5 APIs and both Parquet and Delta Lake … Continue reading “Microsoft Fabric Data Engineering: Native Execution Engine now generally available”