Please enter your information to subscribe to the Microsoft Fabric Blog.

Thanks for subscribing to the Microsoft Fabric Blog. You’ll receive email notifications when we publish new posts.

Microsoft Fabric Updates Blog

  1. Updates
  2. Jenny Jiang

Fabric Spark Monitoring APIs (Generally Available)

Fabric Spark Monitoring APIs offers powerful new observability capabilities and enhanced automation to Spark workloads within Microsoft Fabric! Based on your feedback, here’s what’s new! We’ve continued refining the APIs to meet evolving user needs. Spark Advisor API – Provides recommendations and skew diagnostics to help identify bottlenecks and optimize performance. Resource Usage API – … Continue reading “Fabric Spark Monitoring APIs (Generally Available)”

Fabric Spark Run Series Analysis (Generally Available)

Fabric Spark Run Series Analysis is a powerful observability feature designed to help you better understand, compare, and optimize your recurring Spark job executions. Building on the momentum from preview and the announcement of the Autotune feature at the Fabric Conference, Run Series Analysis has expanded capabilities, improved accessibility, and enhanced engineering infrastructure to support … Continue reading “Fabric Spark Run Series Analysis (Generally Available)”

Fabric Spark Applications Comparison (Preview)

The Spark Applications Comparison feature is now in preview in Microsoft Fabric. This new capability empowers developers and data engineers to analyze, debug, and optimize Spark performance across multiple application runs—whether you’re tracking changes from code updates or data variations to improve performance. What is Spark Applications Comparison? The Spark Applications Comparison feature allows users … Continue reading “Fabric Spark Applications Comparison (Preview)”

Gain Deeper Insights into Spark Jobs with JobInsight in Microsoft Fabric

JobInsight is a powerful Java-based diagnostic library designed to help developers and data engineers analyze completed Spark applications in Microsoft Fabric. With JobInsight, you can programmatically access Spark execution metrics and logs—all from within a Fabric Notebook. Whether you’re investigating performance bottlenecks, debugging task execution, or conducting post-run analysis across jobs, stages, or executors, JobInsight … Continue reading “Gain Deeper Insights into Spark Jobs with JobInsight in Microsoft Fabric”

Enhanced Monitoring for Spark High Concurrency Workloads in Microsoft Fabric

We’ve completed a set of improvements to the monitoring experience for Notebooks running in high concurrency mode, whether triggered manually or as part of a pipeline using the high concurrency execution model. These updates provide deeper visibility into Spark applications, improve observability across multiple Notebooks, and enable more efficient debugging and performance tuning. New Enhancements … Continue reading “Enhanced Monitoring for Spark High Concurrency Workloads in Microsoft Fabric”