Microsoft Fabric Updates Blog

Troubleshooting Fabric Spark application without production workspace access

Problem Statement You have Fabric Spark Notebooks deployed in a production workspace, but you don’t have direct access to it. The production support team reports that a Fabric Spark job has failed in the production workspace, and you need to analyze the logs to troubleshoot the issue. Solution To troubleshoot Spark applications, Spark engineers typically … Continue reading “Troubleshooting Fabric Spark application without production workspace access”

Building a Custom Sparklens JAR for Microsoft Fabric

Problem Statement In the previous blog on Profiling Microsoft Fabric Spark Notebooks with Sparklens, we covered how to run Sparklens to profile and tune the performance of your spark notebooks in Microsoft Fabric. In that blog, we used a custom Sparklens JAR. The Sparklens JARs available in the Maven Central repo supports only the Spark … Continue reading “Building a Custom Sparklens JAR for Microsoft Fabric”

Profiling Microsoft Fabric Spark Notebooks with Sparklens

Problem Statement: You are a data engineer developing Spark notebooks using Microsoft Fabric. You are having performance issues and you want to know if your spark code is running efficiently. You also want to know if increasing the resources would improve its performance. Discussion: In this blog, you will learn how to leverage Sparklens, an … Continue reading “Profiling Microsoft Fabric Spark Notebooks with Sparklens”