Microsoft Fabric Updates Blog

Spark Connector for Fabric Data Warehouse (Preview)

We are pleased to announce the availability of the Fabric Spark connector for Fabric Data Warehouse (DW) in the Fabric Spark runtime. This connector enables Spark developers and data scientists to access and work with data from Fabric DW and the SQL analytics endpoint of the lakehouse, either within the same workspace or across different … Continue reading “Spark Connector for Fabric Data Warehouse (Preview)”

New improvements coming to the AI Skill

Additional Authors: Amir Jafari, Shreyas Radhakrishna, Nellie Gustafsson We’re excited to unveil significant enhancements to the AI Skill in Fabric! These updates make it easier than ever to build a powerful generative AI data agent, helping you to unlock deeper insights and streamline decision-making. With improved flexibility, intelligence, and user-friendliness, the updated AI Skill is … Continue reading “New improvements coming to the AI Skill”

ArcGIS GeoAnalytics for Microsoft Fabric Spark – Preview

Additional authors – Ashit Gosalia, Aniket Adnaik, Mahesh Prakriya, Madhu Bhowal, Sarah Battersby, and Michael Park Esri is recognized as the global market leader in geographic information system (GIS) technology, location intelligence, and mapping, primarily through its flagship software, ArcGIS. Esri empowers businesses, governments, and communities to tackle the world’s most pressing challenges through spatial … Continue reading “ArcGIS GeoAnalytics for Microsoft Fabric Spark – Preview”

Faster data processing with Native Execution Engines in Microsoft Fabric Runtime 1.3: efficient memory management explained

Accelerating data processing at scale demands far more than just raw compute power. As the complexity and volume of data workloads grow, every layer of the execution pipeline—especially memory management—plays a critical role in determining overall performance. We’ve introduced unique changes how Spark handles memory with the Native Execution Engine for Fabric Spark, reducing performance … Continue reading “Faster data processing with Native Execution Engines in Microsoft Fabric Runtime 1.3: efficient memory management explained”

Announcing the preview of the REST API for Livy for Data Engineering.

The Fabric Livy endpoint lets users submit and execute their Spark code on the Spark compute within a designated Fabric workspace, eliminating the need to create a Notebook or Spark Job Definition artifacts. This integration with a specific Lakehouse artifact ensures straightforward access to data stored on OneLake. Additionally, Livy API offers the ability to … Continue reading “Announcing the preview of the REST API for Livy for Data Engineering.”