Microsoft Fabric Updates Blog

How Spark Supports OneLake Security with Row and Column Level Policies

Recently, we announced a significant milestone: public support for Row and Column Level Security within OneLake. This universal security framework applies consistently across all data engines, regardless of how data is accessed. Traditionally, Spark does not provide granular security features and assumes unrestricted access to the required datasets for query execution. To address this limitation, … Continue reading “How Spark Supports OneLake Security with Row and Column Level Policies”

Capacity usage enabled date for Test capability in User Data Functions

User Data Functions is an item that allows you to create fully managed Python functions to run on Fabric. You can use this item to embed your business logic in your Fabric data architectures across all the different integrations, such as Fabric data sources, Power BI reports, Pipelines, Notebooks, and more. The use of the … Continue reading “Capacity usage enabled date for Test capability in User Data Functions”

From Files to Delta Tables—Parquet & JSON data ingestion simplified with Shortcut Transformations

Picture this: A data engineer at a global enterprise starts the day with a familiar challenge – ‘Why does ingesting Parquet and JSON files always feel like a battle?’. Data engineers are dealing with millions of records stored in compressed Parquet files and deeply nested JSON logs. Every schema change means hours of debugging. Every … Continue reading “From Files to Delta Tables—Parquet & JSON data ingestion simplified with Shortcut Transformations”

Customer-managed keys for Fabric workspaces (Generally Available) 

Protect your data at rest with keys you own and control  By default, Fabric encrypts all data at rest using Microsoft-managed keys and secures data in transit with TLS 1.2 or higher. Customer-managed keys (CMK), which you create, own, and maintain in your Azure Key Vault (AKV), offer enhanced control over your encryption strategy. With … Continue reading “Customer-managed keys for Fabric workspaces (Generally Available) “

Azure Synapse Runtime for Apache Spark 3.5 (Generally Available)

We have made Azure Synapse Runtime for Apache Spark 3.5 for our Azure Synapse Spark customers generally available for customers to start using it for their production workloads, while they get ready and prepare for migrating to Microsoft Fabric Spark. What This Mean for You You can now create Azure Synapse Runtime for Apache Spark … Continue reading “Azure Synapse Runtime for Apache Spark 3.5 (Generally Available)”