Microsoft Fabric Updates Blog

Privacy by Design: PII Detection and Anonymization with PySpark on Microsoft Fabric

Introduction Whether you’re building analytics pipelines or conversational AI systems, the risk of exposing sensitive data is real. AI models trained on unfiltered datasets can inadvertently memorize and regurgitate PII, leading to compliance violations and reputational damage. This blog explores how to build scalable, secure, and compliant data workflows using PySpark, Microsoft Presidio, and Faker—covering … Continue reading “Privacy by Design: PII Detection and Anonymization with PySpark on Microsoft Fabric”

Introducing upgrades to AI functions for better performance—and lower costs

Earlier this year, we released AI functions in public preview, allowing Fabric customers to apply LLM-powered transformations to OneLake data simply and seamlessly, in a single line of code. Since then, we’ve continued iterating on AI functions in response to your feedback. Let’s explore the latest updates, which make AI functions more powerful, more cost-effective, … Continue reading “Introducing upgrades to AI functions for better performance—and lower costs”

How to debug user data functions locally in VS Code

Debugging your code is a big deal, especially when you’re working with user data functions. You want to make sure everything works as it should and that’s where local debugging lets you catch problems in your code without messing with the live environment. In this blog post, I’ll walk you through the steps to make local debugging easier, faster, and less of a headache.

Secure Your Data from Day One: Best Practices for Success with Purview Data Loss Prevention (DLP) Policies in Microsoft Fabric

As data volume and complexity soar, protecting sensitive information has become non-negotiable. With the latest enhancements to Purview Data Loss Prevention (DLP) Policies in Microsoft Fabric, organizations now have the power to proactively secure their data in Onelake. Whether you’re just getting started or looking to take your data governance to the next level, following … Continue reading “Secure Your Data from Day One: Best Practices for Success with Purview Data Loss Prevention (DLP) Policies in Microsoft Fabric”

Azure Synapse Runtime for Apache Spark 3.5 (Preview)

We’re thrilled to announce that we have made Azure Synapse Runtime for Apache Spark 3.5 for our Azure Synapse Spark customers in preview, while they get ready and prepare for migrating to Microsoft Fabric Spark. Apache Spark 3.5 You can now create Azure Synapse Runtime for Apache Spark 3.5. The essential changes include features which come from … Continue reading “Azure Synapse Runtime for Apache Spark 3.5 (Preview)”