Introduzca su información para suscribirse al Blog de Microsoft Fabric.

Gracias por suscribirse al blog de Microsoft Fabric. Recibirá notificaciones por correo electrónico cuando publiquemos nuevas publicaciones.

Microsoft Fabric Updates Blog

  1. Actualizaciones
  2. Apache Spark

Privacy by Design: PII Detection and Anonymization with PySpark on Microsoft Fabric

  • Headshot of article author junio 12, 2025 por RK Iyer 17,546 Vistas

Introduction Whether you’re building analytics pipelines or conversational AI systems, the risk of exposing sensitive data is real. AI models trained on unfiltered datasets can inadvertently memorize and regurgitate PII, leading to compliance violations and reputational damage. This blog explores how to build scalable, secure, and compliant data workflows using PySpark, Microsoft Presidio, and Faker—covering … Continue reading “Privacy by Design: PII Detection and Anonymization with PySpark on Microsoft Fabric”

Introducing upgrades to AI functions for better performance—and lower costs

Earlier this year, we released AI functions in public preview, allowing Fabric customers to apply LLM-powered transformations to OneLake data simply and seamlessly, in a single line of code. Since then, we’ve continued iterating on AI functions in response to your feedback. Let’s explore the latest updates, which make AI functions more powerful, more cost-effective, … Continue reading “Introducing upgrades to AI functions for better performance—and lower costs”

Azure Synapse Runtime for Apache Spark 3.5 (Preview)

We’re thrilled to announce that we have made Azure Synapse Runtime for Apache Spark 3.5 for our Azure Synapse Spark customers in preview, while they get ready and prepare for migrating to Microsoft Fabric Spark. Apache Spark 3.5 You can now create Azure Synapse Runtime for Apache Spark 3.5. The essential changes include features which come from … Continue reading “Azure Synapse Runtime for Apache Spark 3.5 (Preview)”

Boost performance effortlessly with Automated Table Statistics in Microsoft Fabric

We’re thrilled to introduce Automated Table Statistics in Microsoft Fabric Data Engineering — a major upgrade that helps you get blazing-fast query performance with zero manual effort. Whether you’re running complex joins, large aggregations, or heavy filtering workloads, Fabric’s new automated statistics will help Spark make smarter decisions, saving you time, compute, and money. What … Continue reading “Boost performance effortlessly with Automated Table Statistics in Microsoft Fabric”

Microsoft Fabric Spark: Native Execution Engine now generally available

The Fabric Spark Native Execution Engine (NEE) is now generally available (GA) as part of Fabric Runtime 1.3. This C++-based vectorized engine (built on Apache Gluten and Velox) runs Spark workloads directly on the lakehouse, requiring no code changes or new libraries. It supports Spark 3.5 APIs and both Parquet and Delta Lake formats, so … Continue reading “Microsoft Fabric Spark: Native Execution Engine now generally available”