Microsoft Fabric Updates Blog

Enhancing Data Transformation Flexibility with Multiple-Schema Inferencing in Eventstream (Preview)

Introducing multiple-schema inferencing in Eventstream! This feature empowers you to work seamlessly with data sources that emit varying schemas by inferring and managing multiple schemas simultaneously. It eliminates the limitations of single-schema inferencing by enabling more accurate and flexible transformations, preventing field mismatches when switching between Live and Edit modes, and allowing you to view … Continue reading “Enhancing Data Transformation Flexibility with Multiple-Schema Inferencing in Eventstream (Preview)”

Secure Data Streaming with Private Endpoints in Eventstream (Generally Available)

We’re excited to announce the General Availability of Managed Private Endpoints (MPE) in Fabric Eventstream. This network security feature allows you to stream data from Azure resources to Fabric over a private and secure network without the complexity of manual network configurations. Why Network Security Matters for Streaming As organizations increasingly adopt real-time data streaming … Continue reading “Secure Data Streaming with Private Endpoints in Eventstream (Generally Available)”

Ingest Logs using Logstash into Real-Time Intelligence

Coauthor: Ramachandran G, RTI Engineering Manager, Microsoft In today’s data-driven world, organizations rely heavily on real-time insights to monitor systems, detect anomalies, and make informed decisions. One of the key challenges in achieving this is efficiently ingesting and transforming log data from diverse sources into a format that can be analysed instantly. Real-Time Intelligence Real-time … Continue reading “Ingest Logs using Logstash into Real-Time Intelligence”

ML Model Scoring in Fabric Eventhouse via Update Policy

In this blog post, we will describe how to train an ML model in Fabric Spark notebook, save it in Fabric’s models registry and use it for scoring new streaming data by Fabric Eventhouse via update policy in real time. We describe a typical workflow that can be implemented to monitor cloud resources or IoT … Continue reading “ML Model Scoring in Fabric Eventhouse via Update Policy”

From Clicks to Code: SQL Operator under Fabric Eventstream (Preview)

A new feature has been added to Eventstream—the SQL Operator—which enables real-time data transformation within the platform. Whether you’re filtering, aggregating, or joining data streams, or handling complex data transformation needs like conditional logic, nested expression, string manipulation etc. SQL Operator gives you the flexibility and control to craft custom transformations using the language you … Continue reading “From Clicks to Code: SQL Operator under Fabric Eventstream (Preview)”