Fabric Eventhouse now supports Eventstream Derived Streams in Direct Ingestion mode (Preview)
The Eventstreams artifact in the Microsoft Fabric Real-Time Intelligence experience lets you bring real-time events into Fabric, transform them, and then route them to various destinations such as Eventhouse, without writing any code (no-code).
You can ingest data from an Eventstream to Eventhouse seamlessly either from Eventstream artifact or Eventhouse Get Data Wizard.
This capability is now being extended to support Eventstream Derived streams in direct ingestion mode. Direct ingestion mode ingests your event data directly into the Eventhouse without any processing.
Derived stream is a specialized type of destination that you can create after adding stream operations, such as Filter or Manage Fields, to an Eventstream. The derived stream represents the transformed default stream following stream processing. You can route the derived stream to multiple destinations in Fabric and view the derived stream in the Real-Time Hub.
Direct Ingestion from Derived Stream to Eventhouse can be configured from Eventstream, as well as from Eventhouse Get Data Wizard, including embedded Real-Time Hub in Get Data Wizard.
Steps to Configure from Eventstream Canvas
- In Edit mode for your eventstream, select Add destination on the ribbon or select the Transform events or add destination card on the canvas, then select Eventhouse.
- On the Eventhouse screen, select Direct ingestion.
- Enter a Destination name, a Workspace, and an Eventhouse from the selected workspace.
- Select Save.
- Connect the new Eventhouse destination card to the output of your eventstream if not already connected, then select Publish.
- In Live view, select Configure in the Eventhouse destination node.
- Your Eventhouse opens in the Get data screen. Select an existing table of the KQL database or select a new table to create a new one to route and ingest the data.
- Provide a Data connection name or keep the name provided, and then select Next. It can take a few minutes to pull data from the eventstream.
- Inspect the incoming data and Edit columns if needed. When you’re finished configuring the data, select Finish on the Inspect the data screen.
- You can now see the Eventhouse destination on the canvas in Live view.
Steps to configure from Get Data Embedded Real-Time Hub
In the KQL Database of your destination Eventhouse, select Get Data from the Database ribbon and then the derived stream from the Embedded Real-Time Hub window.
Select a target table. If you want to ingest data into a new table, select + New table and enter a table name. Follow through the inspect step and hit ‘Finish’ to start ingesting data from Derived stream to your KQL Database table.
Steps to configure from Eventhouse Get Data Wizard
In the KQL Database of your destination Eventhouse, select Get Data and then in the Get data source step, select Eventstream tile.
Select a target table. If you want to ingest data into a new table, select + New table and enter a table name. When you select Eventstream as your source, you must specify the Workspace, Eventstream, and default or derived Stream.
| Setting | Description |
|---|---|
| Workspace | Your eventstream workspace location, select a workspace from the dropdown. |
| Eventstream | The name of your eventstream, select an eventstream from the dropdown. |
| Stream | The name of the default or derived stream, select a stream from the dropdown. * For default streams, the stream name format is Eventstream-stream. * For derived streams, the name was defined when the stream was created. |
Follow through the inspect step and select ‘Finish’ to start ingesting data from Derived stream to you KQL Database table.
What next?
Direct ingestion from Eventstream derived streams to Evenhouse is now available as a ‘Preview’ in Microsoft Fabric. Please refer Get data from Eventstream to learn more and get started today.
Need help or want to suggest an improvement?
Reach out to us on RTI Forum: Get Help with Real-Time Intelligence.
Request or upvote a suggestion on Fabric Ideas RTI: Fabric Ideas.
