We are excited to introduce the new data connectivity and discovery experience in Dataflow, Dataflow Gen2, and Datamart.
Today, users spend a lot of time finding the right data, the right connection info and credentials. With the new Get Data experience, we make it easy to browse different Fabric artifacts through the OneLake data hub.
This improved experience aims to expedite this process and get you closer to the data that you’re looking for in the quickest way possible.
Listening to feedback and the new design experience
Over the years we’ve been receiving feedback from our customers around the current experience to connect to data in Dataflow.
Previously, the experience provided a simple way to browse all the connectors available with a simple search functionality.
Feedback from customers indicated the need to speed up the journey in connecting to the data and leveraging any information that was previously entered such as previously created connections and credentials.
This is how the new connectivity and discovery experience in Dataflow was born – to address this feedback and provide our customers with new, intuitive and quick ways to access the data that they need.
A new modular and extensible approach
One of the core pillars of this new experience is its modular and extensible approach. On the left side of the dialog, you’ll see a navigation bar with modules to this ‘Get Data’ experience which are contextual to the product that you’re working on.
These modules present a new approach to the experience in an extensible fashion and will allow us to deliver and enhance this dialog as a whole and each module on its own in the coming months.
The following list represents the modules that are or will be available during the next few weeks:
This Home module allows you to get a quick view of the multiple experiences available inside of the product that you’re working on. For Dataflow Gen2 inside of Microsoft Fabric, you’ll be able to see the list of most common connectors, the OneLake data hub (coming soon), as well as a way to upload a file.
For Power BI Dataflow, you have a module specifically designed for templates that already exist in this version of Dataflow. You can pick these templates from within this new module and our goal is extend tis module to enable a way for you to import a Power Query template from within this experience as well as improving the experience to better understand what these templates are able to offer.
The new module is effectively the same dialog that you’re familiar with from previous versions of Dataflow where it shows you the Choose data source dialog. It allows you to see a full list of the connectors available for the product integration and a quick way to search for them.
This new module is an extension to an existing capability available inside of the connect to data source experience to Upload a File. With this experience you are able to click the browse button to browse a file locally and upload it, or simply drag and drop any file that you’d like to upload to the cloud and connect to using Dataflow.
Creating a quick table in the Dataflow experience is one of the most used features for getting data in Power Query and thanks to your feedback we’ve made this a top level module inside the new and modern get data experience to allow you to have a quickstart to create a table in Dataflow.
One of the most common entry points that we have in Dataflow is the Blank query entry point or connector. We’ve heard your feedback and we’re making this entry point have his own module in the new experience so you can jump directly into a code-first experience where you can write or paste your own M script to create a new query.
The vision and our goals
This is the first step in bringing data discovery directly in the Get Data experience. In the future, you will be able to re-use connections, browse Azure, browse SharePoint and many more. This new way of connecting to data will come to other experiences that connect to data, like Power BI Desktop, Fabric Pipelines, Excel and many more… Stay tuned!
Try it out today in Microsoft Fabric!
Follow these simple steps to try out the modern data connectivity experience in Dataflow Gen2 for Microsoft Fabric:
Welcome to the September 2023 update. We have lots of features this month including updates to the monitoring hub, Fabric Metrics app, VS code integration for Data Engineering, Real-time data sharing and many more. Continue reading for more details on our new features! Contents Core Monitoring hub – column options OneLake OneLake file explorer (v.1.0.10) …
Continue reading “Microsoft Fabric September 2023 update”
Introduction Setting up alerts for pipeline failures on a Teams channel/outlook mail enhances communication, collaboration, and problem-solving within your team. It creates a streamlined workflow for addressing issues, reduces downtime, and promotes a culture of continuous improvement in managing your data pipelines. In this blog, I’ll showcase a method for sending notifications to both Teams …
Continue reading “Notifying Outlook and Teams channel/group from a Microsoft Fabric pipeline”