Microsoft Fabric Updates Blog

Announcing a new modern data connectivity and discovery experience in Dataflows

We are excited to introduce the new data connectivity and discovery experience in Dataflow, Dataflow Gen2, and Datamart. Today, users spend a lot of time finding the right data, the right connection info and credentials. With the new Get Data experience, we make it easy to browse different Fabric artifacts through the OneLake data hub. This improved experience aims to expedite this process and get you closer to the data that you’re looking for in the quickest way possible.

Listening to feedback and the new design experience

Over the years we’ve been receiving feedback from our customers around the current experience to connect to data in Dataflow. Previously, the experience provided a simple way to browse all the connectors available with a simple search functionality.
Screenshot of the previous Get Data experience found in Power Query Online
Feedback from customers indicated the need to speed up the journey in connecting to the data and leveraging any information that was previously entered such as previously created connections and credentials. This is how the new connectivity and discovery experience in Dataflow was born – to address this feedback and provide our customers with new, intuitive and quick ways to access the data that they need.
Screenshot of the Home tab for the Modern Get Data experience in Power Query Online

A new modular and extensible approach

One of the core pillars of this new experience is its modular and extensible approach. On the left side of the dialog, you’ll see a navigation bar with modules to this ‘Get Data’ experience which are contextual to the product that you’re working on. These modules present a new approach to the experience in an extensible fashion and will allow us to deliver and enhance this dialog as a whole and each module on its own in the coming months. The following list represents the modules that are or will be available during the next few weeks:

Home

This Home module allows you to get a quick view of the multiple experiences available inside of the product that you’re working on. For Dataflow Gen2 inside of Microsoft Fabric, you’ll be able to see the list of most common connectors, the OneLake data hub (coming soon), as well as a way to upload a file.
Screenshot of the Get Data dialog where the lakehouse phrase has been entered in the search bar and is displaying results contextual to the search

OneLake data hub

The OneLake data hub makes it easy to find, explore, and use the Fabric data items in your organization that you have access to. It provides information about the items and entry points for working with them Discover Fabric content in the OneLake data hub – Microsoft Fabric | Microsoft Learn.
Screenshot of the Onelake data hub module in the modern get data experience

Templates

For Power BI Dataflow, you have a module specifically designed for templates that already exist in this version of Dataflow. You can pick these templates from within this new module and our goal is extend tis module to enable a way for you to import a Power Query template from within this experience as well as improving the experience to better understand what these templates are able to offer.
Screenshot of the templates experience inside of the Modern Get Data

New

The new module is effectively the same dialog that you’re familiar with from previous versions of Dataflow where it shows you the Choose data source dialog. It allows you to see a full list of the connectors available for the product integration and a quick way to search for them.
Screenshot of the "New" module for the modern get data experience which features the classic choose data source dialog to find all the connectors available in Power Query Online

Upload

This new module is an extension to an existing capability available inside of the connect to data source experience to Upload a File. With this experience you are able  to click the browse button to browse a file locally and upload it, or simply drag and drop any file that you’d like to upload to the cloud and connect to using Dataflow.
Screenshot of the Upload module in the modern get data experience

Blank table

Creating a quick table in the Dataflow experience is one of the most used features for getting data in Power Query and thanks to your feedback we’ve made this a top level module inside the new and modern get data experience to allow you to have a quickstart to create a table in Dataflow.
Screenshot of the Blank table module in the modern get data experience

Blank query

One of the most common entry points that we have in Dataflow is the Blank query entry point or connector. We’ve heard your feedback and we’re making this entry point have his own module in the new experience so you can jump directly into a code-first experience where you can write or paste your own M script to create a new query.
Screenshot of the Blank query module in the modern get data experience

The vision and our goals

This is the first step in bringing data discovery directly in the Get Data experience. In the future, you will be able to re-use connections, browse Azure, browse SharePoint and many more. This new way of connecting to data will come to other experiences that connect to data, like Power BI Desktop, Fabric Pipelines, Excel and many more… Stay tuned!

Try it out today in Microsoft Fabric!

Follow these simple steps to try out the modern data connectivity experience in Dataflow Gen2 for Microsoft Fabric:
    1. Navigate to https://fabric.microsoft.com/ (register your account if needed)
    1. Navigate to a workspace and create a Dataflow Gen2
    1. Create a query by using the “Get Data” Primary button
Be sure to share your feedback with us in our Data Factory Community forum and also try this new experience in other product integrations such as Datamarts and Dataflow in Power BI.

Other resources

    • Join the Fabric community to post your questions, share your feedback, and learn from others.
    • Visit Microsoft Fabric Ideas to submit feedback and suggestions for improvements and vote on your peers’ ideas!
    • Check our Known Issues page for up to date on product fixes!
Have any questions or feedback? Leave a comment below!

Related blog posts

Announcing a new modern data connectivity and discovery experience in Dataflows

April 16, 2024 by Ruixin Xu

We are pleased to share a set of key updates regarding the Copilot in Microsoft Fabric experiences. The information in this blog post has also been shared with Fabric tenant administrators. Below are the highlights of the changes. This change is an important milestone to eventually allow Copilot to reach GA within this year. See … Continue reading “Copilot in MS Fabric: Soon available to more users in your organization“

April 15, 2024 by Santhosh Kumar Ravindran

Users orchestrate their data engineering or data science processes using notebooks and in most of the enterprise scenarios pipelines and job schedulers are used as a primary option to schedule and trigger these Spark jobs. We are thrilled to announce a new feature Job Queueing for Notebook Jobs in Microsoft Fabric. This feature aims to … Continue reading “Introducing Job Queueing for Notebook in Microsoft Fabric”