Microsoft Fabric Updates Blog

Introducing Data Factory in Microsoft Fabric

See Arun Ulagaratchagan’s blog post to read the full Microsoft Fabric preview announcement.

 

As organizations work through their digital transformation journeys, they are awash with data that they need to bring together to meet their analytics needs. To do this, they need to seamlessly access data from a diverse set of data sources, reshape and transform the data to the right format, and load the data into a data store like a lakehouse or data warehouse, where the data can support their analytics needs. In addition, companies are looking to stitch together different data activities (e.g., running a notebook, a stored procedure, SQL script, and more) and orchestrate specific data workflows.

 

Today, we are unveiling Data Factory in Microsoft Fabric, bringing together the best of Power Query and Azure Data Factory into a single, modern data integration experience which empowers both data and business professionals with capabilities to ingest and transform data as well as orchestrate data workflows. Our goal is to empower everyone to be able to connect to diverse data sources and bring that data to where it can best help you derive insights for better business decisions.

 

Whether you’re a citizen or professional developer, Data Factory enables you to develop enterprise-scale data integration solutions with next-generation dataflows and data pipelines. 

 

Data Factory in Fabric empowers you with: 

    • Seamless connectivity to more than 170+ data stores (including on-premises data sources, cloud databases, analytical platforms, line of business applications, and more)
    • Next-generation Power BI dataflows is now available as part of Data Factory in Fabric, providing 300+ out-of-the box data transformations, including AI transformations, and scalable data flows that run on Fabric compute. In addition, you can output the transformed data into various data destinations. 
    • Data pipelines in Fabric is an evolution of Azure Data Factory pipelines which provides you with a rich set of integration capabilities. In addition, the copy assistant enables you to jumpstart any copy task from data sources to data destinations.
    • Built-in AI enables you to accelerate and automate common data integration tasks.

For example, you might need to extract data from an unstructured data source like a web page or a text file without a well-defined format. With the help of AI, you can now use Data Factory to analyze examples you give on values you want to extract. Then, the powerful AI capabilities underneath the hood learn from the examples and create the Data Factory dataflows to extract just the data you need.

 

Watch an overview of Data Factory in Microsoft Fabric:

Explore how our customers and partners are already using Data Factory in Microsoft Fabric  

 

Hitachi Solutions 

Hitachi Solutions provides consulting services to help customers migrate their data systems into Microsoft Fabric. Their global team of IT professionals has extensive expertise using Data Factory in Fabric to seamlessly integrate data from multiple sources.

“The Data Factory experience in Microsoft Fabric has surpassed our data and analytics needs by equipping our customers with industry-leading data orchestration capabilities in an elegant, easy-to-use, code-free experience.”

Simon Nuss, Vice President of Data & Analytics, Hitachi Solutions

 

Watch the team at Hitachi Solutions using Data Factory with Fabric:

  

Delphix 

Delphix has a strong track record of delivering powerful data compliance capabilities to enterprises across industries to address their privacy mandates and cybersecurity requirements. Delphix is partnering with Microsoft to bring their proven technology to the Microsoft Fabric platform with Delphix Compliance Services for Data Factory. 

 “In collaborating with Microsoft to bring our multi-cloud data masking solution to Microsoft Fabric, Delphix is proud to deliver a comprehensive way to de-risk the cloud while accelerating the path from data to transformation.”  

Jedidiah Yueh, Delphix Founder and CEO

 

Learn more about the Delphix Compliance Services for Data Factory.

  

Get started with Microsoft Fabric

Microsoft Fabric is currently in preview. Try out everything Fabric has to offer by signing up for the free trial—no credit card information required. Everyone who signs up gets a fixed Fabric trial capacity, which may be used for any feature or capability from integrating data to creating machine learning models. Existing Power BI Premium customers can simply turn on Fabric through the Power BI admin portal. After July 1, 2023, Fabric will be enabled by default for all Power BI tenants. 

 

Sign up for the free trial. For more information read the Fabric trial docs.

 

Learn more about Data Factory in Fabric at the following Build 2023 sessions:

  

Other resources 

If you want to learn more about Microsoft Fabric, consider:   

Related blog posts

Introducing Data Factory in Microsoft Fabric

October 31, 2024 by Jovan Popovic

Fabric Data Warehouse is a modern data warehouse optimized for analytical data models, primarily focused on the smaller numeric, datetime, and string types that are suitable for analytics. For the textual data, Fabric DW supports the VARCHAR type that can store up to 8KB of text, which is suitable for most of the textual values … Continue reading “Announcing public preview of VARCHAR(MAX) and VARBINARY(MAX) types in Fabric Data Warehouse”

October 29, 2024 by Dandan Zhang

Managed private endpoints allow Fabric experiences to securely access data sources without exposing them to the public network or requiring complex network configurations. We announced General Availability for Managed Private Endpoint in Fabric in May of this year. Learn more here: Announcing General Availability of Fabric Private Links, Trusted Workspace Access, and Managed Private Endpoints. … Continue reading “APIs for Managed Private Endpoint are now available”