Microsoft Fabric Updates Blog

Mastering Enterprise T-SQL ETL/ELT: A Guide with Data Warehouse and Fabric Pipelines

Developing ETLs/ELTs can be a complex process when you add in business logic, large amounts of data, and the high volume of table data that needs to be moved from source to target. This is especially true in analytical workloads involving relational data when there is a need to either fully reload a table or incrementally update a table. Traditionally this is easily completed in a flavor of SQL (or name your favorite relational database). But a question is, how can we execute a mature, dynamic, and scalable ETL/ELT utilizing T-SQL with Microsoft Fabric? The answer is with Fabric Pipelines and Data Warehouse.

Demystifying Data Ingestion in Fabric: Fundamental Components for Ingesting Data into a Fabric Lakehouse using Fabric Data Pipelines

✎ Co-Author – Abhishek Narain Overview Building an effective Lakehouse starts with establishing a robust ingestion layer. Ingestion refers to the process of collecting, importing, and processing raw data from various sources into the data lake. Data ingestion is fundamental to the success of a data lake as it enables the consolidation, exploration, and processing … Continue reading “Demystifying Data Ingestion in Fabric: Fundamental Components for Ingesting Data into a Fabric Lakehouse using Fabric Data Pipelines”

A Data Factory Pipeline Navigator Map to a Successful POC

Authors: Prashant Atri & Prabhjot Kaur Welcome to Version 1 of the ultimate Data Factory Pipeline Mind Map! This one-page view is packed with guidelines to help you navigate Data Factory pipelines on your Data Factory journey to build a successful Data Integration project. Starting from the left-hand side, you will find broad feature areas … Continue reading “A Data Factory Pipeline Navigator Map to a Successful POC”

Announcing New Data Factory Connectors Released in May 2024

We are excited to announce the release of several powerful new connectors in Fabric Data Factory this May 2024! These connectors will significantly enhance your data integration and transformation capabilities, enabling seamless workflows and expanding your data connectivity options. Here’s a detailed overview of the newly released connectors and a sneak peek at what’s coming … Continue reading “Announcing New Data Factory Connectors Released in May 2024”

Boost performance and save costs with Fast Copy in Dataflows Gen2

In this blog, you’ll learn how the Fast Copy feature helps to enhance the performance and cost-efficiency of your Dataflows Gen2. In March, we announced the Public Preview of Fast Copy in Dataflows Gen2 within Microsoft Fabric. This feature allows you to ingest large amounts of data efficiently, leveraging the same backend as the Copy … Continue reading “Boost performance and save costs with Fast Copy in Dataflows Gen2”