Fast Copy with On-premises Data Gateway Support in Dataflow Gen2
Fast Copy boosts the speed and cost-effectiveness of your Dataflows Gen2. We loaded a 6 GB CSV file to a Lakehouse table in Microsoft Fabric with 8x faster and 3x cheaper result. See our last post for details.
Today, we’re excited to announce that Fast Copy in Dataflow Gen2 now supports high-performance data transfers from on-premises data stores using a gateway. You can use your existing on-premises data gateway in your Data Factory to access on-premise stores like SQL Server with Fast Copy in Dataflow Gen2.
Let’s see how it works.
Assume that you have the on-premises data gateway installed and registered in your Data Factory as below.
Create your Dataflow Gen2, and you can access data from a SQL Server through that on-premises data gateway.
Click the Options button from Dataflow Gen2 pane to enable Fast Copy feature.
The indicator will also show you that your data will be loaded via Fast Copy after evaluating your data loading step.
After you finish all the configurations in Dataflow Gen2, publish it. You will see the copy activity engine is used to transfer your data from an on-premises SQL Server in a fast way.
More resources
- Fast copy in Dataflows Gen2 – Microsoft Fabric | Microsoft Learn
- Microsoft Data Factory Community Forum
- Microsoft Fabric Ideas portal
Have any questions or feedback? Leave a comment below!
