Announcing the General Availability of Fabric Data Pipeline Support in the On-Premises Data Gateway
Fabric Data Pipeline support in the On-Premises Data Gateway is now generally available! The on-premises data gateway allows you to seamlessly bring on-premises data to Microsoft Fabric. With data pipelines and the on-premises data gateway, you can perform high-scale data ingestion of your on-premises data into Fabric.
Enhancements Over Self-Hosted Integration Runtime in Azure Data Factory
If you’ve been using Azure Data Factory’s self-hosted integration runtime to link on-premises data with the cloud, this new feature release will enhance your experience, maintaining the same performance levels while providing even more benefits.
1. Multi-Node Cluster Support for Performance and Scalability
One of the most significant enhancements is the ability to go beyond the previous 4-node cluster giving your better scale out for running more concurrent jobs. The Fabric Data pipeline now supports multi-node clusters, giving you the flexibility to scale out your workloads as your data processing needs grow. Whether you’re handling increasing data volumes or running multiple concurrent activities, this feature enables you to maintain fast processing speeds and improve performance under heavy loads.
See details: Plan, scale, and maintain a business-critical gateway solution
2. Comprehensive Diagnostics Logs for Troubleshooting
Another powerful feature is the inclusion of diagnostics logs. You can now monitor your data pipelines and activities in greater detail. These logs provide deep insights that help with troubleshooting, optimizing performance, and resolving issues faster. From error detection to usage trends, diagnostics logs give you the transparency and data you need to keep your operations running smoothly.
See details: Troubleshoot the on-premises data gateway | Microsoft Learn
3. Effortless Setup and Cross-Tenant Sharing
Setting up the Fabric Data Pipeline on the On-Premises Data Gateway is designed to be intuitive and simple, saving valuable time for your IT teams. Once set up, you can easily share it across your tenant, making it a breeze to collaborate with other departments or business units. This eliminates the need for complicated configurations, letting you focus more on data operations and less on infrastructure management.
See details: Install an on-premises data gateway | Microsoft Learn
4. A Consolidated Gateway Experience for Data Analytics
The On-Premises Data Gateway now offers a unified experience for all your data analytics and integration needs. This means that you can manage Power BI reports, orchestrate dataflows, and set up pipelines all from a single, consolidated platform. By merging your analytics and data integration workloads into one easy-to-use interface, you gain a more efficient and streamlined workflow.
Get Started Today
With the general availability of Fabric Data Pipeline on the On-Premises Data Gateway, now is the perfect time to explore these new features. Existing Azure Data Factory self-hosted integration runtime customers can enjoy a seamless transition and immediate benefits.
For more details or to get started, visit our How to access on-premises data sources in Data Factory – Microsoft Fabric | Microsoft Learn and unlock the full potential of this powerful new feature today.
