DataOps in Fabric Data Factory
We’ve made several significant updates to our Fabric Data Factory artifacts stories, including Continuous Integration/Continuous Deployment (CI/CD) and APIs support! These updates are designed to automate the integration, testing, and deployment of code changes, ensuring efficient and reliable development.
In Fabric Data Factory, we currently support two key features in collaboration with the Application Lifecycle Management (ALM) to enhance CI/CD: Git integration and Deployment pipelines. Additionally, our APIs solution offers REST APIs support with Service Principal Name (SPN) support.
The Data Factory team has been working diligently to enable these fantastic CI/CD and APIs functionalities in your Fabric Data Factory items, and we have made significant progress in this endeavor.
Fabric Data Factory items and DataOps support
Data pipelines
CI/CD and APIs for Data pipelines are now generally available (GA)! This means you can now automate the integration, testing, and deployment of your data pipeline code changes seamlessly. You can learn more by checking out our documentation on CI/CD for Data pipelines and REST API capabilities for Data pipelines.
Dataflows Gen2
CI/CD is now supported in Dataflows Gen2, with the API functionality coming soon. You can now add Dataflow refresh activities to your pipelines in Fabric Data Factory, which include the new version of Dataflows. For more information, check out our documentation on Dataflow Gen2 with CI/CD and Git integration.
Mirrored Database (Generally Available)
Mirrored Database is now generally available (GA). This feature ensures that your database operations are synchronized and reliable, providing a robust solution for data mirroring. To learn more, check out our documentation on CI/CD for mirrored databases and Mirroring Public REST APIs.
Copy Job Item (Generally Available)
Copy job is now generally available (GA), with incremental refresh in Preview. This update allows you to efficiently copy and refresh data, ensuring that your data operations are up-to-date and accurate. Check out our documentation on CI/CD for Copy job to learn more.
Mounted ADF Item (Preview)
CI/CD and REST APIs support is now available for the Azure Data Factory item (Mounting ADF), which is currently in preview. This feature provides enhanced integration and deployment capabilities for your Azure Data Factory items, ensuring seamless data operations.
Conclusion
We can’t wait for you to try out DataOps in Fabric Data Factory. Submit your feedback on Fabric Ideas and join the conversation on the Fabric Community.
