Simplifying Data Ingestion with Copy Job – CI/CD is now available
Copy Job is optimized to simplify your data ingestion with non-compromising experience from any source to any destination. It supports various data delivery styles, including both batch copy and incremental copy, offering the flexibility to meet your specific needs.
Find more details in this blog post: Announcing Public Preview: Copy Job in Microsoft Fabric | Microsoft Fabric Blog | Microsoft Fabric
To build successful data analytics projects with Copy Job, it is very important to have source control, continuous integration, continuous deployment, and collaborative development environments.
Copy Job in Data Factory within Microsoft Fabric now supports Git Integration and Deployment Pipeline. With these enhancements, users can leverage their own Git repositories in Azure DevOps or GitHub and utilize Fabric’s built-in Deployment Pipelines, enabling seamless CI/CD workflows. This integration marks an important step toward expanding CI/CD capabilities across all Fabric items, empowering users with advanced, reliable development tools for their data projects.
Just like with other Fabric items, you can seamlessly connect and sync your Copy Job with Git repositories.
In addition to using your own Git repositories, you can optionally use the built-in Deployment pipelines feature that enables Copy Job graduation through Development, Test, and Production environments through a super-easy and intuitive UI.
For more details, reference CI/CD for copy job in Data Factory – Microsoft Fabric | Microsoft Learn
