Building Custom Tasks for SQL Server Integration Services

Build custom SQL Server Integration Services (SSIS) tasks using Visual Studio Community Edition and C#. Bring all the power of Microsoft .NET to bear on your data integration and ETL processes, and for no added cost over what you’ve already spent on licensing SQL Server. New in this edition is a demonstration deploying a custom SSIS task to the Azure Data Factory (ADF) Azure-SSIS Integration Runtime (IR).

All examples in this new edition are implemented in C#. Custom task developers are shown how to implement custom tasks using the widely accepted and default language for .NET development.

Why are custom components necessary? Because even though the SSIS catalog of built-in tasks and components is a marvel of engineering, gaps remain in the available functionality. One such gap is a constraint of the built-in SSIS Execute Package Task, which does not allow SSIS developers to select SSIS packages from other projects in the SSIS Catalog. Examples in this book show how to create a custom Execute Catalog Package task that allows SSIS developers to execute tasks from other projects in the SSIS Catalog. Building on the examples and patterns in this book, SSIS developers may create any task to which they aspire, custom tailored to their specific data integration and ETL needs.

WHAT YOU WILL LEARN

*
Configure and execute Visual Studio in the way that best supports SSIS task development*
Create a class library as the basis for an SSIS task, and reference the needed SSIS assemblies*
Properly sign assemblies that you create in order to invoke them from your task*
Implement source code control via Azure DevOps, or your own favorite tool set*
Troubleshoot and execute custom tasks as part of your own projects*
Create deployment projects (MSIs) for distributing code-complete tasks*
Deploy custom tasks to Azure Data Factory Azure-SSIS IRs in the cloud*
Create advanced editors for custom task parameters


WHO THIS BOOK IS FOR

For database administrators and developers who are involved in ETL projects built around SQL Server Integration Services (SSIS). Readers do not need a background in software development with C#. Most important is a desire to optimize ETL efforts by creating custom-tailored tasks for execution in SSIS packages, on-premises or in ADF Azure-SSIS IRs.

ANDY LEONARD is Chief Data Engineer at Enterprise Data & Analytics, an SSIS trainer, consultant, developer of the Data Integration Lifecycle Management (DILM) Suite, a Business Intelligence Markup Language (Biml) developer, and BimlHero. He is a SQL Server database and data warehouse developer, community mentor, engineer, and occasional farmer. He is co-author of Apress books SQL Server Integration Services Design Patterns and The Biml Book, and author of the Apress book Data Integration Life Cycle Management with SSIS and the Stairway to Integration Services series at SQLServerCentral.com.

1. The Story of This Book

2. Preparing the Environment

3. Creating the Assembly Project

4. Check-In the Project Code

5. Signing the Assembly

6. Preparing to Build

7. Coding the Task

8. Coding a Simple Task Editor

9. Signing and Binding

10. Expanding Editor Functionality

11. Minimal Coding for the Complex Editor

12. Editor Integration

13. Implement Views and Properties

14. Implement New Connection

15. Implement Use32bit, Synchronized, and LoggingLevel SettingsView Properties

16. Refactoring SourceConnection

17. Refactoring the SSIS Package Hierarchy

18. Instrumentation and Validation

19. Crushing Bugs

20. Adding Synchronous Execution Properties

21. Testing the Task

22. Building the Setup Project

23. Using the Execute Catalog Package Task in an SSIS Framework

24. Deploying to Azure-SSIS

25. Test the Task in Azure Data Factory

26. Notes from my Experience