Sunday, June 1, 2014

Working with Data Profile Task in SSIS (SQL Server Integration Services)

Data Profile Task is used to identify the data quality issues.  For identify the data integrity problems we can use the data profiling task.


Data Profile Task is available in control flow tab in SSIS.




Drag and drop the data profile task and double click the task for editing.
In General tab destination type is used to store the profile information. There two destination types available
1)       File Connection
2)      Variable




Destination will allow for specifying the connection string for File Connection or Variable name for variable.

Create a file connection using the destination.

Open Profiler viewer is used to view the existing data profile file.

In order to create a new data profile click on new profile. If you need to know how to create connection go to this post.




I have downloaded the adventure work 2012 database from codeplex site.
Check the checkbox to verify the data quality issues. Click ok.



Then it will go to the profile request tab. Then Click on ok.


Then execute the task as shown.



Profile executed successfully. Profile will be saved in XML format. In order to open the profile data use the dataprofileviewer.
The dataprofileviewer will be available in the below mentioned path.
C:\Program Files (x86)\Microsoft SQL Server\120\DTS\Binn\ DataProfileViewer
(Drive\programfiles(x86)\ Microsoft SQL Server\sqlserver2012 version\bin folder).
You can for Address line null ability ratio is very high.




No comments: