SSIS - Data profiling Task - Adding custom profile request
Problem:
Solution:
Original Post: https://stackoverflow.com/questions/51665819/data-profiling-task-custom-profile-request/51802178#51802178
Is there any option to create a custom Profile Request for SSIS Data Profiling Task?
At the moment there are 5 standard profile requests under SSIS Data Profiling task:
- Column Null Ratio Profile Request
- Column Statistics Profile Request
- Column Length Distribution Profile Request
- Column Value Distribution Profile Request
- Candidate Key Profile Request
I need to add another one (Custom one) to get summary of all numeric values.
Solution:
Based on this Microsoft Documentation, SSIS Data profiling Task has only 5 main profiles (listed on your question) and there is no option to add a custom profile.
For a similar reason, i will create an
Execute SQL Task
to achieve that, you can use the aggregate functions you need and ISNUMERIC
function in the where clause :SELECT MAX(CAST([Column] AS BIGINT)) -- Maximum value
,MIN(CAST([Column] AS BIGINT)) -- Minimum value
,COUNT(Column) -- Count values
,COUNT(DISTINCT [Column]) -- Count distinct values
,AVG(CAST([Column] AS BIGINT)) -- Average
,SUM(CAST([Column] AS BIGINT)) -- Sum
FROM TABLE
WHERE ISNUMERIC([Column]) = 1
Original Post: https://stackoverflow.com/questions/51665819/data-profiling-task-custom-profile-request/51802178#51802178
Comments
Post a Comment