Skip to content

Benny Austin

  • Home
  • About Me

Categories

Follow Benny Austin on WordPress.com

DtsComException

COMExceptionComponentMetaDatadataflowdataflow column metadatadataflow discovererdataflow metadatadfldDtsComExceptionDtsExceptionDtsPipelineExceptionDtsTaskExceptionError OutputErrorCodeErrorColumnErrorColumn nameForEachLoopForLoopInputCollectionIntegration ServiceIntegration ServicesLineageIDMainPipeOutputCollectionPackageIDSequence ContainerSSIStaskhosttaskhost.InnerObject

DFLD: How to capture/refresh Dataflow column metadata from multiple packages using Dataflow Discoverer?

Dataflow Discoverer (DFLD) is a command-line discovery utility that detects and writes the metadata of SSIS dataflow columns to a SQL Server lookup table. DFLD detects Dataflows nested within containers up to any level of nesting. For information on how to install and use DFLD utility,visit http://dfld.codeplex.com

DFLD works on one package at a time. It’s a typical ops requirement to keep the DFLMetadata of all SSIS packages up to date. This can be automated by creating a SSIS package similar to the one shown below Continue Reading

-33.867139 151.207114

Share this:

  • Click to share on Twitter (Opens in new window)
  • Click to share on Pinterest (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on Reddit (Opens in new window)
  • Click to print (Opens in new window)
  • Click to email a link to a friend (Opens in new window)
  • Click to share on Tumblr (Opens in new window)

Like this:

Like Loading...
7 Comments February 5, 2011October 5, 2012 Benny Austin
COMExceptionComponentMetaDatadataflowdataflow column metadatadataflow discovererdataflow metadatadfldDtsComExceptionDtsExceptionDtsPipelineExceptionDtsTaskExceptionError OutputErrorCodeErrorColumnErrorColumn nameForEachLoopForLoopInputCollectionMainPipeOutputCollectionPackageIDSequence ContainerSSIStaskhosttaskhost.InnerObject

SSIS: How to get name of ErrorColumn from Error Output?

SSIS automatically creates two columns on the Error Output from dataflow components – ErrorColumn and ErrorCode. ErrorColumn contains the column ID of the erroneous column. Column ID is a number that is unique to a dataflow within the package. Similarly ErrorCode contains the error number that caused the row to be rejected. At the moment, SSIS by default does not provide ErrorColumn name and ErrorCode description. These can be derived using the methods described below. Continue Reading

-33.867139 151.207114

Share this:

  • Click to share on Twitter (Opens in new window)
  • Click to share on Pinterest (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on Reddit (Opens in new window)
  • Click to print (Opens in new window)
  • Click to email a link to a friend (Opens in new window)
  • Click to share on Tumblr (Opens in new window)

Like this:

Like Loading...
20 Comments February 4, 2011August 13, 2014 Benny Austin
COMExceptionComponentMetaDatadataflowdataflow column metadatadataflow discovererdataflow metadataDtsComExceptionDtsExceptionDtsPipelineExceptionDtsTaskExceptionError OutputErrorCodeErrorColumnForEachLoopForLoopInputCollectionIntegration ServiceIntegration ServicesLineageIDOutputCollectionPackageIDSequence ContainerSSIStaskhosttaskhost.InnerObject

SSIS Dataflow Discoverer (DFLD)

What is Dataflow Discoverer?

Dataflow Discoverer (DFLD) is a command-line discovery utility that detects and writes the metadata of SSIS dataflow columns to a SQL Server lookup table. DFLD detects Dataflows nested within containers up to any level of nesting.

Why use Dataflow Discoverer?

SSIS dataflow column metadata generated by this utility could be used to enhance the error reporting capability of your SSIS package. For example to get the name of ErrorColumn from the Error Outputs which is not available by default in SSIS yet.

What are the minimum system requirements to use Dataflow Discoverer?

  1. .NET framework 4 or above
  2. SQL Server Database (any version)

How to install Dataflow Discoverer?

Verify that your system meets minimum requirements, then

  1. Download sql script from here – http://dfld.codeplex.com/releases/60334/download/205239

    Execute the script on your SQL Server. By default the sql script will create a SQL Server database – ETLMetadata and a lookup table – DFLMetadata. You could also create the table DFLMetadata in any other SQL Server database, in that case just comment out the database creation segment of the sql script.

  2. Download DFLD executable from here http://dfld.codeplex.com/releases/60334/download/205238

    Copy the executable to a local folder. It is recommended to add the executable path to System Path environment variable.

Continue Reading

-33.867139 151.207114

Share this:

  • Click to share on Twitter (Opens in new window)
  • Click to share on Pinterest (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on Reddit (Opens in new window)
  • Click to print (Opens in new window)
  • Click to email a link to a friend (Opens in new window)
  • Click to share on Tumblr (Opens in new window)

Like this:

Like Loading...
10 Comments February 4, 2011April 10, 2013 Benny Austin
Blog at WordPress.com.
  • Follow Following
    • Benny Austin
    • Join 66 other followers
    • Already have a WordPress.com account? Log in now.
    • Benny Austin
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
%d bloggers like this: