I got a great question from a student in the December delivery of Expert SSIS. A student asked, “Why wouldn’t you use Environments in Visual Studio (Dev, Test, and Prod), and deploy accordingly the mapped project parameters and package parameters?” I’ve looked into using SQL Server Data Tools (SSDT, or Visual Studio) configurations in the …
Continue reading SSIS and Visual Studio Configurations
Category:SSIS Catalog
On Data Frameworks…
You may not realize this, but Apache Spark is a framework. Spark is cluster-computing engine that manages parallel executions extremely well. Spark enables other technologies including Java, Scala, Python, R, and graph processing. Spark stitches together previously-disparate functionality into a cohesive, syntactically-similar set of commands. Spark’s architecture is library-driven and includes the following libraries: Spark SQL …
Continue reading On Data Frameworks…
Data Integration Life Cycle Management with SSIS is Available!
My latest book – Data Integration Life Cycle Management with SSIS – is now available! In this focused (185-page) book, I walk through ways to manage SSIS in the enterprise using what ships in the box. I point out what works well and what’s missing. I share workarounds for the stuff that’s missing, and then I …
Continue reading Data Integration Life Cycle Management with SSIS is Available!
Presenting A Day of Intelligent Data Integration at SQL Saturday Richmond!
I am honored to present my day-long precon titled SSIS Design Patterns and Biml: A Day of Intelligent Data Integration at SQL Saturday 705 – Richmond 23 Mar 2018! Description What is Intelligent Data Integration? SSIS packages developed using tried and true design patterns, built to participate in a DevOps enterprise practicing DILM, produced using Biml and executed using …
Continue reading Presenting A Day of Intelligent Data Integration at SQL Saturday Richmond!
Parsing SSIS Catalog Messages for Lookup Performance, v2
A couple years ago I wrote Administering SSIS: Parsing SSIS Catalog Messages for Lookups. I’ve updated the script to return all Lookup Transformation performance messages captured by the SSIS Catalog with Basic logging enabled (the SSIS Catalog’s default Logging Level). Some smart data integration people recommend setting the SSIS Catalog Logging Level to Verbose and …
Continue reading Parsing SSIS Catalog Messages for Lookup Performance, v2