ETL Instrumentation: Logging SSIS Variable Values

During the December 2017 delivery of Expert SSIS, I was asked if there is an SSIS Catalog Logging Mode that will display the value of variables. I responded that I wasn’t aware of a logging level that accomplishes this, but then – as sometimes happens – I could not let it go. It is an excellent …
Continue reading ETL Instrumentation: Logging SSIS Variable Values

Coming Soon to SSIS Catalog Compare: Values Everywhere

I’ve been testing a new feature in SSIS Catalog Compare‘s catalog browser. I call it “values everywhere.” What do I mean by values everywhere? In the browser shown above, please note the reference mapping of the ConnectionString property for the package connection manager in SimplePackage.dtsx. Each Reference is listed as a child node of the reference …
Continue reading Coming Soon to SSIS Catalog Compare: Values Everywhere

I Need Some Updates

As I type, 2017 is drawing to a close. For many, this time of year is a time of reflection on the past year and planning for the coming year. I recently saw this Windows message in the corner of my screen and realized, “You’re right, Windows. I do need some updates.” I’m not big …
Continue reading I Need Some Updates

Website Ch-ch-changes…

Inspired by Frank La Vigne’s (blog | @Tableteer) snappy update to the Data Driven home page, I decided to spruce up a couple / three of my websites including this one, andyleonard.blog. I added the sidebar shown on the right of the site. It contains a more-readily-available search box and links to other websites I maintain – …
Continue reading Website Ch-ch-changes…

SSIS and Visual Studio Configurations

I got a great question from a student in the December delivery of Expert SSIS. A student asked, “Why wouldn’t you use Environments in Visual Studio (Dev, Test, and Prod), and deploy accordingly the mapped project parameters and package parameters?” I’ve looked into using SQL Server Data Tools (SSDT, or Visual Studio) configurations in the …
Continue reading SSIS and Visual Studio Configurations

On Data Frameworks…

You may not realize this, but Apache Spark is a framework. Spark is cluster-computing engine that manages parallel executions extremely well. Spark enables other technologies including Java, Scala, Python, R, and graph processing. Spark stitches together previously-disparate functionality into a cohesive, syntactically-similar set of commands. Spark’s architecture is library-driven and includes the following libraries: Spark SQL …
Continue reading On Data Frameworks…

Learning Goals for 2018 – T-SQL Tuesday #97

My friend and #SqlFamily sister Mala hosts this month’s T-SQL Tuesday topic: Setting learning goals for 2018. It’s a timely topic for me as I’ve recently engaged in more formalized training. Mala’s questions: What do you want to learn? (specific skills and talents) How and when do you want to learn? (methods of learning and …
Continue reading Learning Goals for 2018 – T-SQL Tuesday #97

Achievement Unlocked: Certified in Implementing Predictive Analytics with Spark in Azure HDInsight

I learned a lot taking the course Implementing Predictive Analytics with Spark in Azure HDInsight! I’m slowly working my way through the Data Science Certification offered by Microsoft Virtual Academy along with edX. This course is not part of the official curriculum, but I’ve been wanting to learn more about Spark so I took it. Many of the courses …
Continue reading Achievement Unlocked: Certified in Implementing Predictive Analytics with Spark in Azure HDInsight