In this video I share and discuss upcoming updates to SSIS Catalog Compare‘s Catalog Properties node. Check it out! :{>
Author:Andy Leonard
Christian, husband, dad, grandpa, Data Philosopher, Data Engineer; Azure Data Factory, Fabric Data Factory, and SSIS guy; and farmer. I was cloud before cloud was cool. :{>
Twenty years of watching SSIS catalog drift, environment mismatches, and deployment chaos finally has a name: Data Integration Lifecycle Management. I build tools for it at DILM Suite. Start with SSIS Catalog Compare.
Learning for Free
I’ve been blogging lately about training and certifications and it’s generated a fair amount of questions. One question is: “How much does certification cost?” Well, some of it is free. A surprising amount is free, in fact. Biml Academy offers several hours of free training, for example. YouTube is chock-full of learning opportunities. The quality of training …
Continue reading Learning for Free
Achievement Unlocked: Certified in Implementing Real-Time Analytics with Azure HDInsight
I learned a lot completing Implementing Real-Time Analytics with Azure HDInsight. It’s the most fun Microsoft Virtual Academy / edX course I’ve taken to date! In completing this course, I finished the requirements for the Microsoft Azure HDInsight Big Data Analyst program. I completed Implementing Predictive Analytics with Spark in Azure HDInsight and Processing Big Data with Hadoop in Azure …
Continue reading Achievement Unlocked: Certified in Implementing Real-Time Analytics with Azure HDInsight
Writing about Apache Storm Stirs Up a Storm
A storm is coming… I’ve been spending some time learning other data integration and analytics open-source-y stuff. Perhaps you’ve noticed recent blog posts like: Apache Storm Stream Processing in Azure HDInsight Achievement Unlocked: Certified in Implementing Predictive Analytics with Spark in Azure HDInsight Achievement Unlocked: Completed Processing Big Data in Hadoop with Azure HDInsight If …
Continue reading Writing about Apache Storm Stirs Up a Storm
Apache Storm Stream Processing in Azure HDInsight
I’m learning more about Apache Storm which is used for stream processing for near-real-time analytics in Azure HDInsight. I grabbed the image above from an AWS presentation on slideshare (link). I got all giggly inside as I learned about Storm architecture. Why? Because I built this much of this same functionality as part the DILM …
Continue reading Apache Storm Stream Processing in Azure HDInsight
Expert SSIS Training: SSIS Design Patterns for Performance
I focus on three topics in the Expert SSIS course I deliver live, online in cooperation with Brent Ozar Unlimited: SSIS Design Patterns for Performance SSIS Deployment, Configuration, Execution, and Monitoring Automation What do I cover in SSIS Design Patterns for Performance? I cover Data Flow Internals, chat about throughput – the OBM (One Big Metric) …
Continue reading Expert SSIS Training: SSIS Design Patterns for Performance
The Next Book Project: Frameworks
Kent Bradshaw, Shannon Lowder, and I explore stored procedure-based data integration patterns, an SSIS execution framework, and two Biml frameworks in a book we are writing, tentatively titled Frameworks.
Why I Built DILM Suite, by Andy Leonard
The following is Chapter 6: Catalog Browser from my latest book titled Data Integration Life Cycle Management with SSIS: A Short Introduction by Example: I was honored to be a Microsoft SQL Server MVP for five years (2007-2012). One cool thing about a being a Microsoft MVP was access to the internal developer teams. Everyone could …
Continue reading Why I Built DILM Suite, by Andy Leonard
ETL Instrumentation: Logging SSIS Variable Values
During the December 2017 delivery of Expert SSIS, I was asked if there is an SSIS Catalog Logging Mode that will display the value of variables. I responded that I wasn’t aware of a logging level that accomplishes this, but then – as sometimes happens – I could not let it go. It is an excellent …
Continue reading ETL Instrumentation: Logging SSIS Variable Values
Coming Soon to SSIS Catalog Compare: Values Everywhere
I’ve been testing a new feature in SSIS Catalog Compare‘s catalog browser. I call it “values everywhere.” What do I mean by values everywhere? In the browser shown above, please note the reference mapping of the ConnectionString property for the package connection manager in SimplePackage.dtsx. Each Reference is listed as a child node of the reference …
Continue reading Coming Soon to SSIS Catalog Compare: Values Everywhere