I’m learning more about Apache Storm which is used for stream processing for near-real-time analytics in Azure HDInsight. I grabbed the image above from an AWS presentation on slideshare (link). I got all giggly inside as I learned about Storm architecture. Why? Because I built this much of this same functionality as part the DILM …
Continue reading Apache Storm Stream Processing in Azure HDInsight
Author:Andy Leonard
Christian, husband, dad, grandpa, Data Philosopher, Data Engineer; Azure Data Factory, Fabric Data Factory, and SSIS guy; and farmer. I was cloud before cloud was cool. :{>
Expert SSIS Training: SSIS Design Patterns for Performance
I focus on three topics in the Expert SSIS course I deliver live, online in cooperation with Brent Ozar Unlimited: SSIS Design Patterns for Performance SSIS Deployment, Configuration, Execution, and Monitoring Automation What do I cover in SSIS Design Patterns for Performance? I cover Data Flow Internals, chat about throughput – the OBM (One Big Metric) …
Continue reading Expert SSIS Training: SSIS Design Patterns for Performance
The Next Book Project: Frameworks
Kent Bradshaw, Shannon Lowder, and I explore stored procedure-based data integration patterns, an SSIS execution framework, and two Biml frameworks in a book we are writing, tentatively titled Frameworks.
Why I Built DILM Suite, by Andy Leonard
The following is Chapter 6: Catalog Browser from my latest book titled Data Integration Life Cycle Management with SSIS: A Short Introduction by Example: I was honored to be a Microsoft SQL Server MVP for five years (2007-2012). One cool thing about a being a Microsoft MVP was access to the internal developer teams. Everyone could …
Continue reading Why I Built DILM Suite, by Andy Leonard
ETL Instrumentation: Logging SSIS Variable Values
During the December 2017 delivery of Expert SSIS, I was asked if there is an SSIS Catalog Logging Mode that will display the value of variables. I responded that I wasn’t aware of a logging level that accomplishes this, but then – as sometimes happens – I could not let it go. It is an excellent …
Continue reading ETL Instrumentation: Logging SSIS Variable Values
Coming Soon to SSIS Catalog Compare: Values Everywhere
I’ve been testing a new feature in SSIS Catalog Compare‘s catalog browser. I call it “values everywhere.” What do I mean by values everywhere? In the browser shown above, please note the reference mapping of the ConnectionString property for the package connection manager in SimplePackage.dtsx. Each Reference is listed as a child node of the reference …
Continue reading Coming Soon to SSIS Catalog Compare: Values Everywhere
I Need Some Updates
As I type, 2017 is drawing to a close. For many, this time of year is a time of reflection on the past year and planning for the coming year. I recently saw this Windows message in the corner of my screen and realized, “You’re right, Windows. I do need some updates.” I’m not big …
Continue reading I Need Some Updates
Get The Biml Book Sample Code
You can obtain the sample code for The Biml Book at Apress. Navigate to the The Biml Book page and click the “Download source code” button. The sample code wasn’t available when the book was released. I own that and I apologize. It is available now. Happy Biml’ing! :{> Learn more: Biml Academy BimlScript.com
The Next Expert SSIS Delivery is 2.5 Days – 5-7 Mar 2018!
Yep, we’re doing it again! In cooperation with Brent Ozar Unlimited, the next delivery of Expert SSIS Training is 5-7 Mar 2018. I had a great time delivering this course with Brent in September and December 2017 and I’m excited to have the opportunity to share this material with you again! We’ve extended the course …
Continue reading The Next Expert SSIS Delivery is 2.5 Days – 5-7 Mar 2018!
Website Ch-ch-changes…
Inspired by Frank La Vigne’s (blog | @Tableteer) snappy update to the Data Driven home page, I decided to spruce up a couple / three of my websites including this one, andyleonard.blog. I added the sidebar shown on the right of the site. It contains a more-readily-available search box and links to other websites I maintain – …
Continue reading Website Ch-ch-changes…