I am honored and thrilled to welcome Shannon Lowder (@shannonlowder | blog | LinkedIn) to the Enterprise Data & Analytics team! Shannon is a data engineer, data scientist, BimlHero (though not listed on the page at the time of this writing), and shepherd of the Biml Interrogator open source project. If you use Biml to generate SSIS …
Continue reading Enterprise Data & Analytics Welcomes Shannon Lowder!
Category:Automation
Biml, Book Reviews, and Metadata-Driven Frameworks
I occasionally (rarely) read reviews at Amazon of books I’ve written. If I learn of a complaint regarding the book I often try to help. If a reader experiences difficulty with demos, I often offer to help, and sometimes I meet with readers to work through some difficulty related to the book (as I offered …
Continue reading Biml, Book Reviews, and Metadata-Driven Frameworks
DevOps and SSIS and Azure Data Factory
I wrote a book about practicing Data Integration Lifecycle Management with SSIS. In the book I explore tools I built to support DevOps with SSIS. Collectively, I call them the Data Integration Lifecycle Management Suite (DILM Suite). Many utilities at DILM Suite are free and some are open-source: SSIS Framework Community Edition – free, open-source, and …
Continue reading DevOps and SSIS and Azure Data Factory
100 Dumb Little Things
Software development is hard. It takes time, yes. But more than that, software development takes patience and thought and blood and sweat and love and tears. My friends at Varigence recently released an update to their Business Intelligence Markup Language (Biml) products. If you’re into business intelligence or data science, integration, or engineering, you should …
Continue reading 100 Dumb Little Things
SSIS Design Pattern: Controller Pattern
The SSIS Design Pattern known as the Controller Pattern provides a solution for executing SSIS packages in parallel – even from a serial SSIS execution framework such as SSIS Framework Community Edition (part of DILM Suite).
You Might Need an SSIS Framework
You might need an SSIS framework. “How can I tell if I need an SSIS framework, Andy?” I’m glad you asked. Does your enterprise: Practice DevOps? Execute lots of SQL Server Integration Services (SSIS) packages? Execute SSIS packages several times per day? Execute “SSIS in the Cloud” using the Azure Data Factory version 2 Integration …
Continue reading You Might Need an SSIS Framework
My Books
I’ve authored and co-authored a bunch of books! Truth be told, I enjoy writing. I think my love of writing stems from a love of learning. I’m just trying to share the joy! It’s a huge honor to write. I’m humbled and thrilled (all at the same time – a feeling I describe as “all …
Continue reading My Books
On Output…
I’m going to be a little bold in this post and suggest if you are developing for SQL Server, the screenshot to the left and above shows something that is, well, wrong. I can hear you thinking, “What’s Wrong With That Output, Andy?” I’m glad you asked. I will answer with a question: What just …
Continue reading On Output…
Introduction to Configuring SSIS in the SSIS Catalog – 24 May 2018
Join me Thursday, 24 May for a free webinar: Introduction to Configuring SSIS in the SSIS Catalog! The SSIS Catalog is a flexible data integration framework. What’s wrong with that last sentence? “Flexible” is dual-edged – it means there’s some complexity. Fear not! Andy Leonard – SSIS author, trainer, and consultant – is here to …
Continue reading Introduction to Configuring SSIS in the SSIS Catalog – 24 May 2018
How I Learn
This is a picture of how I learn. These are executions of an Azure Data Factory version 2 (ADFv2) pipeline. The pipeline is designed to grab data collected from a local weather station here in Hampden-Sydney Virginia – just outside Farmville – and piped to Azure Blob Storage via AzCopy. How do I learn? Fail …
Continue reading How I Learn