No. No, you do not need a Biml Framework. In the same way that I do not need a vehicle powered by an internal combustion engine, you do not need a Biml framework. You see, I live about 5 miles from Farmville Virginia. I could walk to town each time my family needs groceries. I could pack as many …
Continue reading “Do I Need a Biml Framework, Andy?”
Author:Andy Leonard
Christian, husband, dad, grandpa, Data Philosopher, Data Engineer; Azure Data Factory, Fabric Data Factory, and SSIS guy; and farmer. I was cloud before cloud was cool. :{>
Twenty years of watching SSIS catalog drift, environment mismatches, and deployment chaos finally has a name: Data Integration Lifecycle Management. I build tools for it at DILM Suite. Start with SSIS Catalog Compare.
T-SQL Tuesday: When Good Projects Go Bad
Thanks to Jeff Mlakar for hosting this month’s T-SQL Tuesday, a monthly collection of blog posts by data bloggers who work and live in the Microsoft SQL Server space. This month’s topic is about projects that have gone wrong. “Why Do Good Projects Go Bad, Andy?” Deltas. That’s all. Deltas. Allow me to explain. In …
Continue reading T-SQL Tuesday: When Good Projects Go Bad
Honored to Present Lift and Shift SSIS to ADF at #Azure DataFest Reston
I am honored to deliver Lift and Shift SSIS to ADF at the Azure DataFest in Reston Virginia 11 Oct 2018! Abstract Your enterprise wants to use the latest cool Azure Data Analytics tools but there’s one issue: All your data are belong to the servers on-premises. How do you get your enterprise data into …
Continue reading Honored to Present Lift and Shift SSIS to ADF at #Azure DataFest Reston
Leadership and Failure
How Do People Learn? There’s ample debate about whether people learn from mistakes. Don’t believe me? Search and see for yourself. There are compelling arguments for both learning from our mistakes and not learning from them. In engineering and software, I think we learn from our mistakes. I can hear you thinking, “Why do you think …
Continue reading Leadership and Failure
Bad Presentations
In just a few short weeks I am attending the PASS Summit 2018 in Seattle. Whenever I attend an event like the Summit or SQL Saturday I attempt to attend presentations of interest to me. I love learning new stuff! Good and Less-Good Most of the presentations I attend are good. Some are really good. They …
Continue reading Bad Presentations
Viewing SSIS Configurations Metadata in SSIS Catalog Browser
SSIS Catalog Browser is a pretty neat product. “How neat is it, Andy?” I’m glad you asked. It’s free. That makes it difficult to beat the cost. SSIS Catalog Browser is designed to surface all SSIS Catalog artifacts and properties in a single view. “What exactly does that mean, Andy?” You’re sharp. Let’s talk about why …
Continue reading Viewing SSIS Configurations Metadata in SSIS Catalog Browser
Viewing SSIS Configurations Metadata in SSMS
Let’s take a look at an SSIS Project in SSMS: Demo is the SSIS Catalog folder. Demo contains three SSIS projects named 0-Monolith, EmptySSISProject, and LiftAndShift. If we expand the LiftAndShift SSIS project we see it contains a single SSIS package named Load Customer.dtsx. The Demo folder contains two Catalog environments named env1 and env2. These …
Continue reading Viewing SSIS Configurations Metadata in SSMS
It is Possible to Execute SSIS in a Container
As the title of this post suggests, it is possible to execute SSIS in a container. How? I’ll share more details later – promise. One short version is: Run a container with the microsoft/mssql-server-windows-developer image (assign lots of RAM). Add the SQL Server installation files to the container. Execute SQL Server setup from a command line …
Continue reading It is Possible to Execute SSIS in a Container
Presenting Moving Data with Azure Data Factory at SQL Saturday Charlotte!
I am honored to present Moving Data with Azure Data Factory at SQL Saturday 806 in Charlotte, NC 20 Oct 2018. This is the first time I am delivering this session. It still has that new presentation smell! Abstract Azure Data Factory – ADF – is a cloud data engineering solution. ADF version 2 sports …
Continue reading Presenting Moving Data with Azure Data Factory at SQL Saturday Charlotte!
On Data Engineering in 2018
A few years ago I had a conversation with Scott Currie, the CEO of Varigence and inventor of Biml. Scott is one of the smartest people I know and I know a lot of very smart people. Whenever I have the opportunity to communicate with the very smart people I know, I often ask them – …
Continue reading On Data Engineering in 2018