I recently wrote a series of articles about Data Engineering Patterns. The four articles focus on the differences between software engineering and data engineering and the need to apply software engineering principles to data engineering. But I also cover why that’s not as simple as it sounds. the series, in order, is as follows: We Borrowed …
Continue reading The Data Engineering Patterns Series
The Words for the Work
What a month of naming posts was really all about [originally posted at Engineer of Data Substack] I have spent a chunk of a career in the part of data that has no name. Not the dashboards. Not the models everyone lines up to demo. The layer underneath – the part that moves the data, …
Continue reading The Words for the Work
You Can’t Govern What You Can’t Name
Governance is downstream of a name [originally posted at Engineer of Data Substack] Last week, I wrote: Observable Run – every execution leaves a durable, queryable record of what ran, with what, and how it ended. I called it a pattern. It is also a door. Behind it is the question every data team eventually gets …
Continue reading You Can’t Govern What You Can’t Name
A Pattern Language for Orchestration
Crafting the beginning of a vocabulary [originally posted at Engineer of Data Substack] Last week, I wrote: Stateful problems need their own names. We never wrote them. You’ve written idempotent loads, restart logic, dependency chains, promotion configs. By hand. Correctly enough to ship. You already build every one of these. You’re not missing the knowledge. You’re …
Continue reading A Pattern Language for Orchestration
We Borrowed the Tools, Not the Patterns
Data engineering in a software engineering world [originally posted at Engineer of Data Substack] Your orchestration runs. It Just Works every night. You built something real and that is not nothing. The ache isn’t that it’s broken – it’s that it lives in three people’s heads and a folder of conventions nobody wrote down. You …
Continue reading We Borrowed the Tools, Not the Patterns
SSIS 2025 Microsoft.Data.SqlClient Connection Error
Recently, I was developing an SSIS package that read from an Azure SQL DB table and wrote to an on-premises SQL Server 2025 database table. I encountered the following error: [ADO NET Source [41]] Error: ADO NET Source has failed to acquire the connection {<ConnectionManagerGUID>} with the following error message: “Could not load file or …
Continue reading SSIS 2025 Microsoft.Data.SqlClient Connection Error
Remigration – T-SQL Tuesday #199
This month’s T-SQL Tuesday is hosted by Koen Verbeeck (sqlkover.com, LinkedIn, @Ko_Ver). The topic is remigration, or moving from the cloud back to on-premises or a private data center. Migration As a data engineering consultant, I’ve helped many customers migrate from on-premises to the cloud. Because my experience lies in the Microsoft data sphere, nearly …
Continue reading Remigration – T-SQL Tuesday #199
Install and Configure SQL Server 2025 Enterprise Developer Edition
This post is for people interested in setting up an instance of SQL Server 2025 Enterprise Developer Edition for personal use. I caution those interested in configuring an instance of SQL Server 2025 Enterprise for production purposes: You should not use Developer Edition because it’s not for production workloads by design and according to the …
Continue reading Install and Configure SQL Server 2025 Enterprise Developer Edition
Download SQL Server 2025 Enterprise Developer Edition
This post is for people interested in setting up an instance of SQL Server 2025 Enterprise Developer Edition for personal use. If you are interested in configuring an instance of SQL Server 2025 for production purposes, you should not use Enterprise Developer Edition – it’s not for production workloads by design and according to the …
Continue reading Download SQL Server 2025 Enterprise Developer Edition
One Way to Install SQL Server 2025 Enterprise Developer Edition
In this series, I walk through one way to install and configure SQL Server 2025 Enterprise Developer Edition. This series is not intended as guidance for production environments. This series is simply one way I install and configure SQL Server 2025 Enterprise for my test and exploration environment. Download SQL Server 2025 Enterprise Developer Edition …
Continue reading One Way to Install SQL Server 2025 Enterprise Developer Edition