Why Do I Like to Stream?

For as long as I can remember, I’ve always enjoyed learning – whether it’s learning something new and different, or learning something new and different about a topic in which I already possessed some knowledge. I confess: It’s a rush for me. To my knowledge, I’ve created no knowledge. With few exceptions, I learned everything …
Continue reading Why Do I Like to Stream?

Enterprise Data Warehouse Maintenance Costs More Than Development

This post is part of a series titled Enterprise Data Warehouses: Uncomfortable Truths. There are cases where developing Enterprise Data Warehouses costs less than maintaining Enterprise Data Warehouses. Which cases? When enterprises do not maintain their Data Warehouse, EDW maintenance costs nothing (or nearly nothing). One side-effect of not maintaining an EDW is the Enterprise Data …
Continue reading Enterprise Data Warehouse Maintenance Costs More Than Development

Enterprise Data Warehouse: Uncomfortable Truths

Most enterprises recognize the need to capture, store, collect, and surface enterprise data analytics. Why, then, do most enterprise data warehouse projects disappoint or outright fail? The author proposes to share three reasons gleaned from decades of delivering and writing about data warehouse solutions: Enterprise Data Warehouse Maintenance Costs More Than Development Enterprise Data Warehouse …
Continue reading Enterprise Data Warehouse: Uncomfortable Truths

Stage Updates and Inserts for SSIS Data Flow Performance

A few days ago, I streamed SSIS Data Flow Performance, which you can view below (from LinkedIn) or by clicking the link to the YouTube recording: I share similar SSIS Design Patterns in my Expert SSIS course. I next deliver Expert SSIS 14-15 Dec 2020. Also, Expert SSIS is on sale for 50% off as part of my Cyber Monday Sale at the …
Continue reading Stage Updates and Inserts for SSIS Data Flow Performance

Foreword – Building Custom Tasks for SSIS 2nd Edition

I’m excited to announce Building Custom Tasks for SQL Server Integration Services: The Power of .NET for ETL for SQL Server 2019 and Beyond 2nd Edition is available for pre-order at Amazon! I spent more time on this book and the demo task – the Execute Catalog Package Task – than any other book I’ve authored or …
Continue reading Foreword – Building Custom Tasks for SSIS 2nd Edition

Using Delimiters with HashBytes for Change Detection

A week or so back, I streamed 100% Efficient Data Integration, which you can view below (from LinkedIn) or by clicking the link to the YouTube recording: I share this SSIS Design Pattern in my Expert SSIS course. I next deliver Expert SSIS 14-15 Dec 2020. Also, Expert SSIS is on sale for 50% off …
Continue reading Using Delimiters with HashBytes for Change Detection

AWS and SSIS

Brent Ozar, my friend and brother from another mother, shared an interesting link on LinkedIn. The article Brent linked is titled Amazon RDS for SQL Server now supports the Business Intelligence Suite on SQL Server 2019. I find the topic interesting for a number of reasons. I’m interested in helping enterprises lift and shift on-premises …
Continue reading AWS and SSIS

Global Parameters in SSIS Framework

I’m happy to announce the latest version of our SSIS Framework includes global parameters! I can hear some of you thinking, … “What Are Global Parameters, Andy?” I’m so glad you asked! SSIS ships with package-scoped and project-scoped parameters. Project-scoped parameters may be used in any SSIS package in the project; package-scoped parameters are only …
Continue reading Global Parameters in SSIS Framework

Executing Synchronously from DtExec

Five years ago, I wrote a blog post titled The SYNCHRONIZED SSIS Execution Parameter. Recently, I received a comment with a question: One way to execute SSIS packages stored in the SSIS Catalog from SQL Agent is to use the CmdExec job step type. As with all command-level access, please research security implications. Use a …
Continue reading Executing Synchronously from DtExec