Nutmeg, the Wonder Dog, Sniffing Have you seen the SSIS File Watcher demos where a developer puts an SSIS package in an infinite loop while it waits for a file to show up in a directory? It’s a popular pattern, especially when files are FTP’d (or SFTP’d) to enterprises for processing. I’ve seen way too …
Continue reading SSIS Design Patterns: Sniffer (File Watcher)
Author:Andy Leonard
Christian, husband, dad, grandpa, Data Philosopher, Data Engineer; Azure Data Factory, Fabric Data Factory, and SSIS guy; and farmer. I was cloud before cloud was cool. :{>
Twenty years of watching SSIS catalog drift, environment mismatches, and deployment chaos finally has a name: Data Integration Lifecycle Management. I build tools for it at DILM Suite. Start with SSIS Catalog Compare.
Data Integration Life Cycle Management with SSIS is Available!
My latest book – Data Integration Life Cycle Management with SSIS – is now available! In this focused (185-page) book, I walk through ways to manage SSIS in the enterprise using what ships in the box. I point out what works well and what’s missing. I share workarounds for the stuff that’s missing, and then I …
Continue reading Data Integration Life Cycle Management with SSIS is Available!
Achievement Unlocked: Completed Processing Big Data in Hadoop with Azure HDInsight
I love learning! As Buck Woody (@BuckWoodyMSFT) mentioned in his post titled Don’t learn to be a Data Scientist, one should continuously learn – especially in this field. I’m happy to announce I just earned a certificate for DAT202.1x: Processing Big Data with Hadoop in Azure HDInsight! I’m slowly working my way through the Data Science …
Continue reading Achievement Unlocked: Completed Processing Big Data in Hadoop with Azure HDInsight
One Way to Connect PSDrive to a SQL Server Instance
“Everyone Stand Back! I’m Learning PowerShell!” I keep telling folks, “Learn new stuff” and “then blog about it!” I figured it’s time I take my own advice. I’m reading Learn Windows PowerShell in a Month of Lunches by Don Jones (@concentrateddon). I’m actually reading the first edition. I bought the book a while back and I’m …
Continue reading One Way to Connect PSDrive to a SQL Server Instance
A True Story of Value vs. Hourly Rate
A little over a year ago I wrote a post titled Value. If you have a few minutes Value provides good background for this post. Unlike most of my posts about business and client interactions (I have a standing rule to not blog about stuff until at least one year has passed), the stuff I share in …
Continue reading A True Story of Value vs. Hourly Rate
OLE DB is *NOT* Deprecated
I cannot count how many times I’ve been asked about the deprecation of Microsoft OLE DB for SQL Server. My best guess? Hundreds of times over the years. My reply to questions has been: “I do not believe Microsoft will deprecate the OLE DB Driver for SQL Server.” In data integration circles, the announcement in …
Continue reading OLE DB is *NOT* Deprecated
‘azure’ is Not Recognized
If you are learning Azure Command Line Interface (CLI) 2.0 – especially if you’re learning it by reading articles or watching videos based on v1.0 – you may see references to the “azure” command. But if you type “azure” in a command prompt, you may receive this error: ‘azure’ is not recognized as an internal or …
Continue reading ‘azure’ is Not Recognized
Biml Academy Relaunch! (Well, beta…)
I’m no Brent Ozar but after tens of hours (and tens of dollars – and a little help and some great advice from Brent), I’ve managed to get Biml Academy relaunched as a training site! First, the free content that’s always been at Biml Academy will always be there. The links have changed because MeetingBurner is shutting …
Continue reading Biml Academy Relaunch! (Well, beta…)
Folks Who Influenced Me (#TSql2sday)
It’s been a while since I wrote a TSql2sday post – too long, in fact. But I saw the topic trending on Twitter in the SQL Server Community and knew I needed to add my 2 cents… It’s difficult to list all the people who have inspired me. Many continue to inspire me in small …
Continue reading Folks Who Influenced Me (#TSql2sday)
Just Ship
Last week I attended the PASS Summit 2017. Almost every time I’m around that many geeks, I’m asked a question. In fact, I’d say this is the most frequently asked question I hear. What’s the question? “How do you get so much done?” My first response is half-joking, “Insomnia.” I don’t believe I suffer from …
Continue reading Just Ship