It’s time to hire a consultant for your enterprise data project. That is awesome news, but a quick search for the perfect consultancy reveals a number of options (and hourly rates). What’s a CEO, CIO, CFO, VP, or Director to do? How do you choose a consultant with the right experience for your enterprise data …
Continue reading Four Questions to Ask When Hiring an Enterprise Data Consultant
Author:Andy Leonard
Christian, husband, dad, grandpa, Data Philosopher, Data Engineer; Azure Data Factory, Fabric Data Factory, and SSIS guy; and farmer. I was cloud before cloud was cool. :{>
One Way to Break Out of an Azure Data Factory ForEach Activity
First, a couple shoutouts to my brothers and friends, Joel Cochran (@joelcochran) and Shannon Lowder (@shannonlowder). This approach grew out of conversations with them. The ForEach activity iterates over a collection of items. One less-documented property of the ForEach activity is it (currently) iterates the entire collection. I can hear some of you asking… “What …
Continue reading One Way to Break Out of an Azure Data Factory ForEach Activity
Trying a New Thing
Inspired by Brent Ozar, Erik Darling, Riley – my younger son, command sergeant 12 year old, Streamlabs OBS guru, etc. – and others, I’m taking Twitch for a test drive. So far, I’ve streamed a few test streams. One stream included a walk-through of an Azure Data Factory design pattern. How to Get In on …
Continue reading Trying a New Thing
Configure Azure Data Factory Security for the ADF REST API
Before using the Azure Data Factory’s REST API in a Web activity’s Settings tab, security must be configured. Azure Data Factory pipelines may use the Web activity to call ADF REST API methods if and only if the Azure Data Factory managed identity is assigned the Contributor role. More information about the problem I am …
Continue reading Configure Azure Data Factory Security for the ADF REST API
Integration Services Extension for VS 2019 v3.7 Update
The SQL Server Integration Services Projects extension for Visual Studio 2019 was updated 20 Apr 2020. There are also recent updates to Microsoft® OLE DB Driver 18 for SQL Server® and the GitHub Extension for Visual Studio. Happy coding! :{>
The Summer o’ ADF, v2020
I am pleased to announce the Summer o’ ADF, v2020, is on! Webinars: [Recording] Updates to the SSIS Framework Posts: [Recoding] Building an SSIS Framework in Azure Data Factory One Way to Incrementally Develop ADF Pipelines Nesting ForEach Activities in Azure Data Factory [Recording] Using the Azure Data Factory ForEach Activity [Recording] Configuring and Managing ADF …
Continue reading The Summer o’ ADF, v2020
One Way to Create Login Credentials
In the age of password managers, like LastPass, I no longer remember passwords. Instead, my password manager remembers them for me. I’ve found another use for password managers: generating the username portion of a username-password login. When it’s time to create the credential, I use the LastPass plugin’s “Generate Secure Password” function: I copy the password …
Continue reading One Way to Create Login Credentials
Azure Data Factory Supports Excel Files
Excel format in Azure Data Factory. A welcome addition to ADF! When adding an ADF DataSet: I am convinced they got tired of me saying, “Well, you’ll need SSIS if you want to read Excel…” Probably not, though. Either way… score! :{> Need Help Migrating to Azure? Enterprise Data & Analytics specializes in helping enterprises modernize their data …
Continue reading Azure Data Factory Supports Excel Files
An Introduction to Azure Data Factory REST API
TL;DR: To read the value portion of a key-value pair stored in JSON in an ADF pipeline, interrogate properties.<key>, where key is the key-part of the key-value JSON pair. Introduction Last month I wrote a post titled Stop an Azure-SSIS Files Integration Runtime (Safely). The post generated a bunch of hits, which is awesome. The …
Continue reading An Introduction to Azure Data Factory REST API
Announcing Summer 2020 ADF and SSIS Courses!
Due to popular demand, Enterprise Data & Analytics announces additional Azure Data Factory and SSIS training this summer! 06-07 Jul 2020: Expert SSIS 08 Jul 2020: Master the Fundamentals of Azure Data Factory For a limited time, all Enterprise Data & Analytics training is 50% off, including our popular ADF and SSIS Season Pass! Expert SSIS Do …
Continue reading Announcing Summer 2020 ADF and SSIS Courses!