I decided to stream about Parquet files. Enjoy! :{>
Category:ADF
One Way to Create a Parquet File from SQL Server Data
Yesterday I was coding away, deep into using C# to decompress and parse Excel XML so I could read data from a specific worksheet in a workbook on a server without Excel objects installed, when I saw the following on Twitter: For those of you who do not already know… I Don’t Switch Contexts Well I …
Continue reading One Way to Create a Parquet File from SQL Server Data
An ADF Azure-SSIS Framework
I spent a little time walking through the third section of the book SQL Server Data Automation Through Frameworks: Building Metadata-Driven Frameworks with T-SQL, SSIS, and Azure Data Factory co-authored by (the) Kent Bradshaw and me. At the start of Part 1, I included thoughts about our first review. Part 1 did not go as planned. …
Continue reading An ADF Azure-SSIS Framework
SQL Data Partners Episode 215: Azure Data Factory
I was honored to chat with Carlos Chacon and Eugene Meidinger of SQL Data Partners about Azure Data Factory! :{>
Getting Started With ADF (Azure Data Factory)
Here’s a sample of a live stream I recorded today about Getting Started with ADF (Azure Data Factory)! You can view the full video here. Be sure to click Follow to be alerted when I stream live! :{> Need Help With ETL or Your Enterprise Data Warehouse? At Enterprise Data & Analytics, we believe you should ask …
Continue reading Getting Started With ADF (Azure Data Factory)
My Black Friday 2020 Sale is On!
Do you read my blog? Would you like to save money on Azure Data Factory and SSIS training (from me!) for a full year? For a limited time, you can save $4,000 (67%) on my Live ADF and SSIS Class Season Pass! Visit Enterprise Data & Analytics Training to view upcoming public course deliveries and …
Continue reading My Black Friday 2020 Sale is On!
Azure-SSIS Catalog Database Connection Failed
I was provisioning a new Azure Data Factory (ADF) Azure-SSIS Integration Runtime (IR) to conduct some testing and, when I clicked the “Test connection” link, I got a Connection failed error as shown in the red box: I clicked the “More” link to display details in the blue box To provision new Integration Runtime, Azure …
Continue reading Azure-SSIS Catalog Database Connection Failed
Azure Data Factory and SSIS Training 2020-Q4
Join me 16-19 Nov 2020 for four days of SQL Server Integration Services (SSIS) training! Days 1 and 2 focus on development using real-world data (I love AdventureWorks for demos, but real-world data is never that clean). Students complete 10 labs on days 1 and 2 and get to play the game What Will SSIS …
Continue reading Azure Data Factory and SSIS Training 2020-Q4
Honored to Present From Zero to ADF at SQLBits 2020!
I’m honored to deliver a Training Day at SQLBits 2020, which is now a virtual event! My training day will be delivered 30 Sep 2020 and is titled From Zero to Azure Data Factory. The agenda is: From Zero to Azure Data Factory is designed to jumpstart data engineering and data integration developers, introducing them …
Continue reading Honored to Present From Zero to ADF at SQLBits 2020!
One Way to Incrementally Develop ADF Pipelines
A friend pinged me recently to ask about rolling back Azure Data Factory (ADF) pipeline versions. My response was a question: Are you using source control with ADF? That did not help the current situation. I thought of the way I often build ADF pipelines and shared my methodology, which is relatively simple (it has …
Continue reading One Way to Incrementally Develop ADF Pipelines