I’m an automation weenie, that’s a fact. It’s why I’m drawn to frameworks – especially data engineering execution orchestration frameworks. Speaking of frameworks, if you haven’t checked out Martin Schoombee’s series titled Building a Framework for Orchestration in Azure Data Factory: A Series, you are missing out. First, Martin is scary smart. Second, he shares practical …
Continue reading One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API
Some Frank Thoughts About Newsletters
“We need to talk.” Actually, we don’t need to talk, but I would like to share some thoughts about newsletters and managing privacy, especially the privacy of email addresses. I Encourage You to Unsubscribe I can hear some of you thinking, “Wait, Andy. You send out newsletters and you’re encouraging your readers to unsubscribe?” Yep. I’m only …
Continue reading Some Frank Thoughts About Newsletters
Announcing Data Engineering Fridays!
I’m excited to announce Data Engineering Fridays! I can hear some of you thinking, … “What are Data Engineering Fridays, Andy?” That’s an awesome question! I’m glad you asked. Data Engineering Fridays is a weekly stream, between 24 May and 23 Aug 2024, in which I lead a discussion about data engineering-related topics. The 24 …
Continue reading Announcing Data Engineering Fridays!
Join me for A Day of Fabric Data Factory 24 Jun 2024!
Join me 9:00 AM-4:30 PM EDT 24 Jun 2024 for a full day of live and online training! Register today for A Day of Fabric Data Factory and save! Discount ends soon. Course Description Do you want to learn more about cloud data integration using Fabric Data Factory? Is your enterprise planning to migrate its …
Continue reading Join me for A Day of Fabric Data Factory 24 Jun 2024!
Why is There an Image on Empty Fabric Synapse Data Engineering Screens?
I’m not sure why there’s an image on empty Microsoft Fabric Synapse Data Engineering screens, but I have a theory. My theory makes sense if you compare a Fabric Synapse Data Engineering screen with the image and verbiage, “There’s nothing here yet Add something new, or upload something to see them here.” with the Fabric …
Continue reading Why is There an Image on Empty Fabric Synapse Data Engineering Screens?
Presenting A Day of Fabric Data Factory 17 May 2024 at Richmond SQL Saturday
I’m honored to deliver A Day of Fabric Data Factory – a full day of Microsoft Fabric Data Factory training 17 May 2024! In this session, we discuss data engineering using Microsoft Fabric Data Factory, compare Azure Data Factory with Fabric Data Factory, and demonstrate how to use Data Factory for data engineering in the modern …
Continue reading Presenting A Day of Fabric Data Factory 17 May 2024 at Richmond SQL Saturday
Scaffold Design Pattern in Fabric Data Factory Pipeline
When assigned a project, it’s tempting – and dangerous – to Just Start Coding. If you suffer from the urge to develop first and design later, you are not alone (there’s at least one other developer like you and he’s typing this post). Do yourself a favor and… Design First As the definition of “design” …
Continue reading Scaffold Design Pattern in Fabric Data Factory Pipeline
#TSQL2sday Has AI Helped you with your SQL Server Job?
This month’s T-SQL Tuesday is hosted by my friend and brother from another mother, Pinal Dave. My job title is Chief Data Engineer for Enterprise Data & Analytics and Enterprise Data & AI. So, “Has AI Helped you with your SQL Server Job?” In a word, yes. I can hear some of you thinking, … …
Continue reading #TSQL2sday Has AI Helped you with your SQL Server Job?
One Way to Build a Custom GPT
As I stated in my post titled Three Ways to Work with LLMs, I’ve built a handful of custom GPTs. Custom GPTs allow users to configure personal* chatbots. For example, you could base a GPT on your favorite coach or someone famous. You could add more people to the mix for a blend of context. …
Continue reading One Way to Build a Custom GPT
Three Ways to Work with LLMs
I am admittedly fascinated with large language models. I’ve been enamored with the idea of automated assistants since before the days of Microsoft Bob. The notion of a searchable, integrated, digital-life-spanning, automatable solution appealed to me. I can hear some of you thinking, “Why did it appeal to you, Andy?” I cannot articulate a rational answer …
Continue reading Three Ways to Work with LLMs