09 Aug 2023 Update: Yitzhak Khabinsky and I met via Microsoft Teams to continue the conversation that started in the comments section of this post and was continued on LinkedIn. There will likely be more to come… Why Use XML to Transfer Data? I asked Brave Search, “Why use XML?” Brave responded with a Summarizer …
Continue reading XMheck (formerly “XMhell”)
Tag:Data Integration
Why I Do Not Mix High Availability with Reporting Solutions
One way to offload reporting requirements from the Production OLTP (OnLine Transaction Processing) database while providing a near-real-time copy of Production data is to execute reporting and analytics queries against a High Availability solution replica – such as SQL Server Availability Groups. Learn more about Availability Groups On at: Overview of Always On Availability Groups (SQL Server). “Why …
Continue reading Why I Do Not Mix High Availability with Reporting Solutions
Coming Soon: SSIS Catalog Compare Updates
I spent a lot of time this year writing and managing a book project. I will blog about that later, I promise. While I enjoy writing it really cuts into my play time. What do I do when I play? I write software. This weekend I cracked open the code for SSIS Catalog Compare and …
Continue reading Coming Soon: SSIS Catalog Compare Updates
Intelligent Data Integration, SSIS Design Patterns, and Biml
On occasion I have the privilege and honor of delivering a full-day precon titled Intelligent Data Integration: SSIS Design Patterns and Biml as part of SQL Saturday events. “Isn’t This The Same Presentation You Delivered Before, Andy?” Yes and no. It has the same title but… I’ve focused on Biml presentations for the past two years. Over the …
Continue reading Intelligent Data Integration, SSIS Design Patterns, and Biml
The Recording for Designing an SSIS Framework is Now Available
Kent Bradshaw and I had a great crowd, lots of awesome questions, and delivered good demonstrations at the Designing an SSIS Framework webinar. You can view the webinar for free (although registration is required) here. In the webinar Kent and I discussed the following Data Integration Lifecycle Management Suite products: SSIS Framework Community Edition – free and open source Catalog Reports – …
Continue reading The Recording for Designing an SSIS Framework is Now Available
Why Automate?
This post was originally published at SQLBlog. Because, as Jen Underwood (jenunderwood.com | LinkedIn) states in the Data Driven podcast Jen Underwood on Data Visualization and Automating Data Science: The future of data science is automation. If automation is the future, how do we decide what to automate? We look for the long pole. What’s the long pole in data science? …
Continue reading Why Automate?
Data Wrangling Concepts: Latency and Staleness
This post was originally published at SQLBlog. Latency is the amount of time between data creation and load. Staleness is the amount of time since data in a target was refreshed. In many data integration use cases, a latency or staleness of one day, one week, or even one month is acceptable. Enterprise Data & Analytics helps enterprise data integration teams …
Continue reading Data Wrangling Concepts: Latency and Staleness