Andy Leonard shares two recordings about using the SSIS Catalog to manage enterprise data engineering.
Category:SSIS Frameworks
You Might Need an SSIS Framework
You might need an SSIS framework. “How can I tell if I need an SSIS framework, Andy?” I’m glad you asked. Does your enterprise: Practice DevOps? Execute lots of SQL Server Integration Services (SSIS) packages? Execute SSIS packages several times per day? Execute “SSIS in the Cloud” using the Azure Data Factory version 2 Integration …
Continue reading You Might Need an SSIS Framework
Honored to Deliver Intelligent Data Integration – a PASS Summit 2018 Precon
I’m honored to deliver my full-day precon, Intelligent Data Integration with SSIS, at the PASS Summit 2018! You can see a list of other precons at the PASS Summit 2018 Pre-Conference Sessions page. I refer to this group as “a bunch of really smart people… plus me!” Abstract What is Intelligent Data Integration? SSIS (SQL Server …
Continue reading Honored to Deliver Intelligent Data Integration – a PASS Summit 2018 Precon
Why I Built SSIS Framework Community Edition, by Andy Leonard
A few weeks ago I published a blog post titled Why I Built DILM Suite, by Andy Leonard – an excerpt from the book Data Integration Life Cycle Management with SSIS. Last week I published Why I Built SSIS Catalog Compare, by Andy Leonard, another excerpt from the book. This post is another excerpt of the same book. Enjoy! A …
Continue reading Why I Built SSIS Framework Community Edition, by Andy Leonard
Parallel Execution in SSIS Framework Community Edition
A number of folks are using the SSIS Framework Community Edition. I know because I continue to get interesting questions about it! Before I write more, I’d like to invite users to the DILM Suite Slack channel for Community Edition. If you cannot join, please let me know ([email protected]) and I will invite you! For …
Continue reading Parallel Execution in SSIS Framework Community Edition
Presenting DevOps for SSIS 08 Feb 2018
I am honored to present DevOps for SSIS (or Data Integration Lifecycle Management) for the PASS DevOps Virtual Chapter 08 Feb 2018. Abstract: DevOps for SSIS (or Data Integration Lifecycle Management) How does SSIS participate in enterprise DevOps? Sharing topics from his latest book (Data Integration Life Cycle Management with SSIS), author and presenter Andy …
Continue reading Presenting DevOps for SSIS 08 Feb 2018
Apache Storm Stream Processing in Azure HDInsight
I’m learning more about Apache Storm which is used for stream processing for near-real-time analytics in Azure HDInsight. I grabbed the image above from an AWS presentation on slideshare (link). I got all giggly inside as I learned about Storm architecture. Why? Because I built this much of this same functionality as part the DILM …
Continue reading Apache Storm Stream Processing in Azure HDInsight
The Next Book Project: Frameworks
Kent Bradshaw, Shannon Lowder, and I explore stored procedure-based data integration patterns, an SSIS execution framework, and two Biml frameworks in a book we are writing, tentatively titled Frameworks.
The Next Expert SSIS Delivery is 2.5 Days – 5-7 Mar 2018!
Yep, we’re doing it again! In cooperation with Brent Ozar Unlimited, the next delivery of Expert SSIS Training is 5-7 Mar 2018. I had a great time delivering this course with Brent in September and December 2017 and I’m excited to have the opportunity to share this material with you again! We’ve extended the course …
Continue reading The Next Expert SSIS Delivery is 2.5 Days – 5-7 Mar 2018!
On Data Frameworks…
You may not realize this, but Apache Spark is a framework. Spark is cluster-computing engine that manages parallel executions extremely well. Spark enables other technologies including Java, Scala, Python, R, and graph processing. Spark stitches together previously-disparate functionality into a cohesive, syntactically-similar set of commands. Spark’s architecture is library-driven and includes the following libraries: Spark SQL …
Continue reading On Data Frameworks…