You may not realize this, but Apache Spark is a framework. Spark is cluster-computing engine that manages parallel executions extremely well. Spark enables other technologies including Java, Scala, Python, R, and graph processing. Spark stitches together previously-disparate functionality into a cohesive, syntactically-similar set of commands. Spark’s architecture is library-driven and includes the following libraries: Spark SQL …
Continue reading On Data Frameworks…
Category:DILM Suite
Data Integration Life Cycle Management with SSIS is Available!
My latest book – Data Integration Life Cycle Management with SSIS – is now available! In this focused (185-page) book, I walk through ways to manage SSIS in the enterprise using what ships in the box. I point out what works well and what’s missing. I share workarounds for the stuff that’s missing, and then I …
Continue reading Data Integration Life Cycle Management with SSIS is Available!
Presenting A Day of Intelligent Data Integration at SQL Saturday Richmond!
I am honored to present my day-long precon titled SSIS Design Patterns and Biml: A Day of Intelligent Data Integration at SQL Saturday 705 – Richmond 23 Mar 2018! Description What is Intelligent Data Integration? SSIS packages developed using tried and true design patterns, built to participate in a DevOps enterprise practicing DILM, produced using Biml and executed using …
Continue reading Presenting A Day of Intelligent Data Integration at SQL Saturday Richmond!
Data Integration Life Cycle Management with SSIS: A Short Introduction by Example is Available for Pre-Order!
I’m excited to announce that book #3 for 2017 is available for pre-order at Amazon! Data Integration Life Cycle Management with SSIS: A Short Introduction by Example is a(nother) short-ish book (~112 pages) that offers insight into managing SQL Server Integration Services (SSIS) in an enterprise. I wrote the book to demonstrate managing SSIS as it …
Continue reading Data Integration Life Cycle Management with SSIS: A Short Introduction by Example is Available for Pre-Order!
Expert SSIS Training 4-5 Dec 2017!
Yep, we’re doing it again. In cooperation with Brent Ozar Unlimited, the next delivery of Expert SSIS Training is 4-5 Dec 2017. I had a great time delivering this course with Brent in September and I’m excited to have the opportunity to share this material with you again! If you register soon (written 27 Sep …
Continue reading Expert SSIS Training 4-5 Dec 2017!
Presenting at the Seattle SQL Pro Workshop 2017
I am honored to be among the presenters at the Seattle SQL Pro Workshop 2017! Also presenting are Jason Brimhall, Louis Davidson, Jimmy May, Gail Shaw and Wayne Sheffield. I’m looking forward to learning a bunch from these smart folks! My session is titled Designing an SSIS Framework: In this “demo-tastic” presentation, SSIS trainer, author, and …
Continue reading Presenting at the Seattle SQL Pro Workshop 2017
Presenting at Chicago Suburban SQL Server User Group 3 Oct!
I am honored to present Designing an SSIS Framework at the Chicago Suburban SQL Server User Group Tuesday 3 Oct 2017! Learn more and register here. I hope to see you there! :{>
Available for Pre-Order – The Biml Book!
I am excited to announce The Biml Book is now available for pre-order from Amazon and Apress! I was honored to write with the inventor of Biml, Scott Currie, and an awesome team of BimlHeroes: Jacob Alley, Martin Andersson, Peter Avenant, Bill Fellows, Simon Peck, Reeves Smith, Raymond Sondak, Benjamin Weissman, and Cathrine Wilhelmsen. Chapters …
Continue reading Available for Pre-Order – The Biml Book!
BLObs in SSIS – Part 2 – The BLOb-Load Turbo Button.
As we saw in the first post in this series – BLObs in SSIS – Part 1 – How Does SSIS Load BLObs? – SSIS copies BLObs from their source to the location stored in the TEMP and TMP operation system environment variables. That location defaults to %USERPROFILE%\AppData\Local\Temp. That’s a problem because that default location …
Continue reading BLObs in SSIS – Part 2 – The BLOb-Load Turbo Button.
SSIS Version 15.0 Script Error
There I was… Delivering ExpertSSIS training with Brent Ozar Unlimited (we’re going to present another ExpertSSIS class – stay tuned for more information). I scheduled the execution of an SSIS package that contains a Script Task via SQL Agent, executed the job, and boom: “Excellent teaching moment,” I thought as I opened SSIS Catalog Overview and …
Continue reading SSIS Version 15.0 Script Error