I got a great question from a student in the December delivery of Expert SSIS. A student asked, “Why wouldn’t you use Environments in Visual Studio (Dev, Test, and Prod), and deploy accordingly the mapped project parameters and package parameters?” I’ve looked into using SQL Server Data Tools (SSDT, or Visual Studio) configurations in the …
Continue reading SSIS and Visual Studio Configurations
Author:Andy Leonard
Christian, husband, dad, grandpa, Data Philosopher, Data Engineer; Azure Data Factory, Fabric Data Factory, and SSIS guy; and farmer. I was cloud before cloud was cool. :{>
On Data Frameworks…
You may not realize this, but Apache Spark is a framework. Spark is cluster-computing engine that manages parallel executions extremely well. Spark enables other technologies including Java, Scala, Python, R, and graph processing. Spark stitches together previously-disparate functionality into a cohesive, syntactically-similar set of commands. Spark’s architecture is library-driven and includes the following libraries: Spark SQL …
Continue reading On Data Frameworks…
Learning Goals for 2018 – T-SQL Tuesday #97
My friend and #SqlFamily sister Mala hosts this month’s T-SQL Tuesday topic: Setting learning goals for 2018. It’s a timely topic for me as I’ve recently engaged in more formalized training. Mala’s questions: What do you want to learn? (specific skills and talents) How and when do you want to learn? (methods of learning and …
Continue reading Learning Goals for 2018 – T-SQL Tuesday #97
Achievement Unlocked: Certified in Implementing Predictive Analytics with Spark in Azure HDInsight
I learned a lot taking the course Implementing Predictive Analytics with Spark in Azure HDInsight! I’m slowly working my way through the Data Science Certification offered by Microsoft Virtual Academy along with edX. This course is not part of the official curriculum, but I’ve been wanting to learn more about Spark so I took it. Many of the courses …
Continue reading Achievement Unlocked: Certified in Implementing Predictive Analytics with Spark in Azure HDInsight
I Love Delivering Training
In December 2017, I delivered Expert SSIS training in cooperation with Brent Ozar Unlimited. I’m a Star Trek fan and I include a couple references to the series in the course. One reference is to the episode titled The City on the Edge of Forever. In my humble opinion, the plot for this episode is better …
Continue reading I Love Delivering Training
Presenting A Day of Intelligent Data Integration in NYC 18 May!
I’m honored to present A Day of Intelligent Data Integration – a SQL Saturday NYC precon – 18 May! Description What is Intelligent Data Integration? SSIS packages developed using tried and true design patterns, built to participate in a DevOps enterprise practicing DILM, produced using Biml and executed using an SSIS Framework. Attend a day …
Continue reading Presenting A Day of Intelligent Data Integration in NYC 18 May!
SSIS Design Patterns: Sniffer (File Watcher)
Nutmeg, the Wonder Dog, Sniffing Have you seen the SSIS File Watcher demos where a developer puts an SSIS package in an infinite loop while it waits for a file to show up in a directory? It’s a popular pattern, especially when files are FTP’d (or SFTP’d) to enterprises for processing. I’ve seen way too …
Continue reading SSIS Design Patterns: Sniffer (File Watcher)
Data Integration Life Cycle Management with SSIS is Available!
My latest book – Data Integration Life Cycle Management with SSIS – is now available! In this focused (185-page) book, I walk through ways to manage SSIS in the enterprise using what ships in the box. I point out what works well and what’s missing. I share workarounds for the stuff that’s missing, and then I …
Continue reading Data Integration Life Cycle Management with SSIS is Available!
Achievement Unlocked: Completed Processing Big Data in Hadoop with Azure HDInsight
I love learning! As Buck Woody (@BuckWoodyMSFT) mentioned in his post titled Don’t learn to be a Data Scientist, one should continuously learn – especially in this field. I’m happy to announce I just earned a certificate for DAT202.1x: Processing Big Data with Hadoop in Azure HDInsight! I’m slowly working my way through the Data Science …
Continue reading Achievement Unlocked: Completed Processing Big Data in Hadoop with Azure HDInsight
One Way to Connect PSDrive to a SQL Server Instance
“Everyone Stand Back! I’m Learning PowerShell!” I keep telling folks, “Learn new stuff” and “then blog about it!” I figured it’s time I take my own advice. I’m reading Learn Windows PowerShell in a Month of Lunches by Don Jones (@concentrateddon). I’m actually reading the first edition. I bought the book a while back and I’m …
Continue reading One Way to Connect PSDrive to a SQL Server Instance