The Rapidfuzz Library As A Golden Record SolutionI recently used the python library rapidfuzz to golden some records. This post provides some thoughts on data curation that you can use…Jan 7Jan 7
Possibly Hiring Soon — 2025 And BeyondOver the next two years, I will be looking for top level talented data engineers. as I am working with several clients across the globe…Sep 23, 2024Sep 23, 2024
Row Level Security Deep Dive In SQL ServerRow level security (RLS) provides us with a security tool that can limit data access on the row level of data. This security technique…May 3, 2024May 3, 2024
VNet Injection With Azure DatabricksOne challenge that we can face with labor division involves two teams that must design the appropriate technical architecture with neither…Apr 6, 20244Apr 6, 20244
Azure Data Factory Error — Substantial Concurrent MappingDataflow ExecutionsErrorMar 5, 2024Mar 5, 2024
Dynamic Data Masking Basics In SQL ServerIn this post, we’ll look at an example of data masking in SQL Server using three data masking functions with email. I use emails across the…Feb 18, 20242Feb 18, 20242
How To Create A Date Dimension In Python PandasIn this post, we look at creating a date dimension using python pandas. Pandas is one of the easiest libraries to use in python and can…Feb 17, 202462Feb 17, 202462
Azure Storage Access Deep DiveIn this post we look at some of the basics of Azure RBAC roles with Azure storage before diving into deeper access levels with Azure…Feb 15, 20242Feb 15, 20242
Using the OPENJSON Function In SQL ServerIn this post we look at using the OPENJSON function in SQL Server to parse some example JSON documents. As a quick note, I would not use…Feb 14, 202453Feb 14, 202453
Storage and Resource Sharding and Partitioning With Azure ResourcesIn this post, we look at sharding and partitioning approaches with various Azure technologies. This post is a work in progress and will be…Feb 12, 2024Feb 12, 2024
Setting Up Transparent Data Encryption Within AzureOne method of securing data uses transparent data encryption (TDE). For the sake of this post, we’ll be looking at transparent data…Feb 11, 2024Feb 11, 2024
Using String Functions With SQLIn this post, we’ll quickly look at some string functions that we can use in some SQL languages (examples are all T-SQL and some of these…Feb 10, 2024Feb 10, 2024
When To Use SQL or NoSQLIn the video When To Use SQL and NoSQL, I compare a data example and how each would appear as an entity in a SQL and NoSQL database. In the…Feb 1, 20241Feb 1, 20241
How To Compare 2 Tables In Different DatabasesIn the video, SQL Basics: Compare Tables In 2 Different Databases, we look at how to compare two tables using SQL. In the context of the…Jan 27, 2024Jan 27, 2024
The Most Common Joins Solved In SQL, Pandas and PysparkThe most common joins I’ve seen and created involve inner joins, left joins (or left anti joins), outer joins, cross joins and left semi…Dec 11, 2023Dec 11, 2023
Published inOSINT TeamWhy Everyone Is Panicking Over LinkabilityIn the videos what is linkability and linkability and data leaks, I cover the topic of linkability and how this impacts your security with…Nov 24, 2023Nov 24, 2023
Connecting A Data Factory To An Existing Runtime In AzureWith Azure Data Factory, we can connect on premise assets to Azure resources, such as an on premise database to an Azure database. At this…Oct 29, 2021Oct 29, 2021
T-SQL: How To UNION ALL Tables and WhyIn some cases, we need to combine the result of two tables where data types may be similar or identical. We could combine the data in one…Oct 9, 2021Oct 9, 2021
Solving Data Differentials With LEFT JOINsOne challenge we face with data involves new and existing data from a source data set to a destination data set. The source and destination…Sep 30, 2021Sep 30, 2021