A guide on PySpark Window Functions with Partition By

11 mins read Pyspark window functions are useful when you want to examine relationships within groups of data rather than between groups of […]

Setting up a multi-node Apache Spark Cluster on a local Windows machine with Virtual Box

6 mins read Prerequisite Understand how to install Ubuntu inside Windows using Oracle VM VirtualBox from this Link Apache Spark is a fast and […]

Useful magic commands in Jupyter Notebook/Lab

30 mins read Jupyter Notebook/Lab is the go-to tool used by data scientists and developers worldwide to perform data analysis nowadays. It provides […]

Different approaches for finding feature importance using Random Forests

16 mins read In many (business) cases it is equally important to not only have an accurate, but also an interpretable model. Oftentimes, […]

Common loss functions for training deep neural networks with Keras examples

30 mins read Deep neural networks are trained using the stochastic gradient descent optimization algorithm. As part of the optimization algorithm, the error for […]

Handling skewness in features by applying transformation in Python

13 mins read In this tutorial, you will learn how to deal with your data when it is not following the normal distribution. One […]

Out of Bag (OOB) score in Random Forests with example

12 mins read Introduction This post describes the intuition behind the Out of Bag (OOB) score in Random forest, how it is calculated, […]

Understanding the Random Forest algorithm and its hyperparameters

17 mins read In this post, we will see how the Random Forest algorithm works internally. To truly appreciate it, it might be […]

Machine Learning From Scratch Series: K-means Clustering

22 mins read Introduction Clustering is one of the most common exploratory data analysis techniques used to get an intuition about the structure of […]

Feature selection for categorical data with Python code

17 mins read Feature selection is the process of identifying and selecting a subset of input features that are most relevant to the target […]

Basic feature engineering tasks for numeric and categorical data with Python code

34 mins read Machine learning pipelines Any intelligent system basically consists of an end-to-end pipeline starting from ingesting raw data and leveraging data […]

Interpreting ACF and PACF Plots for AR and MA models

12 mins read Autocorrelation analysis is an important step in the Exploratory Data Analysis of time series forecasting. The autocorrelation analysis helps detect patterns […]

Understanding Alternating Least Squares algorithm for implicit collaborative filtering recommendations

23 mins read Overview We’re going to write a simple implementation of an implicit (more on that below) recommendation algorithm. We want to […]

Implementing Attention Mechanism in Python

7 mins read The attention mechanism was introduced to improve the performance of the encoder-decoder model for machine translation. The idea behind the […]

An illustrated guide to Attention Mechanism in Sequence Models with PyTorch code

22 mins read In this article, I will be covering the main concepts behind Attention, including the implementation of a sequence-to-sequence Attention model, […]

Understanding Self-Attention in Transformers with example

10 mins read What do BERT, RoBERTa, ALBERT, SpanBERT, DistilBERT, SesameBERT, SemBERT, SciBERT, BioBERT, MobileBERT, TinyBERT and CamemBERT all have in common? And […]

Walk-forward optimization for algorithmic trading strategies on cloud architecture

11 mins read Table of Contents: Introduction Terminology Walk-forward Optimization Design of walk-forwards The Architecture Configuring cloud machines using Ansible Docker Swarm Optimization […]

Sampling from a multivariate Gaussian (Normal) distribution with Python code

3 mins read Steps: A widely used method for drawing (sampling) a random vector  from the N-dimensional multivariate normal distribution with mean vector  and covariance […]

Understanding Expectation-Maximization (EM) algorithm with an example in Python

7 mins read Suppose we have some data sampled from two different groups, red and blue: Here, we can see which data point […]

Using pre-commit and Makefile for Python code development workflow

5 mins read Introduction When developing Python code we are constantly adding and committing changes. However, nothing stops us from committing low-quality code, e.g. code […]