2022-11-09

SumTree data structure for Prioritized Experience Replay (PER) explained with Python Code

14 mins read Weighted sampling from a list-like collection is an important activity in many applications. Weighted sampling involves selecting samples randomly from […]
2022-10-24

How to return pandas dataframes from Scikit-Learn transformations: New API simplifies data preprocessing

3 mins read Scikit-learn, a popular Python library for machine learning, is often one of the first tools introduced to data science beginners. […]
2022-09-20

Guidelines to use Transfer Learning in Convolutional Neural Networks

9 mins read Transfer Learning How to adapt an expert’s CNN architecture that has already learned so much about how to find the […]
2022-09-06

Understand Q-Learning in Reinforcement Learning with a numerical example and Python implementation

14 mins read This tutorial introduces the concept of Q-learning through a simple but comprehensive numerical example.  The example describes an agent which […]
2022-08-30

Setup collaborative MLflow with PostgreSQL as Tracking Server and MinIO as Artifact Store using docker containers

14 mins read In this post, I will show how to configure MLflow in a way that allows multiple data scientists using different […]