Data Science Blog

Data Exploration with Pandas Profiler and D-Tale

We all have heard how data is the new oil. I always say that if that is the case, we need to go through some refinement process before that raw oil...

Data Science Code Data Science Featured Homepage Featured Main Practical Techniques Python Pandas D-Tale EDA

Explaining black-box models using attribute importance, PDPs, and LIME

In this article we cover explainability for black-box models and show how to use different methods from the Skater framework to provide insights...

Data Science Code Homepage Featured Main Machine Learning Python Explainability Deep Learning

Building a Named Entity Recognition model using a BiLSTM-CRF network

In this blog post we present the Named Entity Recognition problem and show how a BiLSTM-CRF model can be fitted using a freely available annotated...

Data Science Code Homepage Featured Main Machine Learning Machine Learning Featured Python NLP

Accelerating model velocity through Snowflake Java UDF integration

Over the next decade, the companies that will beat competitors will be “model-driven” businesses. These companies often undertake large data...

Code Engineering Domino Product Domino Practical Techniques Data Engineering Datasets snowflake Practical Techniques Featured

Fitting Support Vector Machines via Quadratic Programming

In this blog post we take a deep dive into the internals of Support Vector Machines. We derive a Linear SVM classifier, explain its advantages, and...

Data Science Code Data Science Featured Machine Learning SVM Python

ML internals: Synthetic Minority Oversampling (SMOTE) Technique

In this article we discuss why fitting models on imbalanced datasets is problematic, and how class imbalance is typically addressed. We present the...

Data Science Code Homepage Featured Main Machine Learning Practical Techniques

Credit Card Fraud Detection using XGBoost, SMOTE, and threshold moving

In this article, we'll discuss the challenge organizations face around fraud detection, how machine learning can be used to identify and spot...

Data Science Code Machine Learning Practical Techniques xgboost Predictive Models Python ROC AUC Metric

On-Demand Spark clusters with GPU acceleration

Apache Spark has become the de facto standard for processing large amounts of stationary and streaming data in a distributed fashion. The addition...

Code Engineering Engineering Featured Compute Environments Machine Learning High-Performance Computing RAPIDS Spark GPU

How to Supercharge Data Exploration with Pandas Profiling

Producing insights from raw data is a time-consuming process. Predictive modeling efforts rely on dataset profiles, whether consisting of summary...

Data Science Code Data Science Featured Domino Practical Techniques Python Pandas data Profile

Simplify data access and publish model results in Snowflake using Domino Data Lab

Introduction Arming data science teams with the access and capabilities needed to establish a two-way flow of information is one critical...

Data Science Domino Users Code Data Science Teams Domino Product Domino Practical Techniques Data Engineering Datasets Data Scientists snowflake Homepage Featured Secondary Managing Data Science Featured

Performing Non-Compartmental Analysis with Julia and Pumas AI

When analysing pharmacokinetic data to determine the degree of exposure of a drug and associated pharmacokinetic parameters (e.g., clearance,...

Code Practical Techniques Data Science Education pharmacokinetic analysis julia Practical Techniques Featured

Density-Based Clustering

Original content by Manojit Nandi - Updated by Josh Poduska. Cluster Analysis is an important problem in data analysis. Data scientists use...

Data Science Code Data Science Featured Homepage Featured Main Practical Techniques R Python data

Bringing ML to Agriculture: Transforming a Millennia-old Industry

Guest post by Jeff Melching from The Climate Corporation At The Climate Corporation, we aim to help farmers better understand their operations and...

Data Science Code AWS Homepage Featured Main Machine Learning Practical Techniques Model Production Data Science Education Data Scientists Best Practices Feature Engineering Climate data Model Development model

The Curse of Dimensionality

Guest Post by Bill Shannon, Founder and Managing Partner of BioRankings Danger of Big Data Big data is the rage. This could be lots of rows (samples)...

Data Science Leaders At Work Code Code Featured Homepage Featured Main biorankings Practical Techniques Data Science Leaders Data Analysis Data Engineering Datasets Deep Learning Practical Techniques Featured data