Animations

Airport Algorithm

Multi-Value-Functions: Efficient Automatic Action Hierarchies for Multiple Goal MDPs

paper

Quickly computing all policies for all goals in a noisy maze

Example execution of "all goals" policy

movie

Using "all goals" to chase stupid bad guys

movie

Using "all goals" to chase simplistic bad guys

movie

Using "all goals" to chase frightened bad guys

movie

Using "all goals" to chase intelligent bad guys

movie

Anchors

The Anchors Hierarchy: Using the Triangle Inequality to Survive High-Dimensional Data

Efficient spatial partioning with size criterion

Efficient spatial partioning with space criterion

movie

Anomaly Hunting

Using Tarjan's Red Rule for Fast Dependency Tree Construction

Finding anomalous records in huge datasets using human feedback to focus on interesting galaxies in Sloan data

Robot Skill Learning

High Dimension Action Spaces in Robot Skill Learning

A PUMA robot learns to throw a tennis ball in 100 trials using combination of active learning and kd-trees ( learning phase )

FLINK

Stochastic Link and Group Detection

paper

Learning social networks from massive noisy transactional data

GoodWalk

Policy Search by Dynamic Programming

Fast search for good walking policies on [Zeglin03] robot simulator using logistic regression and PSDP

Kmeans

Accelerating Exact k-means Algorithms with Geometric Reasoning

paper

Accelerated learning of K-means model and automatic estimation of number of clusters

Dualtree K-Nearest Neighbor

N-Body Problems in Statistical Learning

Fast search for the k-nearest neighbor data points to some query points in k-dimensional space (different k!)

Fast Mixture Learning

Very Fast EM-based Mixture Model Clustering Using Multiresolution KD-trees

Accelerating Gaussian Mixture Learning with Multi-resolution trees

PARTI-GAME

The Parti-game Algorithm for Variable Resolution Reinforcement Learning in Multidimensional State-spaces

Multi-resolution reinforcement learning algorithm

Pool playing

Locally Weighted Learning for Control

paper

Robot learning to play pool using locally weighted linear regression

Fast Scan Statistics

Rapid Detection of Significant Spatial Clusters

paper

Analysing National Retail Pharmacy Sales data to find regions with unusual increase in counts

Variable Resolution Dynamic Programming

Variable Resolution Discretization in Optimal Control

Optimal control of acrobot (two joint arm with unpowered shoulder) using automatically learned partioning of state space

Optimal control of car-on-hill using automatically learned partioning of state space