Hand Gesture Recognition


Implementation can be downloaded here

Gestures Correctly Dectected



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gestures Incorrectly Dectected

Hand gestures will be denote as a 5 digit binary number.
A 1 indicates the finger is up and 0 indicates the finger is down.
The left most digit represents the pinky, the next digit to the right represents the ring finger, and so on.
For example, 10001 indicates the pinky and thumb are up.


Gesture Detected as 00100 (actual is 00101)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gesture Detected as 00110 (actual is 00111)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gesture Detected as 01101 (actual is 01110)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gesture Detected as 01000 (actual is 10000)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gesture Detected as 10001 (actual is 10010)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gesture Detected as 01010 (actual is 10100)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gesture Detected as 10101 (actual is 10110)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gesture Detected as 10110 (actual is 10111)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)



Gesture Detected as 01100 (actual is 11101)

Original Image

Skin Segmentation

Wrist Location Detection Graph (wrist location indicated by circle)

Distance from centroid to contour points

Contour plot with fingertip locations (fingertip locations indicated by square, centroid indicated by circle)