SheeTra

SheeTra allows for tracking of physical sheets on multi-touch tables. The project is written in C++ and contains two different trackers: A shadow tracker for markerless tracking using the infrared camera inside the table and a marker-based tracker using the Studierstube Tracker and cameras mounted above the table.

Input image recognized by the infrared camera — **Shadow Tracking:** (left) input image recognized by infrared camera; (right) output of Harris corner detection.

Output of Harris corner detection — **Shadow Tracking:** (left) input image recognized by infrared camera; (right) output of Harris corner detection.

Tabletop setup for marker tracking — **Marker Tracking:** (left) tabletop setup; (right) example of a paper sheet arrangement, including the calculated z-indices.

Arrangement of paper sheets with calculated z-indices — **Marker Tracking:** (left) tabletop setup; (right) example of a paper sheet arrangement, including the calculated z-indices.

This physical sheet data is the foundation of a project with two other groups to explore interaction with physical and digital sheets on tabletops.

SheeTra was developed together with Jan Riemann, Andre Wisplinghoff and Maik Thöner. It was part of the lecture Projektpraktikum Telekooperation at TU Darmstadt during the winter term 2009/2010. The project was supervised by Jürgen Steimle and Mohammadreza Khalilbeigi.