In this article we present LightTracker -- an open-source toolkit for vision-based multi-touch setups. Using this toolkit, we can dynamically create and manipulate the image processing pipeline at runtime. After presenting various new requirements derived from hardware configurations as well as literature review, features and shortcomings of available tracking solutions are discussed and compared to our proposed toolkit. This is followed by a detailed description of the toolkit’s functionality, including the filter chain and the improved calibration module. We also present implementation details such as the plug-in system and the multithreaded architecture. To illustrate the advantages of the toolkit, an interactive gaming couch table based on LightTracker is introduced.