Abstract
Currently, almost all information retrieval systems utilize a textual interface for users to express their information needs. While this works perfectly well for searching text document collections, there are domains in which textualizing a query or context is much harder. One of these domains is the preservation of cultural heritage practices in the form of artifact usage, which involves the capture and representation of intangible assets. We have started work on a project in which we want to focus on the domain of (hand-held) tools and their use, going beyond a description in the form of text or 2D images. Our aim is to record the gestures necessary to operate the tools and to make a collection of tools accessible with this information, providing a much richer context.