I. The Thesis in a Nutshell
The thesis rethinks how user interfaces can provide useful digital functionality while maintaining their material properties and familiar patterns of use in the real world. However, the development of such hybrid interfaces raises overarching research questions about the design:
- What type of digital enhancement will improve existing physical interfaces?
- How can hybrid interfaces retain their material properties and its familiar context of use?
- What are suitable methods to explore different design parameters?
- How to support end-user prototyping?
For a systematic investigation, the thesis builds on a design-oriented, exploratory, and iterative development process using digital fabrication methods and novel materials. As a main contribution, four specific research projects are presented that apply and discuss different visual and interactive augmentation principles along real-world applications. The applications range from digitally-enhanced paper, interactive cords over visual watch strap extensions to novel prototyping tools for smart garments. While almost all of them integrate visual feedback and haptic input, none of them are built on rigid, rectangular pixel screens or use standard input modalities, as they all aim to reveal new design approaches.
The dissertation shows how valuable it can be to rethink familiar, analog applications while thoughtfully extending them digitally. Finally, this thesis’ extensive work of engineering versatile research platforms is accompanied by overarching conceptual work, user evaluations and technical experiments, as well as literature reviews.
Quick Access
- The Thesis in a Nutshell
- The Thesis Document
- Research Projects
- Further Publications
- Related Student Theses
Defense
The successful defense of the PhD thesis took place on January 26, 2023.
II. The Thesis Document
@phdthesis{Klamka2023,
author = {Konstantin Klamka},
title = {Blending the Material and Digital World for Hybrid Interfaces},
year = {2023},
month = {2},
location = {Dresden},
numpages = {197},
url = {https://nbn-resolving.de/urn:nbn:de:bsz:14-qucosa2-834637},
publisher = {Qucosa - Technische Universit\"{a}t Dresden}
}List of additional material
III. Research Projects
1.
Enhancing Artifacts
Illuminated Interactive Paper
The project presents how paper can be digitally enhanced with integrated visual feedback and versatile input modalities (e.g., pen, touch, paper folding gestures). In particular, the work investigated how natural properties (e.g., haptic paper qualities) and familiar usage pattern can be maintained while simultaneously integrating rich digital functions which build on emerging printed electronics and novel thin-film display technologies.
@inproceedings{Klamka2017d_IllumiPaper_ISS,
author = {Konstantin Klamka and Wolfgang B\"{u}schel and Raimund Dachselt},
title = {Illuminated Interactive Paper with Multiple Input Modalities for Form Filling Applications},
booktitle = {Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces},
series = {ISS '17},
year = {2017},
month = {10},
isbn = {978-1-4503-4691-7},
location = {Brighton, United Kingdom},
pages = {434--437},
numpages = {4},
doi = {10.1145/3132272.3132287},
url = {https://doi.org/10.1145/3132272.3132287},
acmid = {3132287},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Digital pen and paper, electroluminescence, augmented paper, visual feedback, Anoto, form filling, printed electronics}
}List of additional material
@inproceedings{klamka2017a,
author = {Konstantin Klamka and Raimund Dachselt},
title = {IllumiPaper: Illuminated Interactive Paper},
booktitle = {Proceedings of the SIGCHI Conference on Human Factors in Computing Systems},
year = {2017},
month = {5},
location = {Denver, CO, USA.},
pages = {5605--5618},
numpages = {14},
doi = {10.1145/3025453.3025525},
url = {http://dx.doi.org/10.1145/3025453.3025525},
publisher = {ACM},
keywords = {Digital pen and paper, electro-luminescence, pen interaction, visual feedback, Anoto, thin-film display, augmented paper}
}
2.
Exploring New Wearables
Cord-based Interaction
To investigate interaction concepts that provide tangible guidance on the go, the exploration of novel cord-based approaches for mobile interfaces is presented. Therefore, the chapter discusses how belt-worn retractable strings mechanisms (similar to ID badge holders) or textile hoodie cords can be used as novel interface controls that provide a cone-shaped interaction space with rich physical degrees of freedom.
@proceedings{Klamka2019b,
author = {Konstantin Klamka and Patrick Reipschl\"{a}ger and Raimund Dachselt},
title = {CHARM: Cord-based Haptic Augmented Reality Manipulation},
booktitle = {21st International Conference on Human-Computer Interaction - Virtual, Augmented and Mixed Reality. Multimodal Interaction},
series = {Lecture Notes in Computer Science (11574) - Virtual, Augmented and Mixed Reality: Multimodal Interaction},
volume = {9},
year = {2019},
month = {7},
isbn = {978-3-030-21607-8},
location = {Orlando, Florida, USA},
pages = {96--114},
numpages = {19},
doi = {10.1007/978-3-030-21607-8_8},
url = {https://doi.org/10.1007/978-3-030-21607-8_8},
publisher = {Springer International Publishing},
address = {Cham},
keywords = {Augmented Reality; Haptic Feedback; Elastic Input; Cord Input; Radial Menu; 3D Interaction; 3D Transformation; Wearable Computing.}
}List of additional material
@inproceedings{ARCord_Klamka2018,
author = {Konstantin Klamka and Raimund Dachselt},
title = {ARCord: Visually Augmented Interactive Cords for Mobile Interaction},
booktitle = {Proceedings of the 2018 CHI Conference Extended Abstracts on Human Factors in Computing Systems},
series = {CHI EA '18},
year = {2018},
month = {4},
location = {Montreal, QC, Canada},
numpages = {6},
doi = {10.1145/3170427.3188456},
url = {https://doi.org/10.1145/3170427.3188456},
acmid = {3188456},
publisher = {ACM},
address = {New York, NY, USA}
}@inproceedings{Klamka2015a,
author = {Konstantin Klamka and Raimund Dachselt},
title = {Elasticcon: Elastic Controllers for Casual Interaction},
booktitle = {Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services},
year = {2015},
month = {8},
isbn = {978-1-4503-3652-9},
location = {Copenhagen, Denmark},
pages = {410--419},
numpages = {10},
doi = {10.1145/2785830.2785849},
url = {http://dx.doi.org/10.1145/2785830.2785849},
acmid = {2785849},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {mobile interaction, elastic input, mobile input device, wearable, string-based interaction, casual interaction}
}List of additional material
3.
Enhancing Existing Wearables
Interactive Strap Displays for Smartwatches
As a next step, the thesis explored how classic or smart watches can be enhanced with additional pixel-based displays and input capabilities without loosing the familiar form factor of a wristwatch. Therefore, a physical design space considering technological as well as aesthetic parameters is introduced. Finally, synergistic interface concepts that consider promising content distributions, interaction techniques, usage types, and display roles are developed and evaluated based on a series of functional prototypes.
@inproceedings{klamka2021_epaper,
author = {Konstantin Klamka and Raimund Dachselt},
title = {Bendable Color ePaper Displays for Novel Wearable Applications and Mobile Visualization},
booktitle = {The 34st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings},
year = {2021},
month = {10},
isbn = {978-1-4503-8655-5/21/10},
location = {Virtual Event},
doi = {10.1145/3474349.3480213},
url = {https://doi.org/10.1145/3474349.3480213},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Color, ACeP, EPD, ePaper, E-Ink, electrophoretic, flexible, bendable, StrapDisplay, wearable, personal InfoVis, HCI, toolkit, mobileVis}
}List of additional material
@inproceedings{Klamka2020,
author = {Konstantin Klamka and Tom Horak and Raimund Dachselt},
title = {Watch+Strap: Extending Smartwatches with Interactive StrapDisplays},
booktitle = {Proceedings of the CHI Conference on Human Factors in Computing Systems},
year = {2020},
month = {4},
location = {Honolulu, Hawaii, USA},
pages = {72:1--72:15},
doi = {10.1145/3313831.3376199},
publisher = {ACM}
}List of additional material
, Video
4.
Enhancing Garments & Textiles
Towards Rapid Prototyping of Textile User Interfaces
While the previous projects have specifically focused on the actual interaction design of user interfaces embedded in the real world, this project examined how to provide users custom on-clothing interfaces as well as empower interface designers to prototype novel applications with next-generation ultra-thin, multilayered as well as printed sensors and actuators technologies.
@inproceedings{Klamka2020b,
author = {Konstantin Klamka and Raimund Dachselt and J\"{u}rgen Steimle},
title = {Rapid Iron-On User Interfaces: Hands-on Fabrication of Interactive Textile Prototypes},
booktitle = {Proceedings of the 2020 ACM Conference on Human Factors in Computing Systems},
year = {2020},
month = {4},
location = {Honolulu, Hawaii, USA},
doi = {10.1145/3313831.3376220},
publisher = {ACM}
}List of additional material
, Video
@inproceedings{peetz2019_bodyhub,
author = {Andreas Peetz and Konstantin Klamka and Raimund Dachselt},
title = {BodyHub: A Reconfigurable Wearable System for Clothing},
booktitle = {The 32nd Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings},
year = {2019},
month = {10},
isbn = {978-1-4503-6817-9/19/10},
location = {New Orleans, Louisiana, USA},
numpages = {3},
doi = {10.1145/3332167.3357108},
url = {https://doi.org/10.1145/3332167.3357108},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Wearable, E-Textiles, Smart Fabric, Rapid Prototyping, 3D Printing, Wearable Construction Kits, Modular System}
}
IV. Further Publications
In addition to the main research projects of the PhD thesis, a variety of further publications, workshops contributions and accompanying demonstrations were published:
@inproceedings{fixme,
author = {Katja Krug and Wolfgang B\"{u}schel and Konstantin Klamka and Raimund Dachselt},
title = {CleAR Sight: Exploring the Potential of Interacting with Transparent Tablets in Augmented Reality},
booktitle = {Proceedings of the 21st IEEE International Symposium on Mixed and Augmented Reality},
series = {ISMAR '22},
year = {2022},
month = {10},
isbn = {978-1-6654-5325-7/22},
location = {Singapore},
pages = {196--205},
doi = {10.1109/ISMAR55827.2022.00034},
publisher = {IEEE}
}List of additional material
@inproceedings{Engert2022,
author = {Severin Engert and Konstantin Klamka and Andreas Peetz and Raimund Dachselt},
title = {STRAIDE: A Research Platform for Shape-Changing Spatial Displays based on Actuated Strings},
booktitle = {Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems},
series = {CHI '22},
year = {2022},
month = {4},
isbn = {978-1-4503-9157-3/22/04},
location = {New Orleans, LA, USA},
numpages = {16},
doi = {10.1145/3491102.3517462},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Prototyping Platform, Spatial Display, Shape-Changing Interface, Tangible Interaction, Casual Visualization, Data Physicalization}
}List of additional material
@article{fixme,
author = {Andreas Peetz and Konstantin Klamka and Raimund Dachselt},
title = {Tailored but versatile, simple but powerful: Challenges and Insights of Wearable Toolkit Design},
booktitle = {CHI 2022 Workshop on Toolkits \& Wearables - Developing Toolkits for Exploring Wearable Designs},
year = {2022},
month = {04},
location = {New Orleans, LA, USA},
keywords = {wearable toolkits, prototyping, e-textile, modular systems}
}List of additional material
@inproceedings{Pourjafarian2021,
author = {Narjes Pourjafarian and Marion Koelle and Bruno Fruchard and Sahar Mavali and Konstantin Klamka and Daniel Groeger and Paul Strohmeier and J\"{u}rgen Steimle},
title = {BodyStylus: Freehand On-Body Design and Fabrication of Epidermal Interfaces},
booktitle = {Proceedings of the 2021 ACM Conference on Human Factors in Computing Systems},
year = {2021},
month = {5},
isbn = {978-1-4503-8096-6/21/05},
location = {Yokohama, Japan},
numpages = {15},
doi = {10.1145/3411764.3445475},
publisher = {ACM},
address = {New York, NY, USA}
}List of additional material
@inproceedings{Klamka2020c,
author = {Konstantin Klamka and Raimund Dachselt and J\"{u}rgen Steimle},
title = {Demonstrating Rapid Iron-On User Interfaces: Hands-on Fabrication of Interactive Textile Prototypes},
booktitle = {Proceedings of the 2020 CHI Conference Extended Abstracts on Human Factors in Computing Systems},
year = {2020},
month = {4},
isbn = {978-1-4503-6819-3/20/04},
location = {Honolulu, Hawaii, USA},
numpages = {4},
doi = {10.1145/3334480.3383139},
publisher = {ACM}
}List of additional material
, Video
@inproceedings{Klamka2019,
author = {Konstantin Klamka and Jannik Wojnar and Raimund Dachselt},
title = {ScaleDial: A Novel Tangible Device for Teaching Musical Scales \& Triads},
booktitle = {CHI Conference on Human Factors in Computing Systems Extended Abstracts},
year = {2019},
month = {5},
isbn = {978-1-4503-5971-9/19/05},
location = {Glasgow, UK, Scotland},
numpages = {4},
doi = {10.1145/3290607.3313238},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {music education, tangible, physical computing, scales; keys, intervals, triads, TUI, digital manipulatives}
}List of additional material
, Video
@article{klamka2018_make,
author = {Konstantin Klamka and Raimund Dachselt},
title = {Folientaster selbstgemacht – von Hand oder mit der Maschine},
year = {2019},
month = {01},
location = {Hannover},
pages = {84--85},
url = { https://shop.heise.de/katalog/community-projekte-bc9a98?wt_pdsrc=productList},
publisher = {Kreativ mit Technik | Make - Heise; Maker Media GmbH}
}List of additional material
@inproceedings{klamka2018_pushables,
author = {Konstantin Klamka and Raimund Dachselt},
title = {Pushables: A DIY Approach for Fabricating Customizable and Self-Contained Tactile Membrane Dome Switches},
booktitle = {The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings},
year = {2018},
month = {10},
location = {Berlin, Germany},
pages = {1--4},
numpages = {3},
doi = {10.1145/3266037.3266082},
url = {https://doi.org/10.1145/3266037.3266082},
acmid = {3266082},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {paper button, tactile, printed electronics, interactive paper, haptic, membrane switch, dome switch}
}List of additional material
@conference{fixme,
author = {Konstantin Klamka and Annett Mitschick and Raimund Dachselt},
editor = {Konstantin Klamka and Annett Mitschick and Raimund Dachselt},
title = {HANDle: A Novel Tangible Device for Hand Therapy Exergames},
booktitle = {Mensch und Computer 2018 - Tagungsband},
year = {2018},
month = {9},
location = {Dresden, Germany},
pages = {303--307},
numpages = {5},
doi = {10.18420/muc2018-mci-0335},
url = {https://dx.doi.org/10.18420/muc2018-mci-0335},
publisher = {Gesellschaft f\"{u}r Informatik e.V.},
address = {Bonn},
keywords = {Tangible, Hand therapy, Exergame, Fabrication, Sensors}
}List of additional material
@article{klamka2018_social_acceptability,
author = {Konstantin Klamka and Raimund Dachselt},
title = {The Future Role of Visual Feedback for Unobtrusive E-Textile Interfaces},
booktitle = {CHI 2018 Workshop: (Un)Acceptable!?! — Re-thinking the Social Acceptability of Emerging Technologies},
year = {2018},
month = {4},
location = {Montreal, QC, Canada},
numpages = {4},
keywords = {mobile interaction, wearable, social acceptability, AR glasses, e-textile, augmented controls, smart fabric}
}List of additional material
@proceedings{fastvpn2018,
author = {Andreas Bluschke and Wolfgang B\"{u}schel and Michael Hohmuth and Frieder Jehring and Rainer Kaminski and Konstantin Klamka and Stefan K\"{o}psell and Adam Lackorzynski and Tim Lackorzynski and Michael Matthews and Philipp Rietzsch and Alexander Senier and Peter Sieber and Volker Ulrich and Rainer Wiggers and Jean Wolter},
title = {fastvpn – Secure and Flexible Networking for Industry 4.0},
booktitle = {Broadband Coverage in Germany; 12. ITG-Symposium.},
year = {2018},
month = {4},
isbn = {978-3-8007-4637-8},
location = {Berlin, Germany.},
pages = {28--35},
numpages = {8},
publisher = {VDE Verlag GmbH - Berlin - Offenbach},
address = {Berlin, Germany.}
}List of additional material
@inproceedings{klamka2017c,
author = {Konstantin Klamka and Raimund Dachselt},
title = {IllumiPaper: Printed Displays for Novel Digital Pen-and-Paper User Interfaces},
booktitle = {Mensch und Computer 2017 - Workshopband},
year = {2017},
month = {9},
location = {Regensburg},
pages = {625--628},
numpages = {4},
doi = {10.18420/muc2017-demo-0289},
url = { https://doi.org/10.18420/muc2017-demo-0289},
publisher = {Gesellschaft f\"{u}r Informatik e.V.},
address = {Regensburg},
keywords = {digital pen and paper, electroluminescence, visual feedback, Anoto, augmented paper}
}List of additional material
@unpublished{klamka2017b,
author = {Konstantin Klamka and Raimund Dachselt},
title = {Demonstrating IllumiPaper: Illuminated Interactive Paper},
booktitle = {Accompanying CHI 2017 Interactivity Research Demo of the SIGCHI Conference on Human Factors in Computing Systems},
year = {2017},
month = {5},
location = {Denver, CO, USA.},
publisher = {ACM},
keywords = {Digital pen and paper, electro-luminescence, pen interaction, visual feedback, Anoto, thin-film display, augmented paper}
}List of additional material
@inproceedings{klamka2015c,
author = {Konstantin Klamka and Andreas Siegel and Stefan Vogt and Fabian G\"{o}bel and Sophie Stellmach and Raimund Dachselt},
editor = {Konstantin Klamka and Andreas Siegel and Stefan Vogt and Fabian G\"{o}bel and Sophie Stellmach and Raimund Dachselt},
title = {Look \& Pedal: Hands-free Navigation in Zoomable Information Spaces through Gaze-supported Foot Input},
booktitle = {Proceedings of the 17th International Conference on Multimodal Interaction},
year = {2015},
month = {11},
location = {Seattle, USA},
pages = {123--130},
numpages = {8},
doi = {10.1145/2818346.2820751},
url = {http://dx.doi.org/10.1145/2818346.2820751},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {multimodal interaction, foot input, gaze input, eye tracking, gaze-supported interaction, navigation, pan, zoom}
}List of additional material
@inproceedings{Klamka2015b,
author = {Konstantin Klamka and Raimund Dachselt},
title = {Demonstrating Elasticcon: Elastic Controllers for Casual Interaction},
booktitle = {Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services},
year = {2015},
month = {8},
location = {Copenhagen, Denmark},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {mobile interaction, elastic input, mobile input device, wearable, string-based interaction, casual interaction},
crossref = {Klamka2015a}
}List of additional material
@inproceedings{klamka_schmalenberger_rekonstruktion_1946,
author = {Konstantin Klamka and Thomas Schmalenberger},
title = {Rekonstruktion der Ersten Allgemeinen Deutschen Kunstausstellung Dresden 1946},
booktitle = {Mensch \& Computer 2013 - Workshopband},
year = {2013},
month = {9},
location = {Bremen, Germany},
pages = {519--522},
numpages = {4},
publisher = {Oldenbourg Verlag}
}List of additional material
@inproceedings{fixme,
author = {Fabian G\"{o}bel and Konstantin Klamka and Andreas Siegel and Stefan Vogt and Sophie Stellmach and Raimund Dachselt},
title = {Gaze-supported Foot Interaction in Zoomable Information Spaces (Interactivity)},
booktitle = {Proceedings of the Conference on Human Factors in Computing Systems - Extended Abstracts},
year = {2013},
month = {4},
location = {Paris, France},
pages = {3059--3062},
numpages = {4},
doi = {10.1145/2468356.2479610},
url = {http://doi.acm.org/10.1145/2468356.2479610},
publisher = {ACM},
keywords = {eye tracking, foot, gaze, interaction, multimodal, navigation, pan, zoom}
}List of additional material
@article{GKS-2013-CHI-workshop,
author = {Fabian G\"{o}bel and Konstantin Klamka and Andreas Siegel and Stefan Vogt and Sophie Stellmach and Raimund Dachselt},
title = {Gaze-supported Foot Interaction in Zoomable Information Spaces},
booktitle = {CHI 2013 Workshop on Gaze Interaction in the Post-WIMP World},
year = {2013},
month = {4},
location = {Paris, France},
numpages = {4}
}List of additional material
@inproceedings{mci/lapczyna2012,
author = {Esther Lapczyna and Franziska Hann\ss and Konstantin Klamka and Marcus Kirsch and Benny Thom\"{a} and Rainer Groh},
title = {Ein Experimentalraum zur Untersuchung von Bildr\"{a}umlichkeit.},
booktitle = {Mensch \& Computer 2012 – Workshopband: Interaktiv informiert – allgegenw\"{a}rtig und allumfassend!?},
year = {2012},
month = {9},
location = {Konstanz, Germany},
pages = {529--532},
numpages = {4},
publisher = {Oldenbourg Verlag},
address = {M\"{u}nchen}
}List of additional material
V. Related Student Theses
Design and development of e-textiles for medical simulation and training
Ricardo Neumann July 4th, 2022 until December 5th, 2022
Supervision: Katja Krug, Konstantin Klamka, Andreas Peetz, Raimund Dachselt
Design and Development of AR-Widgets for Textile User Interfaces
Soorya M January 21st, 2021 until June 24th, 2021
Supervision: Andreas Peetz, Konstantin Klamka, Wolfgang Büschel, Raimund Dachselt
Kinetic Sculptures for Personal DataViz
Severin Engert May 11th, 2020 until October 12th, 2020
Supervision: Konstantin Klamka, Raimund Dachselt
Design exploration and development of a configurable wearable concepts for clothes
Andreas Peetz May 28th, 2018 until February 9th, 2019
Supervision: Konstantin Klamka, Raimund Dachselt
Comparing Elasticcon and free hand gestures to control innovative menu concepts for AR scenarios
Thomas Schwab July 10th, 2017 until December 18th, 2017
Supervision: Konstantin Klamka, Patrick Reipschläger, Raimund Dachselt
Innovative Interaction Concepts for the Use of Elasticcon in AR Scenarios
Eva Morawietz November 8th, 2016 until July 18th, 2017
Supervision: Konstantin Klamka, Raimund Dachselt
Interactive zip-on textile elements for haptic user interfaces
N.N. August 2nd, 2021 until October 18th, 2021
Supervision: Konstantin Klamka, Raimund Dachselt
Development of a modular wearable concept for workwear
Björn Glawe August 2nd, 2021 until October 18th, 2021
Supervision: Konstantin Klamka, Raimund Dachselt
Novel Approaches for Visualizing and Interacting with Data on Smartwatches
Anselm Bunsen June 7th, 2019 until August 23rd, 2019
Supervision: Tom Horak, Konstantin Klamka, Raimund Dachselt
Development of an Innovative Tangible User Interface for Music Theory and Practice
Jannik Wojnar July 31st, 2018 until October 16th, 2018
Supervision: Konstantin Klamka, Raimund Dachselt
Implementation of innovative menu concepts with Elasticcon in AR scenarios
Paul Riedel June 16th, 2017 until September 1st, 2017
Supervision: Konstantin Klamka, Patrick Reipschläger, Raimund Dachselt
Visualisierungs- und Interaktionsformen für Mathematikanwendungen mit digitalem Papier
Lena Denne September 5th, 2016 until November 28th, 2016
Supervision: Konstantin Klamka, Raimund Dachselt
Development of an accompaniny e-learning application for teaching music theory with the ScaleDial approach
Luisa Leopold January 6th, 2020 until May 22nd, 2020
Supervision: Konstantin Klamka, Raimund Dachselt