Projects Remco C. Veltkamp



Digital Humanities Artificial Intelligence Cultural Heritage. The project aims at co-creating new forms of AI-driven access and context to big volumes of cultural heritage data, given that the continuous stream and heterogeneity of cultural heritage data hampers informed decisions and civic participation. We will research multimodal AI for multimodal heritage and 'deep Journalism'.
Website: HAICu
Funding: Research along Routes by Consortia (NWA-ORC), routes 'Creating value through responsible access to and use of big data', and 'Living history'. Round 2022 grant
Runtime: 2023-2028


Focusing On the Right Things in the Port of Rotterdam. We develop a serious game in collaboration with port employees, law enforcement officers and ex-offenders, among others. We use this game to collect data about the behaviour of the various stakeholders in the port environment. With this approach, we gain insight into the social and cultural environments underlying criminal networks.
Website: News
Funding: NWO Knowledge and Innovatin Convenant (KIC), Subversive crime.
Runtime: 2023-2028


RESCHOOL improves the way energy communities operate by enhancing the technology and behaviour of their users. This will help to make these communities more efficient and effective in their use of energy. RESCHOOL aims to increase the active participation of communities in energy markets, enhancing and facilitating the management and trading of flexibility in cooperation with sectoral players.
Funding: HORIZON-CL5-2022-D3-01, Climate, Energy and Mobility, Innovation Action, Grant agreement ID: 101096490
Runtime: 2023-2026


Game design, AI, system Modeling: Long-term consumer and community empowerment in energy applications. As the sequel to Powersaver Game; by developing integrated tools as the shared platform between citizens and the energy system, and thus enabling user-centred sustainable energy systems, we play an active role in the energy transition. Game research will be coupled with advanced modelling techniques and smart meter data, to provide feedback to citizens about optimal energy management in households.
Website: NWO
Funding: NWO Knowledge and Innovatin Convenant (KIC), Energy transition as a socio-technical challenge.
Runtime: 2022-2026

DINO GAME, DIgitally Nudging Outdoor play, Game Ai for MEntal Health

The contribution of this project is the development of AI in a multiplayer location-based game to optimize individual physical activity. The project aims at the social development of children who, have limited school attendance and play with peers, such as children with chronic illnesses or due to Covid-19.
Funding: EWUU, TU/e-WUR-UU-UMCU alliance.
Runtime: 2023-2024

AI tada, Automated Indexing of historical television data

The project aims at creating an audio-visual timeline of Dutch television programming by integrating three datasets of Beeld en Geluid. It makes use of television guides (digitized paper collection), metadata of individual television programs (collected in the DAAN-database) and video recordings (per year 2 weeks of 24 hours recordings of all Dutch TV channels) of what was actually broadcast.
Funding: UU AI and Digital Humanities call to action.
Runtime: 2022-2023


On the development of eHealth applications for youth with chronic disease. We participate in the work on gamification of survey and intervention apps for chronicallly ill children. Our contribution fits within the Healthy Play, Better Coping SIG/hub.
Funding: NWA ORC, NWA.1292.19.226
Runtime: 2021-2028

Real-time Intelligence

Development of a real-time intelligence dashboard for the police emergency control center. Research into the analysis of social media data, such as Twitter, and an interaction dashboard design to provide real-time intelligence in the police emergency control center.
Website: National Police Lab AI
Funding: National Police
Runtime: 2019-2025


Classification in Cryo-Electron Tomography of Bio-Molecular Complexes. The main research question is how to improve the successive stages in cryo-electron microscopy: detection, alignment, and classification. We design deep-learning networks to distinguish different types of macromolecules in tomograms.
Funding: strategic investment Department of Information and Computing Sciences, collaboration with Department of Chemistry
Runtime: 2018-2022



Playful international police collaboration training tool. Development of a game for the police academy for training officers for international collaboration.
Funding: Internal Security Fund, through Dutch National Police Academy
Runtime: 2020-2021


Urban Sustainable Mobility: student education, community involvement and participative planning. The development of an AR/VR tool for learning sustainable mobility planning and a location based game.
Funding: Erasmus+ KA203 Strategic Partnerships for higher education
Runtime: 2019-2022


Smart solutions in short food supply chains. Development of a project platform, gamification model GAIN, and PlayLocal2Local game app.
Funding: Horizon2020 SFS-2016-2017, H2020-EU., grant ID 773785
Runtime: 2018-2021

Graduate Program Game Research

To fosster interdisciplinary game research. Four PhD candidates are selected based on their personal project proposal on interdisciplinary game research.
Website: link
Funding: NWO Graduate Program
Runtime: 2015-2021


To encourage city dwellers to use urban green and blue spaces more actively. Development of a location-based game.
Funding: Erasmus+, grant nr. 2016-1-DE01-KA203-002919
Runtime: 2017-2019

Dangerous Games

Deploying game design to combat drug-related threats to health and public order.
Website: link
Funding: NWO KIEM, grant nr. KI.18.017
Runtime: 2019


Virtual worlds for well-being. In this project we do research on affective body animation, crowd simulation, biomechanical animation, computational modelling of music emotion, and video analysis of human interaction. The game is a crowd sourcing tool to collect data about perceived emotion in music.
Funding: COMMIT program
Runtime: 2011-2017


Cognition guided interoperability between collections of musical heritage. This project researches which musical features make you remember a fragment well. Through the game we collect data about those hooks in music.
Funding: NWO CATCH 640.005.004
Runtime: 2012-2017

Pheno Rat

Advanced science and technology of rat models for neurodegenerative diseases. Automated recognition of rodent social behavior from video.
Funding: Marie Curie Initial Training Network (ITN) of the European Commission's 7th Framework Programme, grant nr. 317259
Runtime: 2012-2016


Games and learning alliance. Agent technologies, animating virtual characters, (re)construction of virtual worlds.
Website: (follow-up: Serious Game Society)
Funding: FP7 ICT-2009.4.2 Technology Enhanced Learning, grant nr. 258169
Runtime: 2010-2014


ACROSSING: Advanced TeChnologies and PlatfoRm fOr Smarter ASsisted LivING. We develop object detection-based location and activity classification from egocentric videos.
Website: Cordis
Funding: Horizon 2020, Marie Skłodowska-Curie Innovative Training Network, project nr 676157.
Runtime: 2016-2019


Video Analysis and Recognition Tools. GATE Knowledge Transfer project.
Funding: FES GATE program, Game Research for Training and Entertainment
Runtime: 2009-2012


Cyclorama-based Automatic 3D Reconstruction Tools
Funding: FES GATE program, Game Research for Training and Entertainment
Runtime: 2009-2012


Game Research for Training in Entertainment
Funding: € 10 mln, FES Fund (Fonds Economische Structuurversterking
Runtime: 2007-2012


Fostering the Comprehension and Use of Knowledge-intensive 3D-media
Website: (obsolete), Cordis
Funding: FP7-ICT, Coordination Action
Runtime: 2008-2010


What Is Topical in Cultural Heritage: Content-based Retrieval Among Folksong Tunes. Develop a fully functional content-based retrieval system for folksong melodies stored as audio and notation, building on the best practices of Music Information Retrieval research.
Website: link
Funding: NWO CATCH 640.003.501
Runtime: 2006-2010


Project aim:
Tracking, Recognition, and Interpretation of User Motion and Faces


Project aim:
Perceptually-relevant Retrieval Of Figurative Images


Project aim:
Cognition-based Music Information Notation Oriented Retrieval


Project aim:
Advanced Innovative Modeling of Shape
Website: Digital Shape Workbench


Project aim:
On-line Retrieval from Polyhymnia: the Human-oriented Experimental Utrecht Searcher


Project aim:
Shape Matching Environment
Funding: STW
  1. DINO GAME: DIgitally Nudging Outdoor play, Game Ai for MEntal Health. EWUU AI for Health, 2023-2024. Main applicant. Funding: € 50,000.
  2. AI Tada: Automatic Indexing of Historical Television Data, AI and Digital Humanities call to action, 2022-2023. Co-applicant. Funding: € 50,000.
  3. EDIH-NWNL: European Digital Innovation Hub North-West Netherlands. Digital Europe Programme, DIGITAL-2021-EDIH-01, 2022-2025. Co-applicant. Funding (UU part): € 151,391.
  4. GAIM: Game design, AI, system Modeling: Long-term consumer and community empowerment in energy applications. NWO KIC Energy transition as a socio-technical challenge, 2022-2027. Co-applicant. Funding: € 1,343,469.
  5. Feeling good, despite illness; Accessible eHealth supporting the well-being of chronically ill children. NWA Research along Routes by Consortia. Co-applicant. Funding: indirect, co-supervise PhD student.
  6. Citizen science via tools for collaborative game design. Research IT innovation fund 2020. Funding: € 16,802. Co-applicant (PI Sander Bakkes).
  7. Propellant/Terminus
  8. Using deepfake technology to investigate how context and content affect youth’s views of political messages. Dynamics of Youth Invigoration basic funding, 2019-20. Funding: € 50,000. PI with Tamara van Gogh.
  9. AGI-LO: Applied Gaming Intervention for reducing Loneliness of Children with Chronic Diseases. TKI-LSH (Match) PPP Allowance. 2019-21. Funding: € 100,000. Co-applicant (PI Sander Bakkes).
  10. UrbanSCOPE: Urban Sustainable Mobility in focus: student education, community involvement and participative planning. Erasmus+ KA203, 2019-2022. Funding € 33,000. Co-applicant.
  11. Weg met weerstand, Beter leren met smart technology voor jongeren in een justitieel kader. NWA.1162.006. Funding € 3,500.
  12. Dangerous Games: Deploying Game Design to Combat Drug-related Threats to Health and Public Order. NWO KIEM KI.18.017/787, 2018-19. Funding: € 16,500. PI applicant.
  13. Real time intelligence in the control center. PhD program National Police. 2019-2022. Funding: €120,000. PI, with Christoph van Nimwegen.
  14. Healthy Play, Better Coping, 2018-2021. Dynamics of Youth hub project. 1e geldstroom project. Funding: €100,000.
  15. Classification in Cryo-Electron Tomography of Bio-Molecular Complexes. 1e geldstroom project. 2018-2022. Funding: 1 PhD student, ca. €250,000. PI with Friedrich Förster.
  16. Towards innovation-driven and smart solutions in short food supply chains (SMARTCHAIN). H2020, SFS-34-2017 (Innovative agri-food chains: unlocking the potential for competitiveness and sustainability). 2018-21. Funding €140,000. Co-applicant.
  17. FUMA: A functional model of music structure analysis, 1e geldstroom, 2019-2022. Co-applicant. Funding: 1 PhD student, ca. 250,000 €.
  18. PreHealth, 2017-2019.
  19. Beat-IT, 2015-2016. DoY seed money project. Co-applicant. Funding €100,000.
  20. TimeCapsule.
  21. Scientific games for education, 2014-2015, NWO KIEM project. Co-applicant. Funding €15,000.
  22. Graduate Program Game Research, 2015-2019. NWO project. Main Applicant. Funding €800,000.
  23. QBio-CLS (Quantitative Biology-Computational Life Sciences), NWO Graduate Program. Co-applicant. Funding €800,000.
  24. Focus Area Game Research. 1e geldstroom project. 2014-2022. Funding: €800,000. PI with Joost Raessens.
  25. Growing Games, 2013-2016. Task Force Innovatie. Co-applicant. Funding €12,666.
  26. PhenoRat, 2013-2016, Marie-Curie ITN project. Co-applicant. Funding: PhD student via Noldus IT.
  27. Virtual Worlds for Well-Being, 2012-2017. COMMIT project. Main Applicant. Funding €1.000,000.
  28. COGITCH, 2011-2015. NWO CATCH project. Main applicant. Funding: €655,853.
  29. GaLA (Games and Learning Alliance), FP7 ICT-2009.4.2 Technology Enhanced Learning, 2010-2014. Co-applicant. Funding: €2008,831.
  30. VidART: Video Analysis and Recognition Tools, GATE knowledge transfer project. Main applicant. 2009-2012. Funding: FES GATE program, € 150,000.
  31. CycART: Cyclorama-based Automatic Reconstruction Tools, GATE knowledge transfer project. Main applicant. 2009-2012. Funding: FES GATE program, € 150,000.
  32. FOCUS K3D: FOster the Comprehension, adoption and USe of Knowledge intensive technologies for coding and sharing 3D media content in consolidate and emerging application communities, FP7-ICT, Coordination Action, 2008-2010. Funding: € 1,220,000, UU part € 204,882.
  33. Yahoo Faculty Research Grant. 2008 Funding: $ 25,000.
  34. WITCHCRAFT: What Is Topical in Cultural Heritage: Content-based Retrieval Among Folk Tunes, NWO CATCH 640.003.501, co-applicant. Funding: € 561,096. 2006-2010.
  35. NetCodeGame, SURF Onderwijsvernieuwingsprojecten, 2003. Co-applicant. Funding (UU part): € 78,390.
  36. PROFI: Perceptually-relevant Retrieval Of Figurative Images, FET-Open STREP FP6/2002/IST/C, 2003-2007. Main applicant. Funding: € 997,000.
  37. AIM@SHAPE Advanced and innovative models and tools for the development of semantic-based systems for handling, acquiring, and processing knowledge embedded in multidimensional digital objects, FP6-IST-2002-, Network of Excellence 506766, 2004-2007. Funding: € 5,740,000 overall.
  38. ORPHEUS: Online Retrieval from Polyhymnia, the Human-oriented Experimental Utrecht Searcher. UU ICS basic funding, 2003-2007. Main applicant. Funding: ca. € 200,000.
  39. SPIRIT: Spatially-aware Information Retrieval on the Internet, FP5-IST-2001-3.4.1 Semantic Web Technologies, 2002-2005. Co-applicant. Funding: € 2,552,187, UU part: ca. € 400,000.
  40. SMURF: Similarity-based Multimedia Framework demo, Senter ICT-Kenniscongres. Funding: € 11,345 (fl. 25,000), 2002.
  41. MINDSHADE: Matching and Indexing through Shape Decomposition, NWO GBR Multimedia, 612-61-006, 2000-2004. Main applicant. Funding fl. 212.000, ca. € 100,000. UU personnel: Mirela Tanase.
  42. NODES (Novel Techniques for Describing Shapes in Computer Graphics and Image Processing), FP5-IST-1999-29008 FET-Open, 2000-2001. Funding (UU part): 92,000 k€.
  43. GALIA: Geometric Algorithms for Industrial Application, FP4-ESPRIT 4, grant id 28155, CSC (Cost-sharing contracts), 1998-2000. Co-applicant. Funding: €595.000, UU part: ca. € 100,000.
  44. AMIS (Advanced Multimedia Searching and Indexing) SHORT (Shape Oriented Retrieval Technology) SION 612-21-201, 1997. Funding: 3 years postdoc, ca. fl. 270,000.
  45. The AMIS Experimentation Platform, NWO Middelgroot, 1997. Funding (UU part): fl. 80,000.
  46. Constrained-based Graphics, SION 612-31-001, 1994. Funding: 2 years post-doc.
  47. Constraints in Object-Oriented Interactive Graphics, SION 612-322-212, 1994-1998. Funding: 4 years PhD student, ca. € 100,000.