Publications
2019
- Lussu, V., Niewiadomski, R., Volpe, G., Camurri, A.
The role of respiration audio in multimodal analysis of movement qualities,
Journal on Multimodal User Interfaces, Springer International Publishing, v. 13, n. 1, pp. 1-15, ISSN: 1783-8738 1783-8738, Apr, 2019.
DOI = 10.1007/s12193-019-00302-1
2018
- Niewiadomski, R., Mancini, M., Cera, A., Piana, S., Canepa, C., Camurri, A. Does embodied training improve the recognition of mid-level expressive movement qualities sonification?, Journal on Multimodal User Interfaces, Springer International Publishing, v. 28, n. 10, pp. 1-13, ISSN: 1783-8738, Dec, 2018.
DOI = 10.1007/s12193-018-0284-0 - J. Vaessen, M., Abassi, E., Mancini, M., Camurri, A., de Gelder, B. Computational Feature Analysis of Body Movements Reveals Hierarchical Brain Organization, Cerebral Cortex, Oxford University Press, v. 28, n. 10, pp. bhy228, ISBN/ISSN: 1047-3211, Oct, 2018.
DOI = 10.1093/cercor/bhy228 - Frid, E., Elblaus, L., Bresin, R. Interactive sonification of a fluid dance movement: an exploratory study, Journal on Multimodal User Interfaces, Nov. 2018, ISSN: 1783-8738.
DOI = doi.acm.org/10.1007/s12193-018-0278-y
2017
- Zhan, M., de Gelder, B. Unconscious fearful body expression perception enhances discrimination of conscious anger expressions under continuous flash suppression, Neuropsychologia, to appear in 2018.
- Zhan, M., Engelen, T., de Gelder, B. Influence of continuous flash suppression mask frequency on stimulus visibility. Neuropsychologia, to appear in 2018.
- Derey, K., Rauschecker, J.P., Formisano, E., Valente, G., de Gelder, B. Localization of complex sounds is modulated by behavioral relevance and sound category, 2017. The Journal of the Acoustical Society of America. 142(4), 1757–1773.
DOI = asa.scitation.org/doi/10.1121/1.5003779 - Vaessen, M.J., Abassi, E., Mancini, M., Camurri, A., de Gelder, B. Combining computational modeling and brain imaging reveals distinct processing of different movement qualities, In Society for Neuroscience (Washington DC, 2017)
- Niewiadomski, R., Mancini, M., Piana, S., Alborno, P., Volpe, G., Camurri, A., Low-intrusive Recognition of Expressive Movement Qualities, ICMI 2017. In Proceedings of the 19th ACM International Conference on Multimodal Interaction, ACM, pp. 230--237, ISBN/ISSN: 978-1-4503-5543-8, New York, NY, USA, 2017
DOI = doi.acm.org/10.1145/3136755.3136757
2016
- Alborno, P., Cera, A., Piana, S., Mancini, M., Niewiadomski, R., Canepa, C., Volpe, G., Camurri, A., Interactive sonification of movement qualities - a case study on fluidity. In Proceedings of ISon 2016, 5th Interactive Sonification Workshop, CITEC, Bielefeld University, Germany, December 16, 2016, 28-33
- Alborno, P., Piana, S., Mancini, M., Niewiadomski, R., Volpe, G., Camurri, A., Analysis of Intrapersonal Synchronization in Full-Body Movements Displaying Different Expressive Qualities. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '16), Paolo Buono, Rosa Lanzilotti, and Maristella Matera (Eds.). ACM, New York, NY, USA, 136-143, 2016
DOI = http://dx.doi.org/10.1145/2909132.2909262 - Bresin, R., Elblaus, L., Frid, E., Favero, F., Annersten, L., Berner, D., Morreale. F., Sound Forest/Ljudskogen: A Large-Scale String-Based Interactive Musical Instrument. In proceedings of SMC Sound and Music Computing Conference 2016, Hamburg, 2016, 79-84.
- Camurri, A., Canepa, C., Ferrari, N., Mancini, M., Niewiadomski, R., Piana, S., Volpe, G., Matos, J-M., Palacio, P., Romero, M., A System to Support the Learning of Movement Qualities in Dance: a Case Study on Dynamic Symmetry, BodySenseUX Workshop, held in conjunction with UBICOMP 2016
- Camurri, A., Lussu, V., Niewiadomski, R., Volpe, G., Using the Audio Respiration Signal for Multimodal Discrimination of Expressive Movement Qualities, in Proceedings of the 7th International Workshop on Human Behavior Understanding (HBU 2016), M. Chetouani and J. Cohn and A. A. Salah Eds., Springer International Publishing, 102 - 115, ISBN/ISSN: 978-3-319-46843-3, Amsterdam, The Netherlands.
- Camurri, A., Volpe, G., The Intersection of Art and Technology, IEEE MultiMedia 2016 vol.23, Issue No.01, Jan.-Mar. 2016
DOI = http://doi.ieeecomputersociety.org/10.1109/MMUL.2016.13 - Camurri, A., Volpe, G., Piana, S., Mancini, M., Niewiadomski, R., Ferrari, N., Canepa, C., The Dancer in the Eye: Towards a Multi-Layered Computational Framework of Qualities in Movement, 3rd International Symposium on Movement and Computing, MOCO 2016, 5-6 July 2016, Thessaloniki, Greece.
DOI = http://dx.doi.org/10.1145/2948910.2948927 - Derey, K., Formisano, E., Valente, G., Zhan, M., Kupers, R., De Gelder, B., Intra-modal plasticity for binaural spatial processing in the auditory cortex of early blind individuals. Poster presentation at FENS Forum of Neuroscience, 2-6 July 2016, Copenhagen, Denmark.
- Elblaus, L., Unander-Scharin, A., Unander-Scharin, C., New Scenic Subjects: Explorations of a System of Autonomous On-Stage Observers, Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 7-12 May, ACM, New York, NY, USA, 265-268, 2016
DOI = http://dx.doi.org/10.1145/2851581.2889470 - Frid, E., Bresin, R., Alborno, P., Elblaus, L., Interactive Sonification of Spontaneous Movement of Children - Cross-modal Mapping and the Perception of Body Movement Qualities through Sound, Frontiers in Human Neuroscience, 10: 521
DOI = https://doi.org/10.3389/fnins.2016.00521 - Frid, E., Bresin, R., Elblaus, L., Sonification of fluidity - An exploration of perceptual connotations of a particular movement feature, ISON 2016 - Interactive Sonification Workshop, Bielefeld
- Kolykhalova, K., Alborno, P., Camurri, A., Volpe, G., A serious games platform for validating sonification of human full-body movement qualities, 3rd International Symposium on Movement and Computing, MOCO 2016, 5-6 July 2016, Thessaloniki, Greece.
DOI = http://dx.doi.org/10.1145/2948910.2948962 - Paloranta, J., Lundström, A., Elblaus, L., Bresin, R., Frid, E., Interaction with a large sized augmented string instrument intended for a public setting, Proceedings of Sound and Music Computing Conference 2016, Hamburg.
- Piana, S., Alborno, P., Niewiadomski, R., Mancini, M., Volpe, G., Camurri, A, Movement Fluidity Analysis Based on Performance and Perception, In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1629-1636, 2016
DOI = http://dx.doi.org/10.1145/2851581.2892478 - Piana, S., Coletta, P., Ghisio, S., Niewiadomski, R., Mancini, M., Sagoleo, R., Volpe, G., Camurri, A., Towards a Multimodal Repository of Expressive Movement Qualities in Dance, 3rd International Symposium on Movement and Computing, MOCO 2016, 5-6 July 2016, Thessaloniki, Greece
DOI = http://dx.doi.org/10.1145/2948910.2948931 - Piana, S., Staglianò, A., Odone, F., Camurri, A., Adaptive Body Gesture Representation for Automatic Emotion Recognition ACM Trans. Interact. Intell. Syst. 6, 1, Article 6 (March 2016), 31 pages.
DOI = http://dx.doi.org/10.1145/2818740 - Singh, A., Tajadura-Jimez, A., Bianchi-Berthouze, N., Marquardt, N., Tentori, M., Bresin, R. & Kulic, D., Mind the Gap: A SIG on Bridging the Gap in Research on Body Sensing, Body Perception and Multisensory Feedback. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 7-12 May, ACM, New York, NY, USA, 1092-1095, 2016
DOI = http://dx.doi.org/10.1145/2851581.2886440 - Volpe, G., Alborno, P., Camurri, A., Coletta, P., Ghisio, S., Mancini, M., Massari, A., Niewiadomski, R., Piana, S., Sagoleo, R., Designing Multimodal Interactive Systems Using EyesWeb XMI, Smart Ecosystems cReation by Visual dEsign Workshop (SERVE 2016), held in conjunction with AVI 2016
2015
- Alborno, P., Kolykhalova, K., Frid, E., Malafronte, D., Huis in ’t Veld. L., Analysis of the qualities of human movement in individual action, In Proceedings of eNTERFACE 2015 workshop
- Niewiadomski, R., Mancini, M., Volpe, G., Camurri, A., Automated Detection of Impulsive Movements in HCI, Proceedings of the 11th Biannual Conference on Italian SIGCHI Chapter (CHItaly 2015). ACM, New York, NY, USA, 166-169, 2015
DOI = http://dx.doi.org/10.1145/2808435.2808466
Deliverables
- D1.1 - Ultra-high resolution mapping of the anatomical structure of the retinofugal visual system in in congenitally blind subjects using 7T and 9.4 MRI
- D1.2 - Quantify the level of auditory localisation ability in both normally sighted and congenitally blind participants
- D1.3 - Quantify connectivity/overlap of regions processing dance movement and sonified dance movement
- D1.4 - Demonstrate how sonification training modulates mental imagery
- D1.5 - Demonstrate the time course of development of crossmodal plasticity for sonification
- D1.6 - Demonstrate the functional role of the occipital cortex in dance sonification in congenitally blind participants
- D2.1 - First version of the DANCE software libraries - Appendix
- D2.2 – Second version of the Dance software libraries
- D3.1 - First version of the sonification software libraries
- D3.2 - Second version of the sonification software libraries
- D4.1 - DANCE System Platform, First version (see also the DANCE Platform on this website)
- D4.2 – DANCE System Platform, Second version
- D4.3 – DANCE System Platform, Final version
- D5.1 - Use cases - Appendix
- D5.2 - Revised use cases
- D5.3 - Final evaluation report (confidential document, log in into the Private area to download it)
- D6.1 - DANCE web portal
- D6.2 - Intermediate report on dissemination activities
- D6.3 - Standardisation plan (confidential document, log in into the Private area to download it)
- D6.4 - Final report on dissemination activities
- D6.5 - Plan for exploitation of foreground (confidential document, log in into the Private area to download it)