Real-time musical sonification in rehabilitation technology

Liikkeeseen perustuva musiikillinen palauteääni voi tehdä meidät tietoisemmiksi tavasta jolla liikumme. Kun liike muunnetaan sen äänelliseksi vastineeksi, ääni voi kertoa kehon tai raajojen asennosta sekä liikkeen laadusta. Musiikillisen palautteen avulla on mahdollista oppia uudelleen karkea- tai h...

Full description

Bibliographic Details
Main Author: Sunela, Eeva
Other Authors: Humanistis-yhteiskuntatieteellinen tiedekunta, Faculty of Humanities and Social Sciences, Musiikin, taiteen ja kulttuurin tutkimuksen laitos, Department of Music, Art and Culture Studies, Jyväskylän yliopisto, University of Jyväskylä
Format: Master's thesis
Language:eng
Published: 2022
Subjects:
Online Access: https://jyx.jyu.fi/handle/123456789/85358
_version_ 1826225787251982336
author Sunela, Eeva
author2 Humanistis-yhteiskuntatieteellinen tiedekunta Faculty of Humanities and Social Sciences Musiikin, taiteen ja kulttuurin tutkimuksen laitos Department of Music, Art and Culture Studies Jyväskylän yliopisto University of Jyväskylä
author_facet Sunela, Eeva Humanistis-yhteiskuntatieteellinen tiedekunta Faculty of Humanities and Social Sciences Musiikin, taiteen ja kulttuurin tutkimuksen laitos Department of Music, Art and Culture Studies Jyväskylän yliopisto University of Jyväskylä Sunela, Eeva Humanistis-yhteiskuntatieteellinen tiedekunta Faculty of Humanities and Social Sciences Musiikin, taiteen ja kulttuurin tutkimuksen laitos Department of Music, Art and Culture Studies Jyväskylän yliopisto University of Jyväskylä
author_sort Sunela, Eeva
datasource_str_mv jyx
description Liikkeeseen perustuva musiikillinen palauteääni voi tehdä meidät tietoisemmiksi tavasta jolla liikumme. Kun liike muunnetaan sen äänelliseksi vastineeksi, ääni voi kertoa kehon tai raajojen asennosta sekä liikkeen laadusta. Musiikillisen palautteen avulla on mahdollista oppia uudelleen karkea- tai hienomotorisia taitoja. Ääni voi myös kompensoida heikosti toimivaa asentoaistia, ohjata toimintaa tai edistää sosiaalista kanssakäymistä. Toistuvissa itsenäisissä harjoitteissa musiikki motivoi leikillisen ja tunteisiin vetoavan luonteensa takia. Lisäksi musiikki on interaktiivinen ja hyvin joustava työkalu kuntoutuksessa, jossa voidaan hyödyntää myös vaistonvarainen liike musiikin tahtiin. Tässä tutkielmassa tarkastelen kirjallisuuskatsauksen kautta, miten liikkeellä luotu musiikki voi parantaa toimintakykyä. Käsittelen reaaliaikaista musiikillista palautetta kuntoutusteknologiassa ja aistinkorvauslaitteissa sekä musiikillisia interaktiomalleja harjoitusten ohjaajana. Nykyään liikkeiden mittaukseen tarvittava tekniikka on myös älypuhelimissa, mikä on mahdollistanut uusia ratkaisuja erilaisiin terveystilanteisiin, esimerkiksi näkörajoitteisten, kipupotilaiden sekä kävelyn uudelleenoppimisen avuksi. Kehittyneet järjestelmät myös tunnistavat tunnetiloja ja yhdistävät tiedon algoritmiseen säveltämiseen. Koska musiikilliseen ääneen voidaan sisällyttää sekä liikkeen tekninen laatu että sen sisältämä tunne, voidaan palautteen avulla sekä muokata liikeratoja että säveltää liikkuen, esimerkiksi aktiivisessa ilmaisuterapiassa. Musiikki aktivoi mieltä ja kehoa vaikuttaen havainnon ja toiminnan jatkuvaan prosessiin osana kehollista kognitiota. Siksi se on monipuolisesti vaikuttava työkalu. Instant feedback with musical sounds can make us more aware of how we move. Converting motion into an auditory display can inform about arm position, posture, or performance quality, for instance. Musical feedback can help relearn gross and fine motor functions. It can compensate for weak proprioception and guide and promote social interaction. In addition, music causes motion to the rhythm with functional relevance. Musical sounds are motivational in repetitive and independent exercises due to their playful and emotional character. Thus, music provides an interactive and flexible tool in a rehabilitation context. With a literature review, I study applying the idea of producing music with motion to improve independence and functionality. I examine real-time transformable musical sounds in rehabilitation and cross-modal training technology and the interaction models for pseudo-supervised workouts in day-to-day circumstances. Now, virtually everybody carries a precise kinematics meter, a smartphone that has enabled new adaptations for people suffering from various deficiencies. Applications help with chronic pain, relearning or stabilizing gait, and visual impairment, for instance. Then, sonifying motion with emotion is feasible too. Advanced systems recognize affective states and combine the data with algorithmic composing. Thus, active, expressive therapy can employ sonification as a creative utility. We can shape gestures, alter moods and make music by moving. Music engages complex mechanisms activating our bodies and minds, contributes to the connection between perception and action, and involves embodied cognition. Therefore, it is a pervasive tool.
first_indexed 2023-02-06T21:01:02Z
format Pro gradu
free_online_boolean 1
fullrecord [{"key": "dc.contributor.advisor", "value": "Thompson, Marc", "language": "", "element": "contributor", "qualifier": "advisor", "schema": "dc"}, {"key": "dc.contributor.author", "value": "Sunela, Eeva", "language": "", "element": "contributor", "qualifier": "author", "schema": "dc"}, {"key": "dc.date.accessioned", "value": "2023-02-06T06:53:02Z", "language": null, "element": "date", "qualifier": "accessioned", "schema": "dc"}, {"key": "dc.date.available", "value": "2023-02-06T06:53:02Z", "language": null, "element": "date", "qualifier": "available", "schema": "dc"}, {"key": "dc.date.issued", "value": "2022", "language": "", "element": "date", "qualifier": "issued", "schema": "dc"}, {"key": "dc.identifier.uri", "value": "https://jyx.jyu.fi/handle/123456789/85358", "language": null, "element": "identifier", "qualifier": "uri", "schema": "dc"}, {"key": "dc.description.abstract", "value": "Liikkeeseen perustuva musiikillinen palaute\u00e4\u00e4ni voi tehd\u00e4 meid\u00e4t tietoisemmiksi tavasta jolla liikumme. Kun liike muunnetaan sen \u00e4\u00e4nelliseksi vastineeksi, \u00e4\u00e4ni voi kertoa kehon tai raajojen asennosta sek\u00e4 liikkeen laadusta. Musiikillisen palautteen avulla on mahdollista oppia uudelleen karkea- tai hienomotorisia taitoja. \u00c4\u00e4ni voi my\u00f6s kompensoida heikosti toimivaa asentoaistia, ohjata toimintaa tai edist\u00e4\u00e4 sosiaalista kanssak\u00e4ymist\u00e4. Toistuvissa itsen\u00e4isiss\u00e4 harjoitteissa musiikki motivoi leikillisen ja tunteisiin vetoavan luonteensa takia. Lis\u00e4ksi musiikki on interaktiivinen ja hyvin joustava ty\u00f6kalu kuntoutuksessa, jossa voidaan hy\u00f6dynt\u00e4\u00e4 my\u00f6s vaistonvarainen liike musiikin tahtiin. T\u00e4ss\u00e4 tutkielmassa tarkastelen kirjallisuuskatsauksen kautta, miten liikkeell\u00e4 luotu musiikki voi parantaa toimintakyky\u00e4. K\u00e4sittelen reaaliaikaista musiikillista palautetta kuntoutusteknologiassa ja aistinkorvauslaitteissa sek\u00e4 musiikillisia interaktiomalleja harjoitusten ohjaajana. Nyky\u00e4\u00e4n liikkeiden mittaukseen tarvittava tekniikka on my\u00f6s \u00e4lypuhelimissa, mik\u00e4 on mahdollistanut uusia ratkaisuja erilaisiin terveystilanteisiin, esimerkiksi n\u00e4k\u00f6rajoitteisten, kipupotilaiden sek\u00e4 k\u00e4velyn uudelleenoppimisen avuksi. Kehittyneet j\u00e4rjestelm\u00e4t my\u00f6s tunnistavat tunnetiloja ja yhdist\u00e4v\u00e4t tiedon algoritmiseen s\u00e4velt\u00e4miseen. Koska musiikilliseen \u00e4\u00e4neen voidaan sis\u00e4llytt\u00e4\u00e4 sek\u00e4 liikkeen tekninen laatu ett\u00e4 sen sis\u00e4lt\u00e4m\u00e4 tunne, voidaan palautteen avulla sek\u00e4 muokata liikeratoja ett\u00e4 s\u00e4velt\u00e4\u00e4 liikkuen, esimerkiksi aktiivisessa ilmaisuterapiassa. Musiikki aktivoi mielt\u00e4 ja kehoa vaikuttaen havainnon ja toiminnan jatkuvaan prosessiin osana kehollista kognitiota. Siksi se on monipuolisesti vaikuttava ty\u00f6kalu.", "language": "fi", "element": "description", "qualifier": "abstract", "schema": "dc"}, {"key": "dc.description.abstract", "value": "Instant feedback with musical sounds can make us more aware of how we move. Converting motion into an auditory display can inform about arm position, posture, or performance quality, for instance. Musical feedback can help relearn gross and fine motor functions. It can compensate for weak proprioception and guide and promote social interaction. In addition, music causes motion to the rhythm with functional relevance. Musical sounds are motivational in repetitive and independent exercises due to their playful and emotional character. Thus, music provides an interactive and flexible tool in a rehabilitation context. With a literature review, I study applying the idea of producing music with motion to improve independence and functionality. I examine real-time transformable musical sounds in rehabilitation and cross-modal training technology and the interaction models for pseudo-supervised workouts in day-to-day circumstances. Now, virtually everybody carries a precise kinematics meter, a smartphone that has enabled new adaptations for people suffering from various deficiencies. Applications help with chronic pain, relearning or stabilizing gait, and visual impairment, for instance. Then, sonifying motion with emotion is feasible too. Advanced systems recognize affective states and combine the data with algorithmic composing. Thus, active, expressive therapy can employ sonification as a creative utility. We can shape gestures, alter moods and make music by moving. Music engages complex mechanisms activating our bodies and minds, contributes to the connection between perception and action, and involves embodied cognition. Therefore, it is a pervasive tool.", "language": "en", "element": "description", "qualifier": "abstract", "schema": "dc"}, {"key": "dc.description.provenance", "value": "Submitted by Paivi Vuorio (paelvuor@jyu.fi) on 2023-02-06T06:53:02Z\nNo. of bitstreams: 0", "language": "en", "element": "description", "qualifier": "provenance", "schema": "dc"}, {"key": "dc.description.provenance", "value": "Made available in DSpace on 2023-02-06T06:53:02Z (GMT). No. of bitstreams: 0\n Previous issue date: 2022", "language": "en", "element": "description", "qualifier": "provenance", "schema": "dc"}, {"key": "dc.format.extent", "value": "62", "language": "", "element": "format", "qualifier": "extent", "schema": "dc"}, {"key": "dc.format.mimetype", "value": "application/pdf", "language": null, "element": "format", "qualifier": "mimetype", "schema": "dc"}, {"key": "dc.language.iso", "value": "eng", "language": null, "element": "language", "qualifier": "iso", "schema": "dc"}, {"key": "dc.rights", "value": "In Copyright", "language": "en", "element": "rights", "qualifier": null, "schema": "dc"}, {"key": "dc.subject.other", "value": "interactive real-time sonification", "language": "", "element": "subject", "qualifier": "other", "schema": "dc"}, {"key": "dc.subject.other", "value": "movement sonification", "language": "", "element": "subject", "qualifier": "other", "schema": "dc"}, {"key": "dc.subject.other", "value": "sonification of motion and emotion", "language": "", "element": "subject", "qualifier": "other", "schema": "dc"}, {"key": "dc.subject.other", "value": "sonic interaction", "language": "", "element": "subject", "qualifier": "other", "schema": "dc"}, {"key": "dc.subject.other", "value": "acoustic cueing", "language": "", "element": "subject", "qualifier": "other", "schema": "dc"}, {"key": "dc.subject.other", "value": "acoustic feedback", "language": "", "element": "subject", "qualifier": "other", "schema": "dc"}, {"key": "dc.subject.other", "value": "affective computing", "language": "", "element": "subject", "qualifier": "other", "schema": "dc"}, {"key": "dc.subject.other", "value": "motor relearning", "language": "", "element": "subject", "qualifier": "other", "schema": "dc"}, {"key": "dc.title", "value": "Real-time musical sonification in rehabilitation technology", "language": "", "element": "title", "qualifier": null, "schema": "dc"}, {"key": "dc.type", "value": "master thesis", "language": null, "element": "type", "qualifier": null, "schema": "dc"}, {"key": "dc.identifier.urn", "value": "URN:NBN:fi:jyu-202302061639", "language": "", "element": "identifier", "qualifier": "urn", "schema": "dc"}, {"key": "dc.type.ontasot", "value": "Pro gradu -tutkielma", "language": "fi", "element": "type", "qualifier": "ontasot", "schema": "dc"}, {"key": "dc.type.ontasot", "value": "Master\u2019s thesis", "language": "en", "element": "type", "qualifier": "ontasot", "schema": "dc"}, {"key": "dc.contributor.faculty", "value": "Humanistis-yhteiskuntatieteellinen tiedekunta", "language": "fi", "element": "contributor", "qualifier": "faculty", "schema": "dc"}, {"key": "dc.contributor.faculty", "value": "Faculty of Humanities and Social Sciences", "language": "en", "element": "contributor", "qualifier": "faculty", "schema": "dc"}, {"key": "dc.contributor.department", "value": "Musiikin, taiteen ja kulttuurin tutkimuksen laitos", "language": "fi", "element": "contributor", "qualifier": "department", "schema": "dc"}, {"key": "dc.contributor.department", "value": "Department of Music, Art and Culture Studies", "language": "en", "element": "contributor", "qualifier": "department", "schema": "dc"}, {"key": "dc.contributor.organization", "value": "Jyv\u00e4skyl\u00e4n yliopisto", "language": "fi", "element": "contributor", "qualifier": "organization", "schema": "dc"}, {"key": "dc.contributor.organization", "value": "University of Jyv\u00e4skyl\u00e4", "language": "en", "element": "contributor", "qualifier": "organization", "schema": "dc"}, {"key": "dc.subject.discipline", "value": "Musiikkitiede", "language": "fi", "element": "subject", "qualifier": "discipline", "schema": "dc"}, {"key": "dc.subject.discipline", "value": "Musicology", "language": "en", "element": "subject", "qualifier": "discipline", "schema": "dc"}, {"key": "yvv.contractresearch.funding", "value": "0", "language": "", "element": "contractresearch", "qualifier": "funding", "schema": "yvv"}, {"key": "dc.type.coar", "value": "http://purl.org/coar/resource_type/c_bdcc", "language": null, "element": "type", "qualifier": "coar", "schema": "dc"}, {"key": "dc.rights.accesslevel", "value": "openAccess", "language": null, "element": "rights", "qualifier": "accesslevel", "schema": "dc"}, {"key": "dc.type.publication", "value": "masterThesis", "language": null, "element": "type", "qualifier": "publication", "schema": "dc"}, {"key": "dc.subject.oppiainekoodi", "value": "3051", "language": "", "element": "subject", "qualifier": "oppiainekoodi", "schema": "dc"}, {"key": "dc.subject.yso", "value": "musiikki", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "liike", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "kuntoutus", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "tunteet", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "musiikkiterapia", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "s\u00e4velt\u00e4minen", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "vuorovaikutus", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "liikkuvuus", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "akustiikka", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "motoriikka", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "music", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "motion", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "rehabilitation", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "emotions", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "music therapy", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "composing", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "interaction", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "mobility", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "acoustics (phonics)", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.subject.yso", "value": "motor functions", "language": null, "element": "subject", "qualifier": "yso", "schema": "dc"}, {"key": "dc.format.content", "value": "fulltext", "language": null, "element": "format", "qualifier": "content", "schema": "dc"}, {"key": "dc.rights.url", "value": "https://rightsstatements.org/page/InC/1.0/", "language": null, "element": "rights", "qualifier": "url", "schema": "dc"}, {"key": "dc.type.okm", "value": "G2", "language": null, "element": "type", "qualifier": "okm", "schema": "dc"}]
id jyx.123456789_85358
language eng
last_indexed 2025-02-18T10:55:25Z
main_date 2022-01-01T00:00:00Z
main_date_str 2022
online_boolean 1
online_urls_str_mv {"url":"https:\/\/jyx.jyu.fi\/bitstreams\/973375ee-d236-4e46-8c0f-09cb516f98ae\/download","text":"URN:NBN:fi:jyu-202302061639.pdf","source":"jyx","mediaType":"application\/pdf"}
publishDate 2022
record_format qdc
source_str_mv jyx
spellingShingle Sunela, Eeva Real-time musical sonification in rehabilitation technology interactive real-time sonification movement sonification sonification of motion and emotion sonic interaction acoustic cueing acoustic feedback affective computing motor relearning Musiikkitiede Musicology 3051 musiikki liike kuntoutus tunteet musiikkiterapia säveltäminen vuorovaikutus liikkuvuus akustiikka motoriikka music motion rehabilitation emotions music therapy composing interaction mobility acoustics (phonics) motor functions
title Real-time musical sonification in rehabilitation technology
title_full Real-time musical sonification in rehabilitation technology
title_fullStr Real-time musical sonification in rehabilitation technology Real-time musical sonification in rehabilitation technology
title_full_unstemmed Real-time musical sonification in rehabilitation technology Real-time musical sonification in rehabilitation technology
title_short Real-time musical sonification in rehabilitation technology
title_sort real time musical sonification in rehabilitation technology
title_txtP Real-time musical sonification in rehabilitation technology
topic interactive real-time sonification movement sonification sonification of motion and emotion sonic interaction acoustic cueing acoustic feedback affective computing motor relearning Musiikkitiede Musicology 3051 musiikki liike kuntoutus tunteet musiikkiterapia säveltäminen vuorovaikutus liikkuvuus akustiikka motoriikka music motion rehabilitation emotions music therapy composing interaction mobility acoustics (phonics) motor functions
topic_facet 3051 Musicology Musiikkitiede acoustic cueing acoustic feedback acoustics (phonics) affective computing akustiikka composing emotions interaction interactive real-time sonification kuntoutus liike liikkuvuus mobility motion motor functions motor relearning motoriikka movement sonification music music therapy musiikki musiikkiterapia rehabilitation sonic interaction sonification of motion and emotion säveltäminen tunteet vuorovaikutus
url https://jyx.jyu.fi/handle/123456789/85358 http://www.urn.fi/URN:NBN:fi:jyu-202302061639
work_keys_str_mv AT sunelaeeva realtimemusicalsonificationinrehabilitationtechnology