Musislang: Automated Foreign Language and Culture Learning through Music with Specialized Social Media

AUTOR(I) / AUTHOR(S): Konstantinos Tsigkas , Georgios Kyriafinis , Dimitrios Margounakis  and Dionysios Politis

Download Full Pdf  

DOI: https://doi.org/10.46793/TIE26.083T

SAŽETAK /ABSTRACT:

Traditional foreign language learning often struggles with a lack of intrinsic motivation, isolating students from cultural contexts and live communication. This paper presents Musislang, a language learning software that utilizes music as a vehicle for cultural and linguistic immersion. Musislang unifies personalized study, automation, and social networking into a comprehensive environment. The system allows users to select any song and uses advanced audio processing (AI source separation) to isolate vocals for karaoke-style pronunciation practice. It also introduces acoustic recreation, offering an approximation of how a singer’s prosody would sound in a different target language. Additionally, an automated mechanism dynamically extracts lyric translations and definitions, generating interactive quizzes to support both individual learners and educators. Practical knowledge application is facilitated through two primary interaction paths: a specialized social media platform enabling cultural exchange with native speakers, and an advanced Conversational Chatbot for autonomous written practice. Supported by a gamification system that rewards users with digital badges, Musislang aims to transform language learning into an engaging experience. By integrating music, artificial intelligence, and social networking, this proposed architecture offers an interactive environment with significant practical potential in the field of educational technology.

KLJUČNE REČI / KEYWORDS: 

Language Learning; Artificial Intelligence; Music Technology; Social Media; Gamification

 PROJEKAT / ACKNOWLEDGEMENT:

LITERATURA / REFERENCES:

• Brandt, A., Gebrian, M., and Slevc, L. R. (2012). Music and early language acquisition. Psychol. 3:327. DOI:10.3389/fpsyg.2012.00327.
• Crystal, D. (1969). Prosodic Systems and Intonation in English, Cambridge University Press.
• Halliday, M. A. K. (1976). Intonation and meaning. In G. Kress (Ed.), System and function in language, pp. 331-352. Oxford: Oxford University Press.
• Arvaniti, A. Measuring Speech Rhythm. In R.A. Knight and J. Setter (Eds.) The Cambridge Handbook of Phonetics, Cambridge University Press, 312-335.
• Karsono, K. (2019). The Effect of Using Karaoke Activities on Students English Pronunciation. JRT-Journal of English Teaching, 5(3), 179. DOI:10.33541/jet.v5i3.1311.
• Papastergiou, M. (2009). Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation. Computers & Education, 52(1), 1-12.
• Mavridis, A., & Tsiatsos, T. (2017). Game-based assessment: Investigating the impact on test anxiety and exam performance. Journal of Computer Assisted Learning, 33(2), 137-150.
• Biswal, R., Prusty, B. (2011). Trends in Neuro-Linguistic Programming (NLP): A Critical Review. Social Science International, 21(1), 41-56.
• Politis, D., Tsalighopoulos, M., Kyriafinis, G. (2017). Designing Blended Learning Strategies for Rich Content. In K. Shelton & K. Pedersen (Eds.), Handbook of Research on Building, Growing, and Sustaining Quality E-Learning Programs, 341-356. N. York: IGI Global Scientific Publishing.
• Charidimou, D., Tsigkas, K., Patsias, L.-A., Politis, D., & Kyriafinis, G. (Forthcoming). MusicLang: Multimodal Lyrics Translations and Prosodic Transformations in Music with an Interactive AI supported App. Lecture Notes in Networks and Systems. Springer Nature Switzerland AG.
• Politis, D., Kyriafinis, G., Constantinidis, J., Paris, N. (2017). Neurophysiology-based acoustic measurements of singing contours – an empathetic interactive loudness approach. In Proceedings of the International Conference on Interactive Mobile Communication Technologies and Learning, IMCL 2017, Thessaloniki, 803-812.
• Sayd, A. I., Nazarudin, H. (2022). Game-Based Learning to Improve the Vocabulary Mastery in EFL Class, Proceedings of the International Conference on Applied Science and Technology on Social Science, 321-326.