SIGMA #52

The program of the following 52nd SIGMA meeting on 31.03.2022, 14:00-16:10, which takes place online (please send an email to igor.vatolkin [at] udo.edu if you wish to get the Zoom link):

14:00-14:05 Welcome greetings

14:05-14:35 Bachelor’s thesis (results)
Marcel Schrauder: Music genre classification with artificial neural networks

14:35-15:05 Master’s thesis (results)
Pia Eickhoff: Extended replication study to tone consolidation after Carl Stumpf 

15:05-15:35 Master’s thesis (results)
Florian Scholz: Inclusion of different instrument bodies for robust training of neural networks for instrument recognition

15:35-16:05 Research plan for a PhD thesis
Fabian Ostermann: Artificial Intelligence as a tool for music composers

16:05-16:10 Conferences and calls, miscellaneous, next meeting

Veröffentlicht unter SIGMA | Hinterlasse einen Kommentar

Paper on multi-modal music classification using six modalities published in TISMIR

I. Vatolkin and C. McKay: Multi-Objective Investigation of Six Feature Source Types for Multi-Modal Music Classification. Transactions of the International Society for Music Information Retrieval, 5(1), pp.1–19, 2022.

Abstract: Every type of musical data (audio, symbolic, lyrics, etc.) has its limitations, and cannot always capture all relevant properties of a particular musical category. In contrast to more typical MIR setups where supervised classification models are trained on only one or two types of data, we propose a more diversified approach to music classification and analysis based on six modalities: audio signals, semantic tags inferred from the audio, symbolic MIDI representations, album cover images, playlist co-occurrences, and lyric texts. Some of the descriptors we extract from these data are low-level, while others encapsulate interpretable semantic knowledge that describes melodic, rhythmic, instrumental, and other properties of music. With the intent of measuring the individual impact of different feature groups on different categories, we propose two evaluation criteria based on “non-dominated hypervolumes”: multi-group feature “importance” and “redundancy”. Both of these are calculated after the application of a multi-objective feature selection strategy using evolutionary algorithms, with a novel approach to optimizing trade-offs between both “pure” and “mixed” feature subsets. These techniques permit an exploration of how different modalities and feature types contribute to class discrimination. We use genre classification as a sample research domain to which these techniques can be applied, and present exploratory experiments on two disjoint datasets of different sizes, involving three genre ontologies of varied class similarity. Our results highlight the potential of combining features extracted from different modalities, and can provide insight on the relative significance of different modalities and features in different contexts.

Veröffentlicht unter MIR Research, Publications | Hinterlasse einen Kommentar

SIGMA #51

The program of the following 51st SIGMA meeting on 10.01.2022, 10:00-12:00, which takes place online (please send an email to igor.vatolkin [at] udo.edu if you wish to get the Zoom link):

10:00-10:05 Welcome greetings

10:05-10:35 Conference study
Johannes Gauer: Can spectral complexity reduction improve music perception in cochlear implant users?

10:35-11:05 Conference study
Igor Vatolkin: Music categorization with zygons and semantic features

11:05-11:45 Master’s thesis (results)
Philipp Ginsel: Distance measures for evolutionary approximation of audio data

11:45-12:00 Ongoing teachning courses, conferences and calls, miscellaneous, next meeting

Veröffentlicht unter SIGMA | Hinterlasse einen Kommentar

Paper on EAR Drummer accepted for TISMIR special collection on AI and Musical Creativity

F. Ostermann, I. Vatolkin, and G. Rudolph: Evaluating Creativity in Automatic Reactive Accompaniment of Jazz Improvisation

Abstract: Music generating computer programs can support jazz musicians and students during performance and practice, for instance by providing accompaniment for solo improvisation. However, such software typically plays sequences of static precomposed snippets and does not react to the user. In that context, it is hardly possible to determine whether such a system has any of its own creative powers. Within the scope of a user study with 20 participants, we evaluate and compare the mobile application iReal Pro to our own system, the evolutionary automatic and reactive system called ‘EAR Drummer’ that generates drum patterns as accompaniment to jazz solo improvisation. It adapts its behaviour in real-time by heuristic rules based on music properties derived from the user’s melodies. The user-based evaluation is performed by following the standardised procedure for evaluating creative systems (SPECS). The analysis of the results is based on a Linear Mixed Effects Model to consider fixed and random effects on the survey data. The model reveals that our system outperforms iReal Pro in all of SPECS’s partial components of creativity and significantly outperforms it for 7 of those 14 components including variety, originality, emotional involvement, and social interaction. Further, it is characterised as “better” and “more interesting” in the user survey. A conflicting observation is that while 70% of the study participants tend to prefer our more “creative” system as support for stage performances, only 40% find it more suitable for practice. Further analysis addresses differences between user groups defined by their played instrument, age, and musical experience.

Veröffentlicht unter Publications | Hinterlasse einen Kommentar

Job offer in computational music theory

A PhD/PostDoc position is available within a new lab for computational approaches to music theory, analysis and composition (TU Dortmund, the In­sti­tute of Music and Musicology).

Please see the full description (in German).

Veröffentlicht unter Jobs | Hinterlasse einen Kommentar

Paper on multi-modal music classification accepted for Entropy

The following paper was accepted for Entropy:

B. Wilkes, I. Vatolkin, and H. Müller: Statistical and Visual Analysis of Audio, Text, and Image Features for Multi-Modal Music Genre Recognition

Veröffentlicht unter Publications | Hinterlasse einen Kommentar

Job offer for a student assistant

For assistance during software project „Music Informatics“, a position as a student assistant (8 hours per week) is offered at the Chair of Algorithm Engineering, Department of Computer Science, TU Dortmund. Please see the full description in German.

Veröffentlicht unter AMUSE & MIR Software, General, Teaching Activities | Hinterlasse einen Kommentar

Job offers at Dortmund Systematic Musicology Lab

Two new positions are available in the newly established Dortmund Systematic Musicology Lab, Technische Universität Dortmund, Germany:

  1. Postdoctoral Research Fellow in Systematic Musicology / Music Psychology / Music Cognition 100% E-14, for 5 years
    http://www.egermann.net/?page_id=550
    Deadline: 18 October 2021.
  2. PhD candidate in Systematic Musicology / Music Psychology / Music Cognition, 50%, E-13, for 3 years
    http://www.egermann.net/?page_id=553
    Deadline: 18 October 2021.

For more information, please contact Prof. Dr. Hauke Egermann.

Veröffentlicht unter General | Hinterlasse einen Kommentar

SIGMA #50

The program of the following 50th SIGMA meeting on 24.09.2021, 14:00-16:30, which takes place online
(please send an email to igor.vatolkin [at] udo.edu if you wish to get the Zoom link):

14:00-14:10 Welcome greetings + several slides on the history of SIGMA

14:10-14:40 Research study
Mark Gotham: „Representative“ examples and restrictive „rules“ in music theory

14:40-15:05 Bachelor’s thesis (intermediate results)
Felix Wolff: Optimization of the calculation of zygones in „Schuberts Winterreise Dataset“ with beat-synchronized audio features

15:05-15:15 Ongoing teachning courses, conferences and calls, miscellaneous, next meeting

15:15-16:00 Guest talk
Meinard Müller: Learning-By-Doing: Using the FMP Python Notebooks for Audio and Music Processing

16:00+ Open discussion

Veröffentlicht unter SIGMA | Hinterlasse einen Kommentar

SIGMA #49

The program of the following 49th SIGMA meeting on 18.06.2021, 10:00-12:10, which takes place online
(please send an email to igor.vatolkin [at] udo.edu if you wish to get the Zoom link):

10:00-10:05 Welcome greetings

10:05-10:25 Conference study
Maria Heinze, Frieder Stolzenburg (Hochschule Harz): Harmony cognition by neural transformation – an analysis by EEG

10:25-10:55 Master’s thesis (results)
Fabian Ostermann: Modelling of listener music preferences with neural networks

10:55-11:15 Bachelor’s thesis (results)
Pauline Speckmann: Integration of clustering in AMUSE

11:15-11:35 Master’s thesis (introduction)
Philipp Ginsel: Distance measures for evolutionary approximation of audio data

11:35-12:00 Conference presentation + development plan
Igor Vatolkin, Philipp Ginsel: Changes in AMUSE since its presentation at ISMIR 2010 / development plan for the next years

12:00-12:10 Ongoing teachning courses, conferences and calls, miscellaneous, next meeting

Veröffentlicht unter SIGMA | Hinterlasse einen Kommentar