Centre for Digital Music

 
 

IEEE AASP Challenge:
Detection and Classification of Acoustic Scenes and Events

Event Detection - Office Live Results

These are the results for the running of the Event Detection - Office Live subtask. For background information about this task set please refer to the subtask specifications and the subtask datasets. See also the WASPAA 2013 paper summarising the D-CASE challenge results and the EUSIPCO 2013 paper describing the baseline systems.

General Legend

Code Abstract Participants
CPS PDF Sameer Chauhan, Sharang Phadke, Christian Sherland
DHV PDF Aleksandr Diment, Toni Heittola and Tuomas Virtanen
GVV PDF Jort F. Gemmeke, Lode Vuegen, Bart Vanrumste, Hugo Van hamme
NR2 PDF Waldo Nogueira, Gerard Roma, Perfecto Herrera
NVM PDF Maria E. Niessen, Tim L. M. Van Kasteren, Andreas Merentitis
SCS PDF Jens Schröder, Benjamin Cauchi, Marc René Schädler, Niko Moritz, Kamil Adiloglu, Jörn Anemüller, Simon Doclo, Birger Kollmeier, Stefan Goetze
VVK PDF Lode Vuegen, Bert Van Den Broeck, Peter Karsmakers, Jort F. Gemmeke, Bart Vanrumste, Hugo Van hamme

Frame-based Results

F (%) Pre (%) Rec (%) AEER
CPS 3.82 9.15 3.05 2.116
DHV 26.0 19.84 45.28 3.128
GVV 31.94 61.78 22.29 1.084
NR2 34.66 37.15 34.96 1.885
NVM_1 40.85 59.90 32.90 1.115
NVM_2 42.76 61.15 34.28 1.102
NVM_3 45.50 57.23 38.80 1.212
NVM_4 42.86 50.79 37.79 1.360
SCS_1 53.02 59.89 48.28 1.167
SCS_2 61.52 66.18 57.83 1.016
VVK 43.42 68.14 32.60 1.001
Baseline 10.72 12.13 10.56 2.590

Event-based Results

F (%) Pre (%) Rec (%) F_off (%) Pre_off (%) Rec_off (%) AEER AEER_off
CPS 2.23 3.21 1.86 1.65 2.44 1.34 2.285 2.301
DHV 26.67 22.75 33.46 22.43 19.08 28.22 2.519 2.676
GVV 15.52 61.82 22.22 13.46 21.85 12.89 1.779 1.831
NR2 19.21 14.85 27.66 15.26 11.79 22.03 3.076 3.244
NVM_1 32.57 33.91 32.19 24.95 26.14 24.50 1.864 2.095
NVM_2 34.16 34.93 34.17 26.28 27.11 26.05 1.852 2.095
NVM_3 34.51 36.13 33.80 27.01 28.42 26.31 1.827 2.052
NVM_4 30.47 31.83 30.07 24.68 25.95 24.18 1.906 2.083
SCS_1 39.47 41.72 37.76 36.74 38.86 35.12 1.669 1.749
SCS_2 45.17 45.49 45.38 41.06 41.43 41.18 1.601 1.727
VVK 30.77 31.31 32.53 25.40 25.83 26.86 2.054 2.224
Baseline 7.38 4.82 18.18 1.58 1.02 4.17 5.900 6.318

Class-wise Event-based Results

F (%) Pre (%) Rec (%) F_off (%) Pre_off (%) Rec_off (%) AEER AEER_off
CPS 0.65 0.41 2.16 0.49 0.32 1.55 1.872 1.891
DHV 30.72 30.99 35.85 25.29 25.49 29.58 2.182 2.370
GVV 13.21 14.23 13.80 12.03 13.24 12.13 1.556 1.606
NR2 21.54 20.86 28.46 17.64 16.65 23.34 2.857 3.010
NVM_1 29.37 28.88 34.23 21.80 21.26 25.56 1.639 1.899
NVM_2 33.05 33.07 37.33 24.88 24.74 28.14 1.602 1.877
NVM_3 33.52 35.10 36.61 24.65 25.29 27.57 1.575 1.846
NVM_4 28.17 30.16 30.79 21.62 23.07 24.15 1.650 1.849
SCS_1 36.33 40.63 39.56 34.20 38.80 36.31 1.579 1.677
SCS_2 41.51 43.44 46.42 38.32 40.57 41.94 1.511 1.646
VVK 24.55 22.26 33.00 20.36 18.76 26.76 1.762 1.949
Baseline 9.00 7.31 21.65 1.86 1.36 4.91 5.960 6.462


Back to main challenge page