SiSEC 2016

Welcome to the main page for the sixth community-based Signal Separation Evaluation Campaign (SiSEC 2016).

SiSEC aims to be a large-scale regular campaign building upon the experience of previous evaluation campaigns and first community-based Signal Separation Evaluation Campaign (SASSEC).

It will be held in conjunction with the LVA/ICA 2017 conference, where participants will be able to present their approach.

So far, several SiSECs (SiSEC2008, SiSEC2010, SiSEC2011, SiSEC2013 and SiSEC2015) were held every one and half year. The unique aspect of this campaign is that it is not a competition but a scientific evaluation from which we can draw rigorous scientific conclusions.

Important Dates

  • 22nd Apr, 2016:      Deadline for evaluation proposal
  • 13th Jun, 2016:      Call for submission of separation results for MUS, ASY, UND, BGN
  • 22th Jul, 2016: 5th, Aug, 2016: Deadline for submission of separation results for MUS, ASY, UND, BGN tasks
  • 14th Aug, 2016:      Deadline for submission of separation results for BIO task
  • 2nd Sep., 2016:     Paper submission deadline of LVA/ICA 2017
  • Nov., 2016:              Publication of SiSEC 2016 results (on the web)
  • 2nd. Dec, 2016:     Deadline for LVA/ICA camera-ready papers
  • 21-23 Feb., 2017:  LVA/ICA conference


Datasets, Tasks, and Evaluation Procedures

  1. Underdetermined speech and music mixtures
  2. Two-channel mixtures of speech and real-world background noise
  3. Professionally produced music recordings
  4. Asynchronous recordings of speech mixtures
  5. Separation of biomedical signals

We welcome other tasks/datasets/evaluation criteria from participants. Anyone can comment or reply about this issue via the comment system at the bottom of the task page.




Evaluation Results of SiSEC 2016




SiSEC 2016 Evaluation Organizing Committee

  • Antoine Liutkus (Inria)
  • Nobutaka Ono (NII)
  • Daichi Kitamura (SOKENDAI)
  • Nobutaka Ito (NTT)
  • Zafar Rafii (Gracenote)
  • Fabian Stöter (Audiolabs)
  • Bertrand Rivet (Grenoble INP)
  • Julie Fontecave (IMAG)

ASY 2016

Asynchronous recordings of speech mixtures Introduction Asynchronous recording is a new interesting task of source separation. The multichannel observation is obtained by multiple independent recording devices, and has wide range of application using portable recording devices as smartphones and IC recorders. The main differences from the conventional synchronous multichannel recording are unknown time offset and …

BGN 2016

Two-channel mixtures of speech and real-world background noise We propose to repeat the Two-channel mixtures of speech and real-world background noise Introduction This task aims to evaluate denoising and DOA estimation techniques by the SiSEC 2010 noisy speech dataset. Description of the dataset We consider two-channel mixtures of one speech source and real-world background noise …

BIO 2016

Separation of biomedical signals Description of the challenge: Phonocardiography (PCG) is the recording of the sounds generated by the heart. It allows to evaluate some vital functions of the heart.However, the raw recordings of the PCG are not always directly exploitable because of ambiant interferences (e.g., speech, cough, gastric noise, etc). Consequently, it is necessary …

MUS 2016

Professionally-produced music recordings We propose to reproduce this year the 2015 Professionally produced music recordings task. 0. Introduction The purpose of this task is to evaluate source separation algorithms for estimating one or more sources from a set of mixtures in the context of professionally-produced music recordings. The data set consists of a total of …

UND 2016

Underdetermined-speech and music mixtures We propose to repeat the underdetermined-speech and music mixtures task in SiSEC2015. Test data We have three datasets: Download test.zip (22 MB) (test data of SiSEC2008.) Download test2.zip (16 MB) (test data of SiSEC2010.) Download test3.zip (8.6MB)(test data of SiSEC2011. This is the 3-ch mixtures of 4 speech sources.) test.zip test.zip …