https://mediatech.aalto.fi/en/research/virtual-acoustics/research/experimental-user-interfaces-with-auditory-feedback 2016-11-03T14:05:37+02:00 Mediatekniikan Laitos webmaster@tml.hut.fi Joomla! - Open Source Content Management 2013-01-09T14:43:24+02:00 2013-01-09T14:43:24+02:00 https://mediatech.aalto.fi/en/research/virtual-acoustics/research/experimental-user-interfaces-with-auditory-feedback/89-eyes-free-user-interfaces TL ktlokki@tml.hut.fi

<p>Under construction.</p> <p><button class="btn btn-info btn-small" type="button" data-toggle="collapse" data-target="#part1">Read more...</button></p> <div id="part1" class="collapse out"> <p> </p> </div> <div id="acousticCarousel" class="carousel slide"> <div class="carousel-inner"> <div class="item active"><img src="images/research/virtualacoustics/eyesfree/eyesfree1.jpg" width="708" height="189" /> <div class="carousel-caption"> <h4>Eyes-free interaction with gestural control and auditory feedback</h4> <p> </p> </div> </div> <div class="item"><img src="images/research/virtualacoustics/BRDF1.jpg" /> <div class="carousel-caption"> <h4>Second Thumbnail label</h4> <p>Cras justo odio, dapibus ac facilisis in, egestas eget quam. Donec id elit non mi porta gravida at eget metus. Nullam id dolor id nibh ultricies vehicula ut id elit.</p> </div> </div> </div> <p><a class="carousel-control left" href="#acousticCarousel" data-slide="prev">‹</a> <a class="carousel-control right" href="#acousticCarousel" data-slide="next">›</a></p> </div> <h3> </h3> <h4>References</h4> <p>{bibtex}virtualacoustics/eyesfree_page.bib{/bibtex}<br /><br /></p>

<p>Under construction.</p> <p><button class="btn btn-info btn-small" type="button" data-toggle="collapse" data-target="#part1">Read more...</button></p> <div id="part1" class="collapse out"> <p> </p> </div> <div id="acousticCarousel" class="carousel slide"> <div class="carousel-inner"> <div class="item active"><img src="images/research/virtualacoustics/eyesfree/eyesfree1.jpg" width="708" height="189" /> <div class="carousel-caption"> <h4>Eyes-free interaction with gestural control and auditory feedback</h4> <p> </p> </div> </div> <div class="item"><img src="images/research/virtualacoustics/BRDF1.jpg" /> <div class="carousel-caption"> <h4>Second Thumbnail label</h4> <p>Cras justo odio, dapibus ac facilisis in, egestas eget quam. Donec id elit non mi porta gravida at eget metus. Nullam id dolor id nibh ultricies vehicula ut id elit.</p> </div> </div> </div> <p><a class="carousel-control left" href="#acousticCarousel" data-slide="prev">‹</a> <a class="carousel-control right" href="#acousticCarousel" data-slide="next">›</a></p> </div> <h3> </h3> <h4>References</h4> <p>{bibtex}virtualacoustics/eyesfree_page.bib{/bibtex}<br /><br /></p> 2013-01-09T14:43:24+02:00 2013-01-09T14:43:24+02:00 https://mediatech.aalto.fi/en/research/virtual-acoustics/research/experimental-user-interfaces-with-auditory-feedback/90-conductor-following TL ktlokki@tml.hut.fi

<h3>Controlling sample-based synthesis with expressive gestural input</h3> <p>Using <em>Conductor Follower</em> can be briefly described as conducting a virtual orchestra. The system uses a Kinect (or any other <a href="http://www.openni.org/">OpenNI</a> compatible device) to capture hand movement. This data is analyzed, and the infromation used to process score data from a <a href="http://en.wikipedia.org/wiki/MIDI">MIDI</a> file. A synthesizer is then controlled using the modified MIDI data.</p> <p>The final outcome of the projet is a <a href="http://en.wikipedia.org/wiki/Virtual_Studio_Technology">VST</a> plugin, which produces a stream of MIDI events. The project was coded in C++, using <a href="http://www.openni.org/">OpenNI</a> for hand tracking, and <a href="http://www.rawmaterialsoftware.com/juce.php">Juce</a> for VST and MIDI related functionality. The <a href="http://boost.org">Boost</a> C++ libraries were also heavily utilized. The source code and documentation for the project are available online on <a href="https://github.com/sbergen/ConductorFollower">GitHub</a>.</p> <h4>Demo video</h4> <p>The demo video below is a screen capture, including the visualization part of the plugin. It shows the basic functionality as I conduct part of Mozart's Trio for piano, clarinet and viola in E flat major, KV 498.</p> <p>http://www.youtube.com/watch?v=DoGmnLHjI6w</p> <h4>Acknowledgment</h4> <p>The project was implemented as part of my master's thesis, and has received funding from the European Research Council under the European Community's Seventh Framework Programme (FP7/2007-2013) / ERC grant agreement no. [203636].</p> <h4>References</h4> <p>Sakari Bergen, "<a href="https://github.com/sbergen/ConductorFollower/blob/7430a3668c375b71213498d6e5476716d191bda0/doc/thesis.pdf" target="_blank">Conductor Follower: Controlling sample-based synthesis with expressive gestural input</a>&nbsp;", Master's Thesis, Aalto University, 2012</p> <p>Sakari Bergen,&nbsp;<a style="color: #1b57b1; text-decoration: none; font-weight: normal;" href="http://prezi.com/embed/bixpielqjja6/" target="_self">The thesis presentation</a>, made with&nbsp;<a style="color: #1b57b1; text-decoration: none; font-weight: normal;" href="http://prezi.com">Prezi</a>.</p> <div>&nbsp;</div>

<h3>Controlling sample-based synthesis with expressive gestural input</h3> <p>Using <em>Conductor Follower</em> can be briefly described as conducting a virtual orchestra. The system uses a Kinect (or any other <a href="http://www.openni.org/">OpenNI</a> compatible device) to capture hand movement. This data is analyzed, and the infromation used to process score data from a <a href="http://en.wikipedia.org/wiki/MIDI">MIDI</a> file. A synthesizer is then controlled using the modified MIDI data.</p> <p>The final outcome of the projet is a <a href="http://en.wikipedia.org/wiki/Virtual_Studio_Technology">VST</a> plugin, which produces a stream of MIDI events. The project was coded in C++, using <a href="http://www.openni.org/">OpenNI</a> for hand tracking, and <a href="http://www.rawmaterialsoftware.com/juce.php">Juce</a> for VST and MIDI related functionality. The <a href="http://boost.org">Boost</a> C++ libraries were also heavily utilized. The source code and documentation for the project are available online on <a href="https://github.com/sbergen/ConductorFollower">GitHub</a>.</p> <h4>Demo video</h4> <p>The demo video below is a screen capture, including the visualization part of the plugin. It shows the basic functionality as I conduct part of Mozart's Trio for piano, clarinet and viola in E flat major, KV 498.</p> <p>http://www.youtube.com/watch?v=DoGmnLHjI6w</p> <h4>Acknowledgment</h4> <p>The project was implemented as part of my master's thesis, and has received funding from the European Research Council under the European Community's Seventh Framework Programme (FP7/2007-2013) / ERC grant agreement no. [203636].</p> <h4>References</h4> <p>Sakari Bergen, "<a href="https://github.com/sbergen/ConductorFollower/blob/7430a3668c375b71213498d6e5476716d191bda0/doc/thesis.pdf" target="_blank">Conductor Follower: Controlling sample-based synthesis with expressive gestural input</a>&nbsp;", Master's Thesis, Aalto University, 2012</p> <p>Sakari Bergen,&nbsp;<a style="color: #1b57b1; text-decoration: none; font-weight: normal;" href="http://prezi.com/embed/bixpielqjja6/" target="_self">The thesis presentation</a>, made with&nbsp;<a style="color: #1b57b1; text-decoration: none; font-weight: normal;" href="http://prezi.com">Prezi</a>.</p> <div>&nbsp;</div>