WEEK 7: 2/24 – 2/28

WEEK 7: 2/24 – 2/28

This week we began work on creating our 3D models that would populate our visualization world. Our lead artist Nayoung, began by creating 2D designs for the flute and the clarinet and the 2D designs of the cells that these instruments would emit. Both Nayoung and Victor then proceeded to create rigged models of the clarinet and the flute, which could then be used in a Unity scene in the way we need them to behave. We got our multiple screen setup to work and now 4 screens are set up from one machine. What is happening in essence is we have one scene in Unity depicting all the five instruments. So far, with simple inputs, we’re able to render these 5 instruments pretty smoothly in real-time. We’re aware that the rendering could get difficult with more complex and fast inputs and are working on optimizing the system. We managed to go to the Kresge Hall this week and take some measurements of the stage and the backstage. We also took photographs of the hall from different audience perspectives to give us an idea what the audience will see from different parts of the auditorium. This also allowed us to create rough stage designs for how to place our screens and the musicians with respect to the audience. We also met with our client Dr. Thomas this week and presented the various stage designs that we came up with. We had some reference images to show her alongwith the stage designs, which made it easier to explain the stage designs that we had...
WEEK 6: 2/17 – 2/21

WEEK 6: 2/17 – 2/21

Our first week after quarters, we took a little time to recoup. We got quite some valuable feedback from the quarters, something we as a team had to pore over and address some of the issues raised. We revisited the storyboard and the our visual concepts and tried to figure out how to move ahead from the prototype that we had. Our art team began making solid concepts for the visuals that we will be seeing on screen. While the artwork is something that will constantly be evolving, it was a good place for the tech team to start from. The other major deliverable we had from the ETC standpoint was our project’s website. While part of the programming team concentrated on researching and trying out new mechanisms that we could use for our performances, Victor, along with Nayoung and Christina, set to work on the project website. A perfect marriage of tech and art, the website came together by the end of the week. Christina and Nayoung also together and began work on the virtual instrument design for our visualization. Christina shared her musical expertise and guided Nayoung about the intricacies of each woodwind instrument, mentioning which key on the instrument would be used. This will help Nayoung in creating the virtual instrument concepts by early next week. We got cracking on getting our equipment. We identified all the sound equipment we would require and started requesting for them to be purchased. We also requested for a dedicated system that could support 5 screens, thus allowing us to simulate our eventual system for the final performance. This would...
WEEK 5: 2/10 – 2/14 (QUARTERS WEEK)

WEEK 5: 2/10 – 2/14 (QUARTERS WEEK)

This was quarters week. While we were still moving towards overall progress, most of our efforts were directed towards the quarters at the end of the week. Having the quarters at the end of the week helped us in a way such that we could actually work towards our progress which would also be what we would show at quarters. We were primarily focussing on creating a working prototype which we could exhibit at quarters. This week we got hold of some of the equipment we required to begin our work. We received the first sound to MIDI converter and tested it to see if it really works. Victor began by making a simple prototype where he could identify every single that could be played. We had some faculty and students have fun with this prototype; Jesse Schell even played his harmonica and the system could recognise each single note. The art team worked on creating a storyboard for our narrative. Nayoung picked out some reference images for the same and built a narrative that matched the four movements. We had a detailed discussion about the flow of the narrative and how each movement represents a portion of the great cycle of life and death. With this in place, our artist began working on concept art for the stage setup and how our visuals would look on screen. We also managed to have our client, Dr. Thomas come down to the ETC and see the progress that we’ve been making. She was very appreciative of the visuals and the idea of having a narrative through the four pieces and...
WEEK 4: 2/3 – 2/7

WEEK 4: 2/3 – 2/7

The penultimate week before quarters, this week we concentrated on giving our deliverable direction. To this end, we identified what equipment we would be requiring to successfully input analog sound and convert it to MIDI signals. We debated for a while if we actually needed to get MIDI signals or if we could do with pulling pitch and amplitude of the music being played. Internally in the team we decided that converting sound to MIDI signals would give us more freedom to play with the music, as then we would be able to identify each note. Once again, we got in touch with Dave Purta who helped us in identifying portable equipment that could convert analog sound to MIDI signals. We also contacted Prof. Riccardo Schulz at the School of Music to get his recommendations and opinions about the equipment we should use. Monday was a busy day. We started the week by shooting for our team photo. It was an enjoyable experience, as we got to play around and pose in the green screen room. On the same day, we had a branding critique, where we got feedback on the posters and half-sheet designs that Nayoung had made. They were much appreciated with only minor feedback about text. We also attended a playtesting workshop hosted by Jessica Hammer, where we learnt many valuable tips and tricks on how to conduct a workshop. Seeing how playtesting would be a great guide for us in the coming weeks, this session was very informative. Christina made MIDI mock-ups for all the four movements, with quick turnaround. She also started work on analysing...
WEEK 3: 1/27 – 1/31

WEEK 3: 1/27 – 1/31

This week has been in a bit of a flux for the team. We, as a team, are still trying to figure out exactly what we are going to create as our deliverable. We’re still in the blue sky phase, but our technical research is ongoing. We got hold of our decorations for the room and began decorating our room with posters and lights. This will be an ongoing process for us as we will continue to add more artwork as we create art for the project. After analysing Dr. Thomas’ last email, we as a team, had a few internal questions about we wanted to achieve. Having decided right from the start that we wanted to create something more than just a graphic visualizer, we asked ourselves how we can make the experience more than just that. We researched about different technologies such as Myo gesture control, a band that can be worn on the hands and read your muscle movements, and considered using the Makey Makey. We were thinking about making the experience more than just about listening to music, but make it about the experience of creating music. We thought it would be interesting to pull data from the musicians themselves, such as their heart rate, or muscle movements and incorporate that into the visual experience. We presented a more concentrated approach to the deliverable to Dr. Thomas. We introduced these ideas to her and presented her an ‘ecosystem’ idea, where different cellular creatures represented each instrument. Dr. Thomas was very enthused about this sort of setting, giving us freedom to use any sort of technology...