Research on Technology

Whilst researching videos and information about the Wii Remote Controller, I came across this video which I found extremely interesting on both a technological and performance aspect; using the technology of motion sensors the Physical Sequencer is a human interface which inevitably encourages musical expression:

The Physical Sequencer is a grid based human sequencer that uses 56 motion sensors which are individually gridded on a 7x8 board which detect the movement of the performer; this movement could consist of speed and height. A Motion Sensor is a device that contains an electronic device which detects motion, within electronic sensors when motion is detected these sensors will transform motion and produce this into an electric signal. Regarding the video, when each of these motion sensors detect the movement of the performer; each motion sensor will send an electric signal to a connected laptop which will use theses signals to trigger a sample or musical sound depending on the software used.

As a result of watching this, the video above shows how a sound installation can be combined with a performance whether its a choreographed dance or if it is improvised movements. 

1st Patch For Wiimote

From continuing to research on the internet about the use of controlling patches using a Wii Remote Control, myself and Simon began looking at ideas and patches that we could create which would react to the movement of the remote control. The video above highlights the use of two Max MSP patches which were designed in order to react to the pitch movement of the wiimote, this is illustrated within the green lines of the following diagram. Nevertheless, the two patches are initial ideas which will be developed and designed further in order to create a patch that will react to the pitch, roll and yaw movements however, I feel at this stage it is necessary for myself to design and develop ideas using Max MSP.

After syncing the wiimote to the laptop using osculator, I uploaded the template "Connect Wiimote to Max MSP" (a screen shot of this was published on an earlier blog of mine) which showed the movement of the controller using number boxes. From this, we used the Pitch number box and sent this information into a new patch through using a receive object which allowed us to create a patch that would be controlled through the pitch movement of the wiimote. As a result of this we decided to use a "mtof" object which converts MIDI notes to frequencies as this would give the remote controller the ability to produce a range of musical notes through specific vertical movements. After creating this patch we also used the information from the movement of the pitch to create a second patch which would control the buffer of a sample; this was achieved by importing a buffer patch into Max MSP in which we connected a receiver object from the "Connect Wiimote to Max MSP" patch. After importing an audio file into the buffer we were able to control the speed of the file through specific vertical movements from the wiimote.  These two patches are shown below:

Ultimately, from experimenting with the Pitch Movement of the Wiimote, this has given me a brief understanding of the wide capabilities of the remote control and the possibilities of creating a patch that will incorporate the use of other movements of the controller. From this the next stage that I will undergo will be to both develop patches similar to this as well as researching information on the Wii remote controller which will inevitably allow myself to produce a patch that will be used for my "Wii Tennis" idea.

Further Wii Remotes with Max MSP

From continuing to research through online webpages, I came across this video which has been taken from YouTube:

Uploaded by Boymakesmusic, the video above illustrates the extreme possibilities of using the technology from a Wiimote along with Max MSP. As a part of a school project, "Boymakesmusic" developed several patches that were created using the software Max which was controlled by a Wii Remote in order to generate both IDM style beats and pre-made loops. As a result of this, the video shows how a composition can be gradually created through a range of patches that have been created and controlled by the Wii Remote control. Inevitably after watching this; I felt that this video shows the possible use of creating a patch that generates loops through particular hand or wrist movements by the user which in turn creates a unique performance.
Nevertheless, from this; I feel that it could be worthwhile to develop and create a patch based on a number of loops which would be triggered by the Wii Remote. These loops could be triggered when the ball (containing the remote control) would be struck by a tennis bat; however, I feel that further research and class discussions will allow myself to develop a working patch.

Wii Remotes and Max MSP

After researching on YouTube for videos based on people using the technology of the Wii Remote Control along with the software Max MSP, I came across this following video which illustrates how the user charytanaka has created a patch using Max MSP which controls and imitates the wiimote as a theramin. As a result of this, this shows the capability and the possibilities of using a Wii remote controller alongside with Max, from this, I think that it is essential for myself to continue researching for videos such as this in order for myself to gain inspiration for when I will develop a patch used for my Wii Remote Tennis idea.

Wii Remote Connection

After proposing my end of term "Tennis Wii Remote" idea to the Performance Technology class, I felt that it was particularly important to research into softwares and Max MSP patches that would allow myself to control a Wii remote (which would be placed within a ball) to a pre-made patch in Max5.

After researching online web forums and having a discussion with Simon, we decided to use a software named OSCulator as this software has been designed to synchronise electronic gadgets to a range of MIDI sequencers as well as supporting softwares such as Max MSP, SuperCollider etc.  After downloading OSCulator, I tried to sync the "wiimote" to the computer but had a number of connection problems which were soon resolved after I changed the batteries and pressed the sync button placed within the battery compartment. 

When connected, I then opened a pre-made patch in Max MSP created by OSCulator which displays the positioning of the Wii remote controller concerning pitch, roll, yaw and scalar acceleration data; this patch is displayed below:

As a result of connecting the Wii to Max MSP, the next stage that I think will be essential will be  to create a patch which will be designed around the movement and positioning of the Wii Remote, from this, I think that it may be beneficial for myself to research and investigate whether people are already using Wii Remotes with softwares such as Max and the possibilities of producing a range of sounds.

Proposed Project for Performance Technology

As a result of attending the Tramway Showcase in Glasgow, this gave me a "hands on" opportunity to see how people are using and developing modern technology in order to produce unique musical experiences; from this, I have devised my own idea in which I would like to develop further. I have proposed a project that will showcase at the end of term Performance Technology concert that will use both the technology a Wii remote control as well as the software of Max MSP. The following information outlines the basis of this idea as well as areas in which I will need to both investigate and develop. 

The Wii is a video game console which was released by Nintendo in 2006  which has developed the idea of allowing users to control and manipulate functions of  the console through the use of motion sensors which is achieved through the technology used within the  remote control. The Wii Remote is a wireless motion sensing controller which has used both accelerometer and optical sensor technology in order to allow the user to control the gaming of the console through wrist/arm movements which ultimately offers a unique experience when playing.                                                                                  

From this, my proposed idea for the Performance Technology Showcase is to use the technology within the Wii Remote to create an object which produces sound depending on the movement of the controller. When walking around Tramway, I noticed that many of the installations allowed and encouraged the public to interact with them and from this, I want to create an instrument that requires human interaction.

From this, I have decided to incorporate the technology used within the Wii Remote and to develop this within a sporting activity. My proposed idea is to place the wii remote into a ball which will be used in a game of Tennis, Badminton, Swingball, Football etc. When placed inside a ball, the wii remote will be wirelessly connected to a patch created in Max MSP which will produce a range of sounds depending on the movement of the controller.

As a rough idea, this project requires a lot of research and design developments as there are many areas in which I need to investigate including:

*The physical weight/dimensions of the Wii remote and the possibilities of placing this within a ball.

* How to connect the Wii Remote to Max MSP and to research any software which allows myself to do this.

* Creating a patch which is designed around the movement of the Wii Remote and which successfully works accordingly. 

*Anthropometric problems which may arise and any difficulties regarding human interaction.

In conclusion, the next stage of this idea is to research and look into the connection between using the controller alongside with Max MSP.