VBAM: VIRTUAL BROAD ART MUSEUM COMMISSION

Press Release

View the VBAM project

VBAM Introductory Lecture

John Fillwalk and the Institute for Digital Intermedia Arts (IDIA Lab) at Ball State University were commissioned to design and build a virtual museum artworks for the Eli and Edythe Broad Art Museum in East Lansing, MI. The physical Museum, was designed by architect Zaha Hadid and opened to the public in Fall 2012. Museum Director, Michael Rush commissioned Fillwalk and IDIA Lab to envision and create a dynamic program of artworks for the Virtual Broad Art Museum project (VBAM). Fillwalk and his collaborators created an immersive multi-user environment and four commissioned artworks using Unity 3D – experienced entirely within a web browser.

“Engaging visitors with innovators at the leading edge of art and technology, both here at MSU and around the globe, is key to the Broad Art Museum’s mission,” said founding director Michael Rush. “With the Virtual Broad Art Museum, we have an opportunity to embrace the tremendous creative and connective possibilities that exist in the digital world.”

The mixed world reception took place on Thursday, March 15th 2012 from 6:00 – 8:00 pm EST simultaneously on the campus of Michigan State University and in the VBAM virtual worlds.

Please visit the VBAM project links below.

http://idialabprojects.org/vbam/proxy.html

http://idialabprojects.org/vbam/flickrgettr.html

http://idialabprojects.org/vbam/survey.html

http://idialabprojects.org/vbam/confluence.html

VBAM Exhibitions by John Fillwalk

Participants in con|FLUENCE can create pathways based on reactions to both social and spatial relationships. There is a virtual response and persistence to interactions, as the routes are drawn and sculpted in the three-dimensional environment – forming nodes that are created via visitors’ proximity.

con|FLUENCE. John Fillwalk. 2012.

Survey for VBAM is an immersive landscape simulation using real time weather data from the location of the Broad Art Museum in East Lansing, Michigan. Representations of surveyor’s tape, flags, light, sky color, time of day, wind speed and even cloud density are driven by the actual physical weather forces – informing the virtual landscape.

Survey. John Fillwalk. 2012.

dis|PLACE is an interactive gesture-based performance that will be exhibited at the VBAM reception on the 15th of March. This installation links virtual space to physical reality in an exploration of agency and gesture. Employing a participant’s movement, the work can both navigate 3D space – as well as control direct interactions with the digital performers via a Microsoft Kinect™ sensor.

dis|PLACE. John Fillwalk. 2012.

Proxy is a performative, interactive and site-specific virtual installation where participants shape the evolution of a sculptural and sonic composition as a response to the Museum. Interactions are painted, sculpted and sonified within this collaborative and evolving environment. The work progresses to construct in itself relation to the Museum – eventually transforming as integrated structure – reflecting and becoming its environment.

Proxy. John Fillwalk. 2012.

Flickr™ Gettr for VBAM connects the social image web service of Flickr™ to the virtual Museum environment, allowing visitors to create a dynamic cloud of spatial imagery by entering a search term of their choice – providing tagged images from Flickr™ into the Museum environment. The search term is spoken by the software and tags from image cloud are revealed allowing for subsequent user transformations of the spatial imagery.

Flickr Gettr. John Fillwalk. 2012.

Credits

Proxy.
John Fillwalk with
Neil Zehr, Michael James Olson
2012

Survey for VBAM
John Fillwalk with
Neil Zehr, Keith Kothman, Charles Estell
2012

Flickr Gettr for VBAM
John Fillwalk with
Jesse Allison, Neil Zehr, Charles Estell
2012

con|FLUENCE
John Fillwalk with
Neil Zehr
2012

dis|PLACE (exhibited at the reception on the 15th of March as a live performance only)
John Fillwalk with
Neil Zehr, Jonathan Strong
2012

Michael Rush, Director of the Broad Museum of Art, MSU
Adam Brown, Professor Intermedia and Electronic Art, MSU
John Fillwalk, Director of the Institute for Digital Intermedia Arts [IDIA Lab], BSU
Neil Zehr, IDIA Lab, BSU
Charles Estell, IDIA Lab, BSU
Michael James Olson, IDIA Lab, BSU
Ina-Marie Henning, IDIA Lab, BSU
Jonathan Strong, IDIA Lab, BSU
Jesse Allison, LSU
Keith Kothman, BSU
Jonathan Ross, BSU
Blake Boucher, BSU
Michael Davidson, MSU
Jayne Goedekke, MSU
Kyle Gomboy, Reaction Grid
Chris Hart, Reaction Grid

Special thank you to Neil Zehr, IDIA Lab, BSU

Virtual Artworks

Virtual Artworks

http://www.idialabprojects.org/displacedresonance/virtual.html

 

PROXY

John Fillwalk

with Michael Olson, Composer and IDIA Lab. 2012.

In the virtual installation, PROXY, visitors shape the construction of a sculptural and sonic response to the virtual museum. The work progresses to form, eventually transforming to become structural support for the building. When multiple users are in the environment, their avatars interact with one another to create collaborative painting and sculpture.

 

FLICKR™ GETTR v6

John Fillwalk

with Jesse Allison, Composer and IDIA Lab. 2012.

FLICKR™ GETTR v6 connects the social image web service of Flickr™ to the virtual museum environment, allowing visitors to create a dynamic cloud of spatial imagery by entering a search term of their choice, that pulls in related images from Flickr™ into the virtual environment.

 

SURVEY FOR BEIJING

John Fillwalk

with Keith Kothman, Composer and IDIA Lab. 2012.

SURVEY FOR BEIJING is an immersive landscape simulation using real time weather data from the physical location in Beijing, China. Representations of surveyor’s tape, flags, light, time of day, wind and clouds are superimposed onto the virtual landscape in accordance with real-life weather data.

 

con|FLUENCE

John Fillwalk

with Michael Olson, Composer and IDIA Lab. 2012.

Participants in con|FLUENCE create pathways based on reactions to both social and spatial relationships. There is a virtual response and persistence to interactions, as the routes are drawn and sculpted in the three-dimensional environment – forming nodes that are created via visitors’ proximity

 

Third Art and Science International Exhibition

China Science and Technology Museum in Beijing

http://www.tasie.org.cn/index.asp

 

 

TASIE Press release

http://www.tasie.org.cn/content_e.asp?id=84

 

Ball State artists create “forest” of light on display in China and Internet

Muncie, Ind. — Ball State University electronic artists have created a “forest” of light and sound that will be on exhibit in Beijing, China through November, yet also accessible to visitors from Indiana or anywhere else in the world.

That’s possible because “Displaced Resonance,” as the interactive art exhibit is known, has both real-life and virtual components.

The physical portion has been installed in a gallery of the China Science and Technology Museum in Beijing. There, in-person visitors can negotiate a thicket of 16 interactive sculptures spaced 1.5 meters apart that will change colors and emit music as they approach.

A digital replica of the layout, meanwhile, resides on the Internet, accessible through the museum’s website. Online visitors can wander the virtual exhibit using an avatar, and the digital pillars will change colors and produce sounds, just like their physical counterparts.

But that’s not all — the two pieces interact with each other, says John Fillwalk, director of Ball State’s Institute for Digital Intermedia Arts (IDIA) and Hybrid Design Technologies (HDT), which created the work in collaboration with IDIA staff, students and composer Michaal Pounds, BSU.

When an online avatar approaches a virtual pillar, the corresponding real-life column also will change colors, and vice versa. In-person and virtual visitors will produce different colors, however, allowing them to track each other through the exhibit.

“It’s what we call hybrid art,” says Fillwalk. “It’s negotiating between the physical world and the virtual. So it’s both sets of realities, and there’s a connection between the two.”

The physical pillars are two meters (or more than 6 feet, 6 inches) tall. They consist of a wooden base containing a sound system; a translucent pillar made of white corrugated plastic and computer-controlled lighting.

A thermal camera mounted on the museum’s ceiling keeps track of visitors and feeds its data to a computer program that directs the columns to change color and broadcast sounds when someone draws near.

“It’s a sensory forest that you can navigate,” Fillwalk says.

Two final touches: a video screen mounted on a museum wall overlooking the exhibit allows in-person visitors to watch avatars move around the virtual version, while Internet patrons can keeps tabs on the real-life display through a window on their computer screens.

“Displaced Resonance” is the centerpiece of Ball State’s contributions to the Beijing museum’s 3rd Art and Science International Exhibition and Symposium, a month-long celebration of technology and the arts. Ball State was invited to participate because museum curators discovered some of IDIA’s work and liked what they saw, Fillwalk said.

In addition to “Displaced Resonance,” IDIA contributed four other pieces of digital art that museum visitors can view at a kiosk.

Those pieces are:

·      “Proxy”, in which visitors create, color and sculpt with floating 3D pixels.

·      “Flickr Gettr,” in which visitors can surround themselves with photos from the Flickr web service that correspond to search terms they submit.

·      “Confluence,” in which users create virtual sculptures by moving around the screen and leaving a path in their wake.

·      “Survey for Beijing,” in which real time weather data from Beijing is dynamically visualized in a virtual environment.

 

(Note to editors: For more information, contact John Fillwalk, director of the Institute for Digital Intermedia Arts, at765-285-1045 or jfillwalk@bsu.edu; or Vic Caleca, media relations manager, at 765-285-5948, or vjcaleca@bsu.edu. For more stories, visit the Ball State University News Center at www.bsu.edu/news.

Flickr Gettr

At its essence, Flickr Gettr is a novel virtual interface bridging the virtual worlds to the wealth of shared real life imagery and information in Flickr.

Currently on Display at the New Media Consortium, amongst others: http://slurl.com/secondlife/NMC%20Campus%20West/137/100/21

USAGE

Participants query to search public image folders at Flickr web-service. Queries pulls related images from Flickr and feeds them back to be spatialized in an immersive visual and sonic environment.  As each image spawns, it generates a chime-like sound which parallels the environment of imagery that surrounds the viewer.

In Flickr Gettr II, a participant can touch any image and receive a list of the tags associated with it.  Touching the same image again initiates a random search for one of those tags thus retrieving similar imagery.

In Flickr Gettr, an external web service was used as an intermediary to query Flickr, receive images and format them for delivery as a texture.  It then passed the aspect ratios and tags in a second query to be able to map the textures properly.  To make these interactions more flexible, the intermediary web server was employed to collate and prepare information to retain states that can be queried from external applications.  The web application effectively serves as an intermediary between the virtual world and outside environments, providing the communications link and logic to assimilate the information.  This can make the creation of Web 2.0 mash-ups much simpler as the code for doing these sorts of queries and logic is already highly developed in Java, Ruby, and Perl for example.  Flickr Gettr also triggered music files upon the rapid rezzing of objects to create a cumulative ambient effect.

Traversal

Traversal for Pipe Organ is a virtual performance exploring connectivity between worlds. As the name implies, it is a temporary link between the live pipe organ in a concert hall and a multi-user virtual world. “Physical” actions and events in the virtual realm compose the work in real time with the end product being a physical and aural realization of virtual performance.
As elements of the virtual instrument were engaged, their physical interactions – touch, physics, collision events – were used to create performance gestures on the organ in Sursa Hall. John Fillwalk, who had created the performance environment and virtual instrument as well as collaboratively conceptualized the work, performed live camera for the event that followed the performance for the live audience.  Jesse Allison composed the controllable sound events, and managed the communications link between the virtual and physical during the performance.

Excerpt from the premier performance.

trans|form

trans|form

An interactive intermedia installation

Michael Pounds

John Fillwalk

Jesse Allison

 

“Trans|form” is an interactive sound sculpture consisting of five metal plates with

attached mechanical transducers that vibrate the metal according to audio signals sent

from the computer. Signals sent from the computer are resonated according to the

physical properties of the metal plates. Additionally contact microphones attached to the

plates can provide feedback to the computer, allowing the computer to gather information

about the specific resonances of each metal plate. This information can be used to further

exploit those resonances by adjusting the audio signals sent to the plates.

 

Interaction is provided through a capacitive sensing mechanism. When viewers move

their hands near the plates or touch the plates, signals are sent to the computer, allowing

the viewers to trigger sounds or modify the properties of sounds through their hand

movements.

 

Five different metal sheets/plates are used with varying physical dimensions and

thicknesses. Different transducers are attached to each plate according to its physical

properties, and each plate will resonate at different frequencies.

Institute for Digital Intermedia Arts [IDIA Lab] at Ball State University

https://idialab.org

RFID-Linked 3D Media Interface

The project allows the user to manipulate a digital world with wireless objects. Through the use of Radio Frequency Identification Devices (RFID), the virtual world can detect the presence of real-world objects and use them to manipulate its own attributes. In the case of this project, physical cubes link the user with virtual cubes within the system and allow the user to call up media such as video and sound. The system uses the software Quest 3D for real-time VR rendering and interactive animation, and Max/MSP for harvesting and inputting RFID data. Additionally, users can navigate the 3D virtual world with the use of a trackball.

Students participating in IDIA’s Immersion Seminar were named as a winner for an Award of Excellence at the International Digital Media and Arts Association (iDMAa) 2007 National Conference. The award included a $250 cash prize and was presented to only two groups out of the twelve universities participating in the conference’s student showcase. iDMAa hosted the Ideas 07: Beyond Boundaries conference in Philadelphia on November 7-11.

Links
BSU Press Release
2007 iDMAa Conference Website
iDMAa Homepage

Virtual World/Social Media Mashup: Flickr Gettr v4

IDIA Lab’s new Flickr Gettr launching soon – shared & mobile virtual world mashup artwork – preview Flickr pics here http://bit.ly/bCWQCL

Flickr Gettr: Shared and Mobile Media Mashup Artwork
Virtual World/Social Media Mashup: Flickr Gettr v4
The Institute for Digital Intermedia Arts (IDIA Lab) at Ball State University

IDIA Labs Flickr Gettr connects the social image repository of Flickr to virtual worlds and mobile devices through an interactive 3D and sonic experience – immersing the viewer in a dimensional cloud of user searched imagery and sound.

Background

Flickr Gettr in Second Life, leverages the new SL shared-media plugin architecture to provide rich spatially integrated web experiences. Participants query to search public image folders at the Flickr web-service. Queries then pull in related images from Flickr and feeds them back to be spatialized in an immersive visual and sonic environment.  As each image spawns, it generates a sound which parallels the environment of imagery that surrounds the viewer in their selected imagery and related tags that are spoken in synthesized voice.

Flickr Gettr positions virtual worlds as a platform to navigate media in the information metaverse. Virtual worlds have the potential to position the Internet as a three-dimensional information and communication platform where live data can flow in and out to visualize, contextualize, communicate, and to inspire.

In Flickr Gettr, an external web service was used as an intermediary to query Flickr, receive images and format them for delivery as a texture.  It then passed the aspect ratios and tags in a second query to be able to map the textures properly.  To make these interactions more flexible, the intermediary web server was employed to collate and prepare information to retain states that can be queried from external applications.  The web application effectively serves as an intermediary between the virtual world and outside environments, providing the communications link and logic to assimilate the information.  This can make the creation of Web 2.0 mash-ups much simpler as the code for doing these sorts of queries and logic is already highly developed in Java, Ruby, and Perl for example.  Flickr Gettr also triggered music files upon the rapid rezzing of objects to create a cumulative ambient effect.

In 2010, IDIA Lab was invited by the Indian Institute of Technology in Mumbai, India to to install Flickr Gettr at the their annual technology festival – the largest of its kind in Asia – which hosted more than 65,000 attendees.

Traversal for Boston Cyberarts

Traversal for Boston Cyberarts was a live performance and hybrid reality installation that bridged the physical and virtual worlds. It connected Faneuil Hall in Boston with a bell tower with midi controlled carillon as part of the 2009 Boston Cyberarts Festival.

Virtual participant could perform the physical bell tower via an interactive online virtual instrument built by IDIA – located in a 3D model of Faneuil Hall. Participants from all over the world could play the actual French carillon on top of Shafer Tower via their avatars. The ringing of the bells of Shafer Tower was streamed and simulcast back into Second Life, so the virtual participants can see and hear their interactions. Participants at Shafer Tower could also connect to their virtual counterparts through technology set up at the base of the tower and perform the bells locally through the same virtual interface.

IDIA collaboratively designed and built this interactive artwork for the Boston Cyberarts Festival.

 

Links

Boston Cyberarts

Boston Cyberarts Gallery

Virtual Reality Brings Interactive, Immersive Art to the 2009 Festival

AM Radio: The Red and The Wild at IDIA Labs in Second Life

AM Radio’s The Red and the Wild Opening Reception Sunday, April 26th 2009 7 pm SLT

IDIA is pleased to host artist AM Radio as the inaugural artist-in-residence at IDIA Labs – an exhibition and installation sim for virtual installation art and performance. IDIA hosts AM Radio’s The Red and the Wild as the inaugural artist-in-residence at IDIA Labs, an exhibition and installation sim for virtual art.

The Red and The Wild is an experimental shift in my work. The Red and Wild has its basis in earlier builds, notably Husk and Beneath the Tree that died. This time, a third house structure appears, based on a house which figures strongly in my childhood memories. The train that appears as a symbol in many of my works returns, but revived. A doorway represents an impossible or at least implausible path. Water towers dot the horizon, displaced in the context of an over abundance of water. A large red shape looms over the water and into or out of the house.

The title itself has its origins in a film and music artist friend from Atlanta. He had sent me a collection of music experiments of his just as I was in the midst of trying to understand why I was feeling a need to bring in abstract and maybe creepy shapes into my work. One of the tracks sampled some audio from the movie Breakfast at Tiffany’s. The audio lead me to watch the film again and read Capote’s Novella. In the story, the main character Holly invents a world around her in reaction to her anxieties and fears which she describes as the “mean reds.” Holly says, “But you can’t give your heart to a wild thing: the more you do, the stronger they get. Until they’re strong enough to run into the woods. Or fly into a tree. Then the sky. That’s how you’ll end up, Mr. Bell. If you let yourself love a wild thing. You’ll just end up looking at the sky ”

-AM Radio

THE INSTITUTE FOR DIGITAL INTERMEDIA ARTS is a hybrid art and design studio established as part of the Center for Media Design at Ball State University and funded the Lilly Endowment, Inc. The institute’s interdisciplinary studio collaborative explores the intersections between arts and technology – employing virtual reality, visualization, simulation and human computer interface.

Slurl: http://slurl.com/secondlife/IDIA%20Laboratories/15/134/21

Links:

SL Things To Do

DIP’s Dispatches from the Imagination Age