Shooting to accommodate user driven & distributed narratives

How do you have to organize and design your shooting to accommodate user driven narrative or distributed narrative?

I think the main thing to consider is to create common start and end points, when possible, for all clips, or groups of related clips. We used this strategy in our “Watching” piece, and I also did the same in my “Cat’s Cradle” clips, which were shot to appear seamless when distributed via a random load MaxMSP patch.

It worked beautifully. Of course this is only possible when you are shooting something that is repeatable, or that you are in control of. In a live, unfolding documentary “event” this may not be an option.

The reason this works is that with a common, or similar, beginning and ending to each clip, they can load in any order and appear seamless for the most part, if this is your intention. Even if the content varies, having the same location and framing also creates continuity. This applies to either distributed or user driven clips, such as Microsoft’s “Ms. Dewey” browser interface, represented by a woman as the browser.

Although a bit dated in feel, fading to white or black at the start or end of each shot creates the same opportunity, though not seamlessly.

Another useful technique for “burying cuts” is to edit on movement. Janis taught me this when we collaborated on an experimental film last semester. Not only does this make the the movement flow from one shot into the next, but it hides or distracts from any abrupt or awkward edits.

 

Data Commons: Urban Sensing, Privacy & Responsibility

Can a data commons, as envisioned in the article by Dana Cuff and Jerry Kang, provide widely divergent and useful data while protecting privacy? I think that the article leaves me wondering what kinds of uses are envisioned for projects like this that could not exist online or in other forms of media. Is making the invisible visible something that will benefit society as a whole, or the largely the rich and powerful, as most social changes have done for some time now.

I can’t help thinking that just because we CAN do something doesn’t mean we SHOULD do it.

What real and unique benefits could urban sensing provide equally to all citizens than cannot be achieved in other, potentially less invasive ways? Does agreeing to share personal information constitute a benefit to the individual providing it, or only to those who have the technology, training and equipment to make viable use of it? Does this type of information gathering that starts voluntarily become something that is required of all of us down the road? Who gets to make money from it? Is money earned put back into community development, or does it line the pockets of those in control?

Who is responsible for logging, categorizing and authenticating the data, and more importantly, how do we ensure that everyone has equal access to it, and that privacy will be maintained? These are all big questions, currently without any clear answers.

 

Wii Remotes: Making New Media Work

I have posted 3 videos, see 1 , 2 and 3 in which people are using the Wii remote control and MaxMSP as a combined interface to interact with music, screen images and projections. I don’t know what’s involved in the programming for this, but it seems to offers more physical freedom than a keyboard or a sensor does. (search for MaxMSP and Wii remote on YouTube to see more examples.)

Is this technology more complicated that what we’re already grappling with (those of us non-programmers)? Is it worth learning? Comments?

 

How Social Media changed my shared images: context of presentation space

I am attempting to understand what more I can learn about how social media has affected the images I posted on flickr and facebook.

The main thing I’ve noticed is that I can see how many views they’ve had, and how few comments in comparison. I have also noticed that the images viewed are the 10, in two batches of 5, that appear as thumbnails on my blog. No one has gone on to look at images further into my photostream

While I’m pleased to see that people have looked at some of what I’ve posted, I’m not sure how to interpret the lack of comments. On the other hand, I often do the same thing – look at images people have posted without commenting. I guess this is because there is just so much to look at, and you can’t comment on all of it unless you have no other real life. I find that I only comment on things that affect me really strongly. A lot of what gets posted is social, so it doesn’t really affect me enough to comment.

That is why I posted some of my personal work, thinking it would generate more comments that party images. Not necessarily.

The other thing that is changed by social media is the way images and videos circulate. Things get forwarded, favourited, and passed around in a way that would only happen at a party otherwise. In fact, it’s not at all like a party, because that would generally be a finite number of people, over a limited duration, and with some kind of common connection and physical presence.

Flickr and facebook allow everything to be endlessly distributed via links well beyond your own social network. The good thing about this is that it can provide a much bigger audience for your work. The bad thing is that it can eliminate your creative attribution in the process. If authorship isn’t important to the work, that’s fine, but when it comes to art, it’s more difficult for me to accept. It also facilitates people re-using or re-working your images in whatever way they like. From a collaborative viewpoint you could see this as positive, but personally, I don’t like the idea much. Of course this is true of any internet-based image, whether in social media or otherwise.

One other thing I dislike about flickr is that while I can group work into different albums, which I have done, I cannot control the sequence that they appear in, including what appears next to each other. This is very frustrating! Context and relationships between images are important, and flikr destroys that. Perhaps there is a work-around to this, but I haven’t discovered it yet.

 

Reflections on “Watching”

I have to start by saying that this course has provided the most meaningful and thought-provoking critiques of any class so far at Ryerson, and wins hands-down for Production Course of the year. Both Alex and Steve are insightful about questioning how we approach our work, and the work of others in New Media, and at suggesting alternative approaches along with rationales for them. The level of discussion, feedback and real, applicable suggestions throughout 18 crits has been just amazing. Thanks to both of you for cracking New Media practice and thinking wide open for us! A special thanks to Steve for helping us with arduino, max patching, coding and sensors, all new territory for everyone in our group.

Project Summary

Our project was based on ideas about watching, including notions of both surveillance and voyeurism. Originally we saw this as a rather playful piece that had seriously “spooky” undertones. These undertones were derived from the widespread prevalence and public acceptance of surveillance cameras, the massive amount of online erotica, and the largely invisible co-opted ownership and mining of personal information and content underpinning the explosive growth of social media. Questions about who is watching who and for what purpose have never been so relevant.

We set up 3 cameras to record a performance in a washroom stall, as though the subject was unaware that he was being watched. We were alluding to the pornographic, which was part of our original intention, but we decided to play this down by displaying hot “boarding boys” instead of overt porn. Our intention was to subvert the watching process, by turning the watcher into the watched by turning their own gaze on themselves.

For a more detailed description of the project, please visit this link on my blog.

How did the outcome differ from or correspond to your expectations?

The project turned out to be extremely close to our original conception and intentions. However, there were a few problems we hadn’t foreseen. These included the surprising amount of time, effort and and coding needed to construct and implement what seemed like it would be a fairly simple idea; the apparent lack of clarity in the installation in regards to how people should interact with the work; and the entirely unexpected perception that the projected image of the peephole could be perceived as the toilet, seen from above.

In addition, the sensor, operating via an Arduino, a breadboard and MaxMSP, did not trigger the image swap between the intended still image and the live video feed. In the end this didn’t really matter, because the image from the live feed when no one was interacting with it appeared to be a still image anyways.

Why did the outcome differ or correspond to your objectives?

Part of the difference between the group’s original objectives and the end result, for me, was that my ideas and concerns related to this topic evolved over the 2 weeks we had to work on it. The more I read, the more concerned I became about “privacy” and ownership issues inherent in the use of the internet and social media like facebook. I also researched artists who are using surveillance cameras to reclaim ownership of imagery recorded by pervasive public security cameras.

These ideas didn’t become part of the conceptual development of the piece. By the time the group began to discuss them it was the day before the presentation, so there was not enough time to consider how they might be better reflected in the piece itself. Once we agreed on the original idea, the group’s focus turned toward producing the physical and technological realization of the individual components, rather than further developing its conceptual sophistication.

This was also part of the dynamic in working collaboratively within a group. We divided the physical work once the video was shot, and did not re-focus on evolving or fine-tuning the initial concept. Everyone was taking care of particular aspects of the project, which we brought together in the very last day. In future, I think an ongoing discussion about the concept’s development or evolution should be part of the process, even if only to affirm that there is nothing that needs to be discussed or changed.

In the end though, the piece functioned very much as we originally intended.

The issues around how to interact within the physical space couldn’t be clearly imagined until we had actually set everything up. (Like Marie puts her finger in the peep-hole to see how it looks – nice!) Since we set up the installation in its entirety for the first time less than an hour before the presentation, we had no opportunity to test the presentation with an audience beforehand. I can see that this is critical, and that you can’t assume people will just “get it” the same way that you do. As Steve pointed out, this needs to be done repeatedly, and small changes that may not even appear noticeable in the entire presentation may really improve the final experience of the work.

There was no way that I could have anticipated that the peep-hole might look like a toilet to someone else. However, this observation did provide a valuable warning that people may not see the same things that you do.

What would I do differently?

1. Continue to discuss and clarify the concept as it relates to the presentation while work proceeds on the physical and digital pieces. The concept should drive both the content and presentation methods, not the reverse.

2. Set up and test how the piece works with an uninitiated audience, more than once, if possible. Watch how people use or interact with the space, get responses, and answer and ask questions. Pay attention to scale, layout, navigation and don’t assume anything.

The idea that the peep-hole projected on the wall resembled the toilet bowl hole as seen from above never occurred to us. Just goes to show you don’t know how people will connect things.

3. Make what’s in the peep-hole totally engaging!

The magazine was OK, but this could have been a much bigger pay-off that reinforced the concept in a more meaningful way.

The box could have been bigger, and could have had 2 (or even 3) peepholes, top, side (and bottom?) to echo the 3 camera views in the washroom. The interior could have been divided to provide multiple viewing experiences related to surveillance, voyeurism and use of personal information/content. These could be displayed as porn viewed on a monitor, as a live surveillance camera feed from the washroom, and as a composite of Hollywood or TV clips about “spying” projected within the box. (Jimmy Stewart in Hitchcock’s “Rear Window” comes to mind.) Another option might be showing the YouTube video about Facebook’s perpetual rights to whatever you post there. (see my earlier post on our project for further discussion on this subject).

This is a recent take on things. We certainly didn’t have time to produce 2 or 3 additional works for inside the box. I’m also not sure that the rest of the group would agree with these ideas, so let’s just leave it at a single engaging and more conceptually relevant viewing experience inside the peep-hole.

4. Collaborations can be difficult and complex. Allowing everyone to feel equally invested and represented in the project is a delicate process. Balancing ideas, egos, schedules and workload is no small task. I might try to put more effort into determining what others wanted to do and get out of working on the project and try to articulate that into the common goal.

What did I learn from this process?

1. The importance of the need for clarity around the method of physically engaging with the work.

2. The effort involved in the entire new media process makes considering a more thought-provoking or emotionally engaging experience worthwhile. Once you get people to peep into the box, what is there to further their understanding, broaden their knowlege, raise questions, or engage/entertain them?

Getting the mechanics of everything built, edited and functioning took more time and energy than we put into fine-tuning what should be in the box. We should have resolved all of the content towards the goal of clarifying an idea more than worrying about physically mastering the construction of the hardware, software, video and sound components. However, time was short, and once we agreed on the idea we just forged ahead to get it built. In my opinion, this was our biggest failing, but it is also the easiest thing to remedy.

Strengthening the message that our online viewing and social media habits are supplying content, personal information and preferences that are collected, logged, mined and used to target us for other purposes could make the piece more powerful and engaging. Our predisposition towards “watching” is enabling us to be watched.

3. Just how much time and effort is involved in coding, testing and creating what originally seemed like a simple piece.

4. The need to consider more carefully how people navigate the physical space, and the placement of elements within it, to creative a more cohesive experience. This includes thinking about angles, positions, scale and the physical separation between the elements.

Steve’s comment on how positioning the peep-hole on the top of the box and looking down into it would more closely echo the view of a surveillance camera, as would black and white video footage, is an example of this. However, we were not trying to re-create a surveillance camera’s imagery.

5. Taking the time to set things up and observe how people interact, move and respond needs to be part of the cycling developmental process. It is an essential component of developing the work, and should not be left until the last minute.

6. Just because it’s clear in your own mind what you want people to do in the space doesn’t mean it will be obvious to them.

For example, colour-coding the peephole box to the distinctive colour being projected behind it might have made it more obvious that the box and the projection were connected to each other, and should be investigated as such.

7. While it was not our intent to make the clips look like traditional surveillance footage, the discussion about the difference between voyeurism and surveillance arose. I’m not certain that the piece needs to answer this question to be effective, but in a piece with multiple interior views, as I speculated on above, this could be addressed.

To respond to further to this question, I believe that the difference between the two is based on intent. Voyeurism implies (a possibly guilty) pleasure, whether sexually derived or otherwise. Surveillance is more about security and safety, rather than pleasure for its own sake. The former is driven by gratifying interior motives within the watcher’s psyche. While the need for security is also derived from interior needs for a sense of safety and control, its focus is on exterior elements, such as property or physical boundaries, rather than the interior, personal domain of fantasy or pleasure.

8. Max patch? Arduino? Breadboard? Resistors? Circuits? Random Narrative? Sensors?
These words don’t scare me anymore!

How does new media affect or not affect my practice?

New media will certainly affect my practice, though I’m not yet sure to what extent. I did projections on multiple layers of sheer fabric and multi-dimensional installations in galleries when I graduated from OCAD in 1982, but the only electrical devices involved then were a slide projector and a small fan.

The use of new media tools in installation-based work seems inevitable. These are useful tools whose potential and possibilities are part of the contemporary art-making landscape. Since my work has often been based on evoking the intangible, new media technologies may be very helpful creating environments that can help to do just this.

 

New Media Project: “Watching”

We have created a new media project that plays with the concept of surveillance in a performative and interactive manner. We used three cameras to capture multiple perspectives of a live performance. This documented performance positions the subject as unaware of the multiple cameras stalking him, in what is usually a private place.

With the rapid adoption of web services, cell phones, GPS systems and social media today, the ever-watching eye of Big Brother has never been more easily and closely trained on our every move and preference. Less and less remains within the strictly private realm, particularly for those using the web and social media today.

Several artists and musicians, most notably in Britain, the most surveilled country in the world today, are using surveillance camera footage in innovative ways to reclaim public spaces and cameras for private use. (see my earlier post for more details).

Also see surveillance-footage-gets-a-starring-role.

While our piece does not use public surveillance techniques, we hope that it will be an entertaining and necessarily participatory, embodied experience which will raise questions about who is watching who, and to what end. While voyeurism may entice us by carrying the allure of pleasure and the forbidden, how do we feel when we become the unwitting subjects of a hidden camera? And, once captured and recorded, who has ownership and access to these images, and for what purposes?

In addition to the generally widespread use and acceptance of surveillance-as-security, personal information and content is also being collected, mined and usurped for profit in surprising ways. A striking example of this use of your personal information can be found in this video about what you are agreeing to when you sign up for a facebook account today:

For me, this represents a bigger issue than just who is watching who, and gathering what information. The far-reaching extent of the uses for these documents and data may not really be understood for years to come.

Our piece uses video clips from the original performance, played back in random sequence through a MaxMSP patch. Amongst the random clips is one longer, edited, narrative clip. The clips will be screened on a wall via a media projector.

An extreme angle of the projection creates deliberate keystoning of the projection, which adds to the disorienting feeling already created in the performance and the playback themselves.

On a table next to the projection is a 20″ x 20″ black box with a small, crude hole on the front panel. A sensor, controlled by an Arduino in conjunction with a breadboard and MAXMSP, turns on 2 tiny lights inside the peep-hole box and triggers a live-feed from a small video camera, also hidden inside the box, when the light in front of the peep-hole is blocked. One light inside the box displays the magazine used in the performance. A second light and a small, hidden video camera inside the box are activated by the sensor when someone blocks the light by putting their eye to the peephole. The second light illuminates the viewer’s peeping eye while the camera provides a live feed onto the wall behind the person peeping via a second AV projector. The camera shows the viewer’s own eye peering at themselves from behind. The viewer can never catch their own eye watching themselves. When the sensor is not activated, a still image is displayed.

The idea is to play with variations on notions of watching. As the viewer watches the performance playback they will be enticed to peep into the box that sets off the sensor and records them looking. The projection behind the person peeping into the box creates the situation where the eye is now watching the watcher. In fact, it is their own eye, watching themselves unaware of being watched.

Here is the sketch of our project proposal:

To me this represents how delightedly we look at our own and other people’s posted information and creative content online, largely unaware of the larger mechanics that are tracking us, while snatching the rights to any content we create and upload, in perpetuity, even after we may have removed it from the web.

In the process of developing our ideas for this project we thought that it would be nice to use the emails we generated about this project as the source for creating audio files, as music or tones (not voice) to accompany the visuals. We also recorded ambient crowd and skateboarding sounds, since it is a skateboarding magazine used in the clips.

Converting text to non-voice audio proved to be a much bigger challenge, one that I was unable to solve in the short time available. However, in trying to research how to do this, I was directed to Soundhack software, which after much reading, testing and fiddling, allowed me to create sound files directly from the visual signals of video files. The resulting sounds, after some tweaking, are quite surreal and strange, and even border on sounding like running water, birds and insects at times. Also airplanes, vacuum cleaners and UFOs. I love the fact that the audio is derived and mutated from the video clips being projected, and that they add another disturbing, abstract and disorienting layer to the entire piece.

My technological goals for this project were to learn the necessary programming skills to apply the arduino and sensor technologies to turn a live feed camera projection and a light on and off, by applying these to a fairly simple project, which could then be further developed for my thesis installation.

 

Struggling to Convert Text to Music

I am struggling to figure out how to convert a text file to audio, but so it sounds like “music”, not spoken word, for our new media project.

After going through a somewhat complicated process, that did turn text to voice as an aiff file, it ended up producing the exact same result as using the “speakable text” application built into the Mac OS.

I then downloaded Soundhack, and waded through about 20 pages of the manual to try to figure out how to make a further conversion. I took the aiff audio file, as created above, which plays in iTunes, and converted the header, as the Soundhack manual says you need to do, but it still says there is no header and cannot play the file.

Emailing Soundhack for help, it turned out that a simple “save a copy” process made it work. I was so excited to hear what it might sound like as I pressed PLAY! Well, it does sound different than in iTunes, which still sounds like a voice speaking the text, but sadly, it sounds like speeded-up chipmunk talk.

Maybe trying some other voice options in the initial step, or some FX in soundforge in the lab on Mon. would help. It sounded like such a great and straightforward idea – sigh.

The next thing to try came from the Soundhack manual, and may provide another option for generating audio directly from our digital material. I don’t want to spoil the surprise if it works, but will post an update once I give it a shot.

Almost starting to feel like a techie!
Now THAT is strange.

This experience confirms Steve’s warning that there are many things that can go wrong at any stage of the game. It seems that the shortest distance between a newmedia idea and its successful execution is never a straight line.

 

The Aloneness of Social Media

While it can be delightful to dabble in the communal and social aspects of new media, it’s an odd contradiction that one is almost always alone while doing so. Some aspects, like facebook, which I joined last night, are actually quite fun. I have been sent 2 videos, a virtual marguerita, an invitation to a play, a bar-b-q and a party, all in my first day. Yet here I am, alone in the dark, typing in front of a glowing screen.

 

“Video Sniffing”: British Artists using CCTV (security cameras) to make ART

Following a link on Heather’s blog to the University of Openess, I came across an interesting article on how artists in Britain, the most surveilled country in the world, are performing for and capturing images from security cameras, then using the footage to make their own movies.

“Video sniffers” intercept wireless camera signals using basic electronic receivers, similar to a device used to pick up television signals. This, connected to a camcorder, allows the sniffer to view images from nearby closed circuit television (CCTV) cameras.

A wonderful way to get something back, and some kind of control, over security cameras!

 

Personal vs. Collective Memory, Narrative and Power

I have been doing quite a bit of reading and thinking about how technology has changed the nature of personal memory, and created a new type of collective memory that lies beyond direct, first-hand experience.

While personal photographs and videos have in many ways come to be the shorthand for, or even the editor of, our personal histories and memories, broadcast media has allowed distant events to become part of our memories and histories in a way that wasn’t possible until recently.

We can all remember personal experiences of, and reactions to, traumatic world events that have become part of our own memories, no matter how physically separated we were from them at the time. Being able to witness these events in real time, and to watch them replayed at will, or against our will but hammered at us by traditional media sources, has caused our visceral responses to disembodied experiences to become a secondary type of embodied memory.

Compassion fatigue cannot withstand every shocking image or event. The question of what gets recorded, disseminated, and therefore collectively remembered, is largely invisible to us, even though we know that there are systems of wealth and power that make these decisions.

In many ways, new media is returning us to the ancient tradition of oral narrative without the necessity of verbal or face-to-face transmission. The most significant means of transmitting culture and history before print was oral transmission, which like new media, is variable, interactive and individualized by the process and performative aspects of speaking.

New technologies and media are restoring the power of the individual over what information gets disseminated, in real time, to whom, and in what form. Not only can anyone with access to the technology contribute, but the personal and performative aspects of narration and information are returning to the individual. Youtube is a lot more interesting to me than most of what’s on tv.

It’s a little scary to think how easy it would be for someone to “pull the plug”.

And thinking about power, it’s also scary to think how much we rely on energy for all of this, and what the political and environmental implications of this growing dependency are. Discussions in the arena of new media don’t seem to include the consideration of things like the half-life of nuclear waste.

So there’s power, and then there’s power to consider.