Gravity Sketch is a tool for sketching in 3D in VR or on an iPad. It allows for real-time collaboration in VR and can import and export the most common 3D formats.
COST: Free
Gravity Sketch
Isadora
Isadora is a node-based visual programming language available on Windows and MacOS. It is similar to other node-based programs such as Touchdesigner but is primarily geared towards live performance playback and has a built-in scene functionality.
Isadora is able to take in a variety of data and input types that can be used to drive live generative visuals. Visuals are created using networks of nodes which Isadora refers to as “actors”.
Has a few more limitations (such as the number of camera inputs and projector outputs) than Touchdesigner but is still extremely powerful.
COST:
-
$732 perpetua license
-
$13 / week rental
-
Monthly & yearly subscriptions also available
OBS
The Open Broadcast Software Project or OBS is a free and open-source software that is used for video recording and live streaming. Since it is open source, there are a lot of available plugins to extend functionality and there is a very active modding community. Originally only available via a plugin, OBS now has integrated Virtual Camera functionality. This allows you to take your OBS composition and turn it into a camera feed that can be used anywhere where a regular camera input would be taken (Zoom etc). This function opens up a wide range of streaming and remote working possibilities without requiring expensive software or hardware. OBS has a highly customizable interface but because of this can seem a little intimidating to new users.
Chroma keying can be done directly in OBS and can be pretty clean when paired with quality lighting. The combination of OBS, chroma-keying, and vdo.ninja can be quite powerful for long-distance collaboration where the desired outcome is for multiple feeds to exist in the same virtual space.
OBS has plugins that add functionality for NDI and Spout
COST: Free
Projects that used OBS:
TouchDesigner
TouchDesigner is a node-based visual programming language available for Windows and macOS. It creates real-time interactive content and can be used in performance, installations and to create other pieces of media. TouchDesigner really shines when paired with some form of real-time data that can be used to drive visuals and it is capable of rendering in both 2D and 3D. As a creative coding tool, TouchDesigner has almost infinite possibilities and the cap of what can be programmed is usually based on what hardware is running it and the skill of the programmer.
TouchDesigner is able to take input from almost any digital source and can output to pretty much anything that can be controlled digitally. This makes it an excellent choice when working with any form of sensor.
TouchDesigner can stream to any RTMP destination which allows to it connect to services such as Vimeo, Twitch, or Youtube Live
Using nodes, which in TouchDesigner are referred to as ‘operators’, users are able to create complex networks which generate or manipulate content. What makes it so flexible and open however is also what can make it difficult for new users. Without some instruction or the time to explore users can get lost in the myriad of possible nodes and unlike Isadora, TouchDesigner has no built-in cueing system.
There are several nodes that come with specific hardware recommendations, if you run into trouble it’s always worth checking the wiki
COST:
-
Free for Non-Commercial license
-
Educational license: $300USD
-
Commercial license: $600USD
-
Pro license: $2200 USD
Projects that used TouchDesigner:
Twine
Twine is an open-source visual coding platform for creating interactive stories online. At its most basic it serves as a way to craft a story that requires user interactivity to experience. You don’t need to have coding experience to create stories in Twine but the possibilities open up with some knowledge of HTML, CSS, and Javascript.
Twine is a great option for prototyping branching narrative and nonlinear storytelling as well as experimenting with interactive user experiences. The level of interactivity ranges from simply clicking to trigger the next portion of the story – similar to flipping the page of a book, to something more akin to “choose your own adventure” novels or text-based video games.
COST: Free
VDO.ninja
VDO.ninja (formally OBS.ninja) is a utility for transporting video feeds from a smartphone, tablet, or remote computer into programs like OBS Studio or any other browser-enabled software. It offers high-quality, low-latency video feeds and supports virtual backgrounds, basic avatars, and screen/media file sharing.
An excellent option for creating video work with remote collaborators or event streaming as it works pretty seamlessly with OBS.
It needs to have one person in charge of the room (the director). The director of the room has control over who can see each other, can see the audio and video settings of each participant, and can create scenes with specific users in them. Video or Scene feeds can then be pulled directly into OBS or any other program that allows for browser feeds.
VDO.ninja is great for bringing guests into a stream in part because the user experience is fairly simple and web-based.
COST: Free
