LINE PLAYERS AR FILTER 2022
CLIENT:META OPEN ARTS POSITION:AR DESIGNER
TOOLS: SPARK AR, ADOBE ILLUSTRATOR AND BLENDER
Line Players is an AR collective game experience for Instagram Reels based on retro game references and futuristic XR glasses design. It was created in collaboration with Meta Open Arts. The effect interprets the design identity and key visual assets for a Meta international event in Palo Alto, California, in September 2022. The project included physical activation stations with backdrops and QR codes during a private event in Palo Alto, California.
Click here to open and try the effect on Instagram.
![]()
![]()
CLIENT:META OPEN ARTS POSITION:AR DESIGNER
TOOLS: SPARK AR, ADOBE ILLUSTRATOR AND BLENDER
Line Players is an AR collective game experience for Instagram Reels based on retro game references and futuristic XR glasses design. It was created in collaboration with Meta Open Arts. The effect interprets the design identity and key visual assets for a Meta international event in Palo Alto, California, in September 2022. The project included physical activation stations with backdrops and QR codes during a private event in Palo Alto, California.
Click here to open and try the effect on Instagram.
CREATION PROCESS
MOURNING STAGE VISUAL EFFECTS(VFX) 2022
CLIENT:CARLOS MOTTA AND SIMON(E) JAIKIRIUMA PAETAU
POSITION:VFX DESIGNER AND ANIMATOR
TOOLS:ADOBE AFTER EFFECTS, PREMIERE AND PHOTOSHOP
Mourning Stage is a film that uses a series of drawings as a performance score. I worked on creating visual effects using face-tracking technology to animate 2D masks created by the artist Carlos Motta and move in sync with Simon(e)’s Paetau performance.
These images depict different renditions of the devil in hell. Among this group of demons, there are feminized characters that suggest sexual perversions as typified by the Catholic imagination. In the film, Simon(e) Paetau interprets and responds to the drawings using her body and facial expressions in a ritualistic performance, where the body, fetishized and colonized by morality, is mourned.
![]()
![Installation views at Wexner Center for the Arts, Columbus, 2022]()
Installation views at Wexner Center for the Arts, Columbus, 2022
![]()
![]()
![]()
![]()
![]()
![]()
CLIENT:CARLOS MOTTA AND SIMON(E) JAIKIRIUMA PAETAU
POSITION:VFX DESIGNER AND ANIMATOR
TOOLS:ADOBE AFTER EFFECTS, PREMIERE AND PHOTOSHOP
Mourning Stage is a film that uses a series of drawings as a performance score. I worked on creating visual effects using face-tracking technology to animate 2D masks created by the artist Carlos Motta and move in sync with Simon(e)’s Paetau performance.
These images depict different renditions of the devil in hell. Among this group of demons, there are feminized characters that suggest sexual perversions as typified by the Catholic imagination. In the film, Simon(e) Paetau interprets and responds to the drawings using her body and facial expressions in a ritualistic performance, where the body, fetishized and colonized by morality, is mourned.
Installation views at Wexner Center for the Arts, Columbus, 2022
CREDITS
A video by Simon(e) Jaikiriuma Paetau and Carlos Motta
Performed by Simon(e) Jaikiriuma Paetau
Director of Photography
Lola Gómez Castello
Soundtrack
Isabel González Toro
Soundtrack Assistant
José Marulanda
Visual Design (VFX)
Fernando Gregório
Second Camera
Carlos Andrés López
Makeup
María Fernanda Cepeda
Titles
Lauryn Siegel
Colorists
Aleksander Bergan
Martin Backhaus
Sound Mix
Ian Turner
A video by Simon(e) Jaikiriuma Paetau and Carlos Motta
Performed by Simon(e) Jaikiriuma Paetau
Director of Photography
Lola Gómez Castello
Soundtrack
Isabel González Toro
Soundtrack Assistant
José Marulanda
Visual Design (VFX)
Fernando Gregório
Second Camera
Carlos Andrés López
Makeup
María Fernanda Cepeda
Titles
Lauryn Siegel
Colorists
Aleksander Bergan
Martin Backhaus
Sound Mix
Ian Turner
Lighting Assistant
Luis Hernando Cubillos
Sound
Jesús Guevara
Photography
Camilo Delgado
Field Producer
Juan David Correal
Production Director
Paola Andrea Pérez Nieto
Production Coordinator
Catalina Patarroyo Velásquez
Production
Oficina Inercia Películas
Natalia Ordoñez García
Camilo Cárdenas Suárez
Alejandra Gómez Osorio
Sara Loboa
Elizabeth Hernández
Location
Espacio Odeón, Bogotá
Co-produced by the Wexner Center for the Arts, Columbus and Goethe Institute, Bogotá with support from XI Berlin Biennale
Special thanks to Alejandra Sarria, Espacio Odeón, Bogotá
Luis Hernando Cubillos
Sound
Jesús Guevara
Photography
Camilo Delgado
Field Producer
Juan David Correal
Production Director
Paola Andrea Pérez Nieto
Production Coordinator
Catalina Patarroyo Velásquez
Production
Oficina Inercia Películas
Natalia Ordoñez García
Camilo Cárdenas Suárez
Alejandra Gómez Osorio
Sara Loboa
Elizabeth Hernández
Location
Espacio Odeón, Bogotá
Co-produced by the Wexner Center for the Arts, Columbus and Goethe Institute, Bogotá with support from XI Berlin Biennale
Special thanks to Alejandra Sarria, Espacio Odeón, Bogotá
AUGMENTEND PERFORMANCE STUDIO AR WORKSHOP 2022
CLIENT: SCHOOL OF THE ART INSTITUTE OF CHICAGO POSITION: AR EDUCATOR
TOOLS: SPARK AR, ZOOM, PERFORMANCE
Augmented Performance Studio is a 4 hours workshop created when I had the honor of being a guest artist at the School of the Art Institute of Chicago. The experience was tailored for the Mixed Reality Performance class, taught by Mark Jeffrey and Judd Morrissey. The workshop offered an opportunity for students to explore the intersection of AR and performance, using Spark AR, hand-tracking techniques and performance dynamics.
CLIENT: SCHOOL OF THE ART INSTITUTE OF CHICAGO POSITION: AR EDUCATOR
TOOLS: SPARK AR, ZOOM, PERFORMANCE
Augmented Performance Studio is a 4 hours workshop created when I had the honor of being a guest artist at the School of the Art Institute of Chicago. The experience was tailored for the Mixed Reality Performance class, taught by Mark Jeffrey and Judd Morrissey. The workshop offered an opportunity for students to explore the intersection of AR and performance, using Spark AR, hand-tracking techniques and performance dynamics.
The workshop was taught via Zoom with the assistance of in person professors and graduate assistants
TOPICS COVERED
During the workshop, we explored various topics related to augmented reality, such as:
- Introduction to Augmented Reality (AR)
-
History of AR
-
Introduction to AI, Deep Learning, and Computer vision
-
Current State of AR and Future Possibilities
-
Presentation of my past works in the field
-
Conceptual and Poetic Approaches to Augmentation and Algorithms
-
Body Warm-up Focusing on Hands
-
Hands-on Spark AR Workshop with Hand Tracking Techniques
- Student’s results presentation for Feedback
Some of the XR performance prototypes created by the students during the workshop
PREPARATION AND TOOLS
To fully immerse themselves in the workshop experience, students were asked to think about something intangible or virtual, such as a memory, a dream, or a future projection, and represent it as a word or simple drawing. They brought this 2D asset to the workshop in either PNG, JPEG, or SVG format. Students were also asked to download, install, and log in to Spark AR Studio, as well as have Instagram or Spark AR Player on their cellphones for testing and experimentation.
PREVIOUS WORKSHOPS AND CLASSES
In addition to this workshop, I have had the pleasure of teaching other classes related to AR:
2021 - Augmented Reality and Performance Studio (2h Workshop) at Interactive Telecommunications Summer Camp, Tisch, NYU
2021 - Augmented Reality and Performance Studio (2h Workshop) at Brooklyn College
2021 - Big Ideas in the Past and Future of Technology (Graduate Assistant) for Nancy Hachinger, Interactive Media Arts BFA program at Tisch, NYU
RAMENHEAD AR FILTER 2022
CLIENT: BIEN INCLUSIVE MOTION DESIGN STUDIO
POSITION:AR DESIGNER
TOOLS:META SPARK STUDIO AND BLENDER
Ramenhead is an AR world effect created together with Bien, an inclusive motion design studio based in Los Angeles, California. The project simulates a snow globe and was part of an XR Holiday card for one of their clients to use in an internal campaign.
In the AR audiovisual experience, you can "open" and "close" the ramen shop by tapping the 3D model.
The animation was inspired by Japanese folk toys called Kyodo gangu and German cuckoo clocks.
Click here to try the filter on your Instagram.
THE FIREBIRD XR SCULPTURE 2021
CLIENT:PROTOTYPE POSITION:CREATOR AND DIRECTOR
TOOLS:BLENDER, SPARK AR, LENS STUDIO, ILLUSTRATOR, PERFORMANCE
The Firebird is a mixed reality live performance. It tells a more-than-human myth about extinction, migration, and dreams in the context of an environmental emergency. The audience experiences this through choreography, relational physical sculptures and AR layers.
The project is currently in its prototype and research phase, reflecting significant potential for further development. I’m seeking additional support to fully realize its vision. Any form of support will be greatly appreciated.
The eyes of the Firebird. Choreographic experiment with AR layer visualized through an AR app
Choreographic experiment without AR layers visualized through an AR app
CLIENT:PROTOTYPE POSITION:CREATOR AND DIRECTOR
TOOLS:BLENDER, SPARK AR, LENS STUDIO, ILLUSTRATOR, PERFORMANCE
The Firebird is a mixed reality live performance. It tells a more-than-human myth about extinction, migration, and dreams in the context of an environmental emergency. The audience experiences this through choreography, relational physical sculptures and AR layers.
The project is currently in its prototype and research phase, reflecting significant potential for further development. I’m seeking additional support to fully realize its vision. Any form of support will be greatly appreciated.
The eyes of the Firebird. Choreographic experiment with AR layer visualized through an AR app
Choreographic experiment without AR layers visualized through an AR app
HOW IT WORKS
As part of performance-installation, the audience dynamically interacts with AR layers, moving in sync with the performance. The piece features unique target trackers, each borne by a different performer. These trackers trigger distinct audiovisual AR sculptures that represent various parts of an unseen critter: the left eye, the right eye, wings, the fire seed technology in the Firebird’s belly, and the tail.
The audience can see the AR layers of the moving sculpture through AR glasses or cellphones and Ipads
Audiences can activate these trackers via an app on their cellphone or an AR headset, enhancing their involvement in the collective choreography and their connection to the mixed reality sculptures.
THE MYTH
A fire catastrophe destroys The Firebird community, forcing the sole survivor to migrate to the last safe place: A-city, where no one is allowed to sleep anymore. Now, they need to find a way of ensuring that their dream-tree technology won't go extinct.
Earlier experiments with audience interaction
SUPPORT
The journey to the prototype stage of "The Firebird" has been supported by several entities:
- NYU Tisch School of the Arts Graduate Research Fellowship, 2021-22
- Summer Round of Sundance Interdisciplinary Program (IDP) granting, 2021
- 2 weeks residency at The Brooklyn College Performing Arts Center in partnership with The Public Theater supported by the Tow Foundation, Brooklyn, New York, 2021
- New York Foundation for the Ars - City Artist Corps Grants, 2021
Visual Identity by Dawn Sinkowski
CREDITS
Conception, Direction and technology: Fernando Gregório
Production, Strategic development and Visual Identity: Dawn Sinkowski
Assistance: Joyce Lai
Performance: Joyce Lai and Hunter Bryant
Sound: Cy X
Wearable design (phase 1): Wei Kang
Interpreter-creators for (phase 1): Viola Leqi He, Chaski No and Sol Cabrini (solychaski)