FERNANDO GREGÓRIO


I’m an augmented and mixed reality (AR/XR) creator and educator based in Brooklyn, NY.
I have a graduate degree from NYU’s Interactive Telecommunications Program (ITP) and more than ten years of experience working in creating experimental storytelling through video and new media art. Contact me for more information or work requests.


AR/XR
Designer and Director








DETAILED PROJECTS


IGNOTO VIBRATIONS   XR SCULPTURE   2022   
CLIENT:RIO ART MUSEUM (MAR), GOETHE INSTITUTE 
POSITION:XR DIRECTOR AND CREATOR 
TOOLS: 8TH WALL, BLENDER, MIRO


Ignoto Vibrations is a mixed-reality sculpture series prototype and performance commissioned for the Museum Conference at Rio Art Museum (MAR) in Brazil. I co-created the project in collaboration with the artist Rodrigo Andreolli and the architect Marilia Piraju. As an XR director, I coordinated an international team of tech professionals (AR developer, 3D modeler, and animator) and designed the user experience.

The fire at the National Museum of Rio de Janeiro on September 2, 2018, created images loaded with symbolic force about the treatment conditions given to Brazil's scientific and cultural research. This fire caused the loss of the most important museum collections in the country's history, but at the same time made us reflect on the weight of certain historical narratives, urging us to trace new memories that re-exist beyond the destroyed matter. Fire, in its tragic manifestation, also reaches its transcendental aspect.

Based on the study of narratives brought by researchers and members of the National Museum collection rescue team, this project proposes a prototype exhibition in Mixed Reality, motivated by 3D scans of some of the recovered pieces and the memories lost in the fire.








CREATION PROCESS






CREDITS

Research Direction, Creation, Production: Rodrigo Andreolli

Mixed Reality Director, Creation: Fernando Gregório

Creation, Scenic Architecture: Marília Pirajú

Augmented Reality Development: Name Atchareeya Jattuporn

Animation and 3D Modeling: Gabriel Brasil

Texts, Drawings and Performance:
Bruxa Profana Latino-americana
Clamor
Fernando Gregorio
João Vitor Cavalcante
Moonlight Mendez
Marília Piraju
Rodrigo Andreolli
Vick Nefertiti

Musicians
André Souza
Kaio Ventura

Design, sound editing and audiovisual recording
Renato Pascoal

Illustrations
Nash Laila
Vincent

Assistant
Valerie Chen

Locksmith
Maurício - Fina Serralheria - Bixiga, São Paulo

Consultancy
Mother Celina de Xango


Thanks
Antonia Cattan
Carolina Bonfim
Clelio de Paula
Fel Barros
Flavia Meirelles
Gustavo Caboco
Henrique Entratice
Lucas Canavarro
Luiz Cruz
Maria Catarina Duncan
Renato Caldas
Rosabelli Coelho-Keyssar




Collaboration
Goethe Institut Rio de Janeiro

Fernanda Galvão, Julian Fuchs, Robin Mallick

National Museum of Rio de Janeiro

Crenivaldo Veloso Jr., João Pacheco de Oliveira, Maria Elizabeth Zucolotto, Maria Gabriela Evangelista, Juliana Sayão, Michele de Barcelos Agostinho, Paula de Aguiar Silva Azevedo, Pedro Luis Von Seehausen, Rafael de Andrade, Sergio Alex Kugland de Azevedo, Silvia Reis

LAPID - Image and Signal Processing Laboratory - UFRJ - Federal University of Rio de Janeiro

Bendegó and Heart Scarab 3D Models provided by LAPID

3D Abebé de Oxum and Ritxokó models created by Rodrigo Andreolli and Gabriel Brasil from images by Pedro Von Seehausen

Support
MISTI Brazil - Massachusetts Institute of Technology
Rio Art Museum
Teatro Oficina
Universidade Antropófaga














LINE PLAYERS   AR FILTER   2022   
CLIENT:META OPEN ARTS   POSITION:AR DESIGNER  
TOOLS: SPARK AR, ADOBE ILLUSTRATOR AND BLENDER

Line Players is an AR collective game experience for Instagram Reels based on retro game references and futuristic XR glasses design. It was created in collaboration with Meta Open Arts. The effect interprets the design identity and key visual assets for a Meta international event in Palo Alto, California, in September 2022. The project included physical activation stations with backdrops and QR codes during a private event in Palo Alto, California.

Click 
here to open and try the effect on Instagram.









CREATION PROCESS













MOURNING STAGE   VISUAL EFFECTS(VFX)   2022   
CLIENT:CARLOS MOTTA AND SIMON(E) JAIKIRIUMA PAETAU   
POSITION:VFX DESIGNER AND ANIMATOR  
TOOLS:ADOBE AFTER EFFECTS, PREMIERE AND PHOTOSHOP


Mourning Stage is a film that uses a series of drawings as a performance score. I worked on creating visual effects using face-tracking technology to animate 2D masks created by the artist Carlos Motta and move in sync with Simon(e)’s Paetau performance.

These images depict different renditions of the devil in hell. Among this group of demons, there are feminized characters that suggest sexual perversions as typified by the Catholic imagination. In the film, Simon(e) Paetau interprets and responds to the drawings using her body and facial expressions in a ritualistic performance, where the body, fetishized and colonized by morality, is mourned.


Installation views at Wexner Center for the Arts, Columbus, 2022Installation views at Wexner Center for the Arts, Columbus, 2022






CREDITS

A video by Simon(e) Jaikiriuma Paetau and Carlos Motta

Performed by Simon(e) Jaikiriuma Paetau

Director of Photography
Lola Gómez Castello

Soundtrack
Isabel González Toro

Soundtrack Assistant
José Marulanda

Visual Design (VFX)
Fernando Gregório

Second Camera
Carlos Andrés López

Makeup
María Fernanda Cepeda

Titles
Lauryn Siegel

Colorists
Aleksander Bergan
Martin Backhaus

Sound Mix
Ian Turner

Lighting Assistant
Luis Hernando Cubillos

Sound
Jesús Guevara

Photography
Camilo Delgado

Field Producer
Juan David Correal

Production Director
Paola Andrea Pérez Nieto

Production Coordinator
Catalina Patarroyo Velásquez

Production
Oficina Inercia Películas
Natalia Ordoñez García
Camilo Cárdenas Suárez
Alejandra Gómez Osorio
Sara Loboa
Elizabeth Hernández

Location
Espacio Odeón, Bogotá


Co-produced by the Wexner Center for the Arts, Columbus and Goethe Institute, Bogotá with support from XI Berlin Biennale

Special thanks to Alejandra Sarria, Espacio Odeón, Bogotá













AUGMENTEND PERFORMANCE STUDIO    AR WORKSHOP    2022
CLIENT: SCHOOL OF THE ART INSTITUTE OF CHICAGO    POSITION: AR EDUCATOR   
TOOLS: SPARK AR, ZOOM, PERFORMANCE




Augmented Performance Studio is a 4 hours workshop created when I had the honor of being a guest artist at the School of the Art Institute of Chicago. The experience was tailored for the Mixed Reality Performance class, taught by Mark Jeffrey and Judd Morrissey. The workshop offered an opportunity for students to explore the intersection of AR and performance, using Spark AR, hand-tracking techniques and performance dynamics. 



The workshop was taught via Zoom with the assistance of in person professors and graduate assistants



TOPICS COVERED

During the workshop, we explored various topics related to augmented reality, such as:

  1. Introduction to Augmented Reality (AR)
  2. History of AR
  3. Introduction to AI, Deep Learning, and Computer vision
  4. Current State of AR and Future Possibilities
  5. Presentation of my past works in the field
  6. Conceptual and Poetic Approaches to Augmentation and Algorithms
  7. Body Warm-up Focusing on Hands
  8. Hands-on Spark AR Workshop with Hand Tracking Techniques
  9. Student’s results presentation for Feedback



Some of the XR performance prototypes created by the students during the workshop



PREPARATION AND TOOLS

To fully immerse themselves in the workshop experience, students were asked to think about something intangible or virtual, such as a memory, a dream, or a future projection, and represent it as a word or simple drawing. They brought this 2D asset to the workshop in either PNG, JPEG, or SVG format. Students were also asked to download, install, and log in to Spark AR Studio, as well as have Instagram or Spark AR Player on their cellphones for testing and experimentation.





PREVIOUS WORKSHOPS AND CLASSES

In addition to this workshop, I have had the pleasure of teaching other classes related to AR:

2021 - Augmented Reality and Performance Studio (2h Workshop) at Interactive Telecommunications Summer Camp, Tisch, NYU
2021 - Augmented Reality and Performance Studio (2h Workshop) at Brooklyn College
2021 - Big Ideas in the Past and Future of Technology (Graduate Assistant) for Nancy Hachinger, Interactive Media Arts BFA program at Tisch, NYU












RAMENHEAD   AR FILTER   2022   
CLIENT: BIEN INCLUSIVE MOTION DESIGN STUDIO   
POSITION:AR DESIGNER  
TOOLS:META SPARK STUDIO AND BLENDER


Ramenhead is an AR world effect created together with Bien, an inclusive motion design studio based in Los Angeles, California. The project simulates a snow globe and was part of an XR Holiday card for one of their clients to use in an internal campaign.

In the AR audiovisual experience, you can "open" and "close" the ramen shop by tapping the 3D model.

The animation was inspired by Japanese folk toys called Kyodo gangu and German cuckoo clocks.

Click here to try the filter on your Instagram.