← Back to main page

Tutorial - how to shoot in 3D? What the frog's eye tells the frog's brain?

single-channel video, colour, sound, 3D animation, FHD 1920x1080, 24fps, 07'25''

The work uses game-engine mechanisms to turn gun handling into camera handling and firing into image shooting.

In 1959, the classic experiments conducted by Lettvin and his colleagues suggested that the frog’s brain does not receive the “raw image” produced by the visual system, but meaning-laden codes already processed by the eye. The work brings this split between image and interpretation into a game-engine environment: a weapons system becomes a camera system, gun handling becomes camera handling, and firing becomes a way of producing images. Seeing is staged as a procedural action rather than a passive reception of the world.

Process notes

The 2020 script begins like a practical lesson, then immediately redirects the tutorial away from conventional 3D filming. It proposes to “shoot” inside a simulated three-dimensional environment, using an FPS-style weapons system to simulate a camera system. From there, the work follows the double meaning of “shoot” through the shared body schema of camera and weapon, hand-cranked camera and hand-cranked machine gun, cameraman and avatar. In the game engine, the physics system is not background realism but the condition of the image: surface, border, collision and feedback make the camera and its holder part of the world they record. The image becomes the output of an action system, where meaning-laden codes, body, rule, moteur de jeu and physical collapse keep interrupting one another.

The added stills trace this research path more directly: a dual-lens camera rig, an eye-study fragment tied to Lettvin and frog vision, a weapon-camera body inside the Unity scene, and a late node map where input, collision and feedback are arranged as image-making conditions.

Exhibitions

  • 2026, Instance Dungeons and Sights / 無限副本與瞄準器, National Taiwan Museum of Fine Arts, Taichung, Taiwan (CNTW) — March 28 - June 28, 2026

Links / references