THE FLOW OF COLORS / Paint Mapping and Neural Network

The Flow of Colors
Interactive Paint Mapping installation, 2017/18
Concept and Digital animation: Andrea Sztojánovits
Painting: Éva Köves

Sound: Gergely Álmos
Math: Domonkos Varga
Size: 540 x 180 cm
Softwares and hardwares: After Effects, Resolume, Ableton, Neural Network, Bare Conductive board

The Flow of Colors 8.jpg

The project establishes a symbiosis of genres, as computer animation (movements, light, sound) projected on oil/canvas/photo paintings is a new type of relation between classical visual arts and 21th century new digital art genres. The two media, and the two artists, Éva Köves painter and Andrea Sztojánovits digital artist, create together the structure of the artwork, a new-type of medium from the static elements of the painting and the constantly changing elements of digital animation through projected light. Their Paint Mapping methods are based on a new art form called Projection- or Architectural Mapping. They unite the technology with the traditional forms.

This two artistic components met with the brand new mathematical way called neural networks, which made the painting installation into a smart, sensitive surface. With the development of biologically inspired vision models called deep neural networks, human creativity was challenged by algorithmic processing. In collaboration with Domonkos Varga (MTA SZTAKI) mathematician, this method brought to life by the complex interplay between deep learning algorithms and artistic style through an algorithm programmed especially for this project.

The mathematical algorithm recreates the color aesthetic of the projected light by changing the vision of the painting itself. With a tactile sensible interface, the audience can activate and change the colorization of the projected light with the movements of their hands on the control surface.

The vision of the installation is the projection of such an inner spiritual state that facilitates observing the spirits of the soul and interpreting the stormy state of our inner being. Through coloring, this state remains, but it gains different interpretations. During the process, with the color organ, observers are to change the quality of this state reproduced over and over again by the complex of the painting, the projected light and the mathematical algorithm altogether.

at Zsolnay Light Festival, Pécs, 2018:

The first reharsal:

Research:

THE FLOW OF COLORS

Advertisement

The Ohm sound reactive paint mapping installation

Ohm
Sound reactive Paint Mapping installation, 2016
Oil painting: Éva Köves
Digital animation: Andrea Sztojánovits
Size: 150 x 200 (19 pc 40 x 30 cm)

Audiovisual painting-installations, responding to the noises of outside world and tonal environment, are novelties for our visual perception because of the interference of the sense of painting and digital marking. The installation decorates black and white traces by creating dashes of color, and in such way it reproduces some phenomena to be found in the nature, as twinkling of the shellfish, or interference color that can be seen on the wings of some insects. The colors influenced by moving voices shift ceaselessly in accordance with the moiré pattern. Therefore, it brings about elementary perception at the particle’s level.

img_1997

Ohm was exhibited at:
Zsolnay Light Festival 07/01-03/2016, Pécs Hungary
ROM – Riders on the Mall Digital Art Festival 05/27-29/2016, MÜSZI, Budapest

Zsolnay Light Festival, Pécs

Zsolnay Light Festival
07/01-03/2016
Pécs Hungary
http://zsolnayfenyfesztival.hu

„At the first weekend of July visitors aiming to relax are awaited by a thematic, multi-arts festival, which alloys the amazing legacy of the city’s 2,000 years of history with a fantasy world; prompts for playing and thinking on the border of the impressive past and an imaginary future, conveys values, entertains and delights.

As night falls, the audience of the festival will get into another world where imagination takes over the lead role.
The city will be engulfed by light, it is worth restart the exploration amongst the stationary and moving light painting masterpieces, photographic structures and light installations.”

ROM – Riders on the Mall Digital Art Festival, Budapest

„Riders on the Mall (ROM) is a unique gathering of audiovisual jockeys, ranging from virgin riders to experienced charioteers, from experts in New Media Art to audiences interested in audiovisual and technological trends. ROM deliberately puts emphasis on visuality within the current art scene, scanning the audiovisual landscape in Hungary and abroad for fresh threads, merging it into a panorama of what-comes-next.”

https://ridersonthemall.com/
video about the festival:
https://www.facebook.com/plugins/video.php?href=https%3A%2F%2Fwww.facebook.com%2Fridersonthemall%2Fvideos%2F1581415978824258%2F&show_text=0&width=560

Scratches paint mapping installation

Scratches
Sound reactive Paint Mapping installation, 2016
Oil painting: Éva Köves
Digital animation: Andrea Sztojánovits

The installation decorates black and white traces by creating dashes of color, and in such way it reproduces some phenomena to be found in the nature, as twinkling of the shellfish, or interference color that can be seen on the wings of some insects. The colors influenced by moving voices shift ceaselessly in accordance with the moiré pattern. Therefore, it brings about elementary perception at the particle’s level.

Scratches was exhibited at:
XVII. LPM 05/12-05/14/2016, Tolhuistuin, Amsterdam, Hollandia

Digital tale of geometric shape / visual for mius

This animation piece for mïus music band’s song called: ‘Haumea’ is a remake from the animations of Monochrome Clack.

Animation: Andrea Sztojánovits
Music: mïus music band

„Relax. This is a journey to a timeless audiovisual microcosmos..

..when you see your own light in totally darkness, it’s a single value carries only intensity level. In that world the audiovisual journey begin which drives you across shattered shapes with black frames and white circles among triangle mountains to the digital fields where there is full moon in grey and your breath begins to slow down; you hear the gong sounds and see the resonances in the air. This is the abstract universe: 40 minutes of visual experimentation with basic geometric shapes for the album: Eigengrau by mïus music band
(eigengrau = the color seen by the eye in perfect darkness)”

LIGHT YEAR presents “Open to Interpretation” event, Manhattan Bridge, NYC

 

„Light Year: “Open to Interpretation” is a publicly-presented video art show that explores the dynamic relationship between contemporary video art, sonic art, live performance and cultural reflection.

Where does VJing end and Video Art begin? And how do music videos fit into this dynamic puzzle? Are there boundaries or just overlapping categories? VJing can best be described as the act of selecting, playing and mixing different sources of visual media such as video files, live camera feeds, generated visuals, while simultaneously applying various effects, in synchronization to music, oftentimes alongside a live DJ. The characteristic that ties the variety of approaches together is the relationship between sound and light.

The term VJ itself dates back to the melting pot that was the New York club scene of the 1970s. Since then, as technology and music have evolved, so has what it means to be a VJ. The tools, techniques, the very culture itself keep changing. 40+ years and the scene is still very new and more relevant than ever. “Open to Interpretation” showcases a variety of work from a variety of sources: Works that are exist between VJ content and Video Art; Music Videos that are made in a truly sound-reactive fashion; and works from Video Artists where sound/music are closely related to the images. All of these will be presented, large-scale, on the iconic Manhattan Bridge as part of the LIGHT YEAR Video Art Projection series.

As the title suggests, everyone is welcome to explore and answer the questions for themselves!

About “Light Year”

The Manhattan Bridge comes alive with “Light Year,” a one-year program of projected video art presented the First Thursday of every month.  In honor of the United Nations’ declaration of 2015 as The Year of Light and Light Art, “Light Year” includes a well-rounded program of video artists from around the globe.  Curated, created and presented by Leo Kuelbs Collection, John Ensor Parker and Glowing Bulbs (aka 3_Search), “Light Year” reveals surprising connections and highlights Dumbo’s role as an important hub for technology and the arts.”

source: http://dumbo.is/hosting/light-year-presents-open-to-interpretation/

Re:Lake II paint mapping installation

RE:LAKE II
Audiovisual installation, 2015
Oil painting: Éva Köves
Digital animation: Andrea Sztojánovits
Size: 160 x 200 cm (20 pc 40 x 30 cm)

Re:Lake II is from the animation of Re:Lake I installaton in Space Collection. The collection regards the phenomena of the abstract ‘celestial bodies’ that appear in the black background, such as the nightly sky, as the structural composition of its syntactic program language. Integrating the disciplines used (painting, photography, music, video art), the work of art itself becomes a sign, but it uses the most concise visual code system to interpret the primary pragmatic information.

It explores individual geometrical phenomena, such as line, circle, triangle, or quadrangle according to semantic (logical) rules, on the basis of which, in process of running the course of the program, the data structures required for the composition are connected to previously known phenomena. The series of random components and signs defined in this way carry information, and are thus tied to a function. They always depend on the subject, on the phenomena, and may therefore change – due to new information or discoveries.

Re:Lake II was exhibited at:
Re:Lake II. 10/01/2015 Mozsár Gallery, Budapest
LanguAGES of LIGHT as a live act 09/26-12/31/2015, Kepes Institute, Eger, Hungary

Oscillation paint mapping installation

Oscillations
Paint Mapping installation, 2014
Oil painting: Éva Köves
Digital animation: Andrea Sztojánovits
Sound: Gábor Borosi
Size: 200×200 cm (27 pc 40 x 30 cm)
Time length: 4 minutes
in private collection

Oscillation is the most transcendental installation in Molecule Collection.

The aim of the collection is to induce a unique atmosphere within the given environment, which causes surprising, calming, transcendental feelings in the viewer/participant through deeply sensed audiovisual impressions. Visual language used in the collection evokes the phenomenon of the blinking light through breath delicious layers and filmy occurrences, which – through continuously changing light and tones – automatically induce the eye to attend actively, shift out from calm, and stimulate cognition. Details show up and fade away, the viewer becomes observer by means of the active participation of the eyesight – for example, twinkling, amazement, that is, by alternate phases of openness-closeness. This circumstance, the eye’s ‘respiration’ provokes assertive action in the attentiveness to the picture.

Oscillations was exhibited at:
Oscillation – A38-MVM Light painting 02/22-23/2014, A38, Budapest, Hungary

Silvered Light II sound reactive paint mapping installation

Silvered Light II
Paint Mapping installation, 2014
Oil painting: Éva Köves
Digital animation: Andrea Sztojánovits

In the Silver Collection we use the projected light to give an emboss effect to the paintings, thereby the bright ‘tint’ of the painting comes from the shifted lighting of black surfaces. The sound reacted vortex dynamics of the projected lighting transforms the vision of the painting into a sense of moving, brightening relief, which indicates a three dimensional space in feelings. In this way, as a consequence of the spatial expansion, the resolution of the sense increases on the level of perception. The light’s pulsation and the reiterating circulation of the sound bring about continuity in time.

Silvered Light II was exhibited at:
Oscillation – A38-MVM Light painting 02/22-23/2014, A38, Budapest, Hungary

Silvered Light I sound reactive paint mapping installation

Silvered Light I
Paint Mapping installation, 2014
Oil painting: Éva Köves
Digital animation: Andrea Sztojánovits
Size: 90×125 cm

In the Silver Collection we use the projected light to give an emboss effect to the paintings, thereby the bright ‘tint’ of the painting comes from the shifted lighting of black surfaces. The sound reacted vortex dynamics of the projected lighting transforms the vision of the painting into a sense of moving, brightening relief, which indicates a three dimensional space in feelings. In this way, as a consequence of the spatial expansion, the resolution of the sense increases on the level of perception. The light’s pulsation and the reiterating circulation of the sound bring about continuity in time.

Silvered Light I was exhibited at:
LanguAGES of LIGHT 09/26-12/31/2015, Kepes Institute, Eger, Hungary
Oscillation – A38-MVM Light painting 02/22-23/2014, A38, Budapest, Hungary

Ludwig Next: Monochrome Clack exhibition, LuMu

„In December 2013,the Ludwig Museum – Museum of Contemporary Art launches a new series of exhibition, titled Ludwig Next that presents fresh ideas and projects by local artists within the frame of four weeks long shows. The new series aims to give a direct insight into current work and activity of contemporary Hungarian art-workshops, also to present new artworks that had not been publicly seen before. Our first guest is going to be:

Monochrome Clack | Intermedial installations of Éva Köves and Andrea Sztojánovits”

http://ludwigmuseum.hu/site.php?inc=program&menuId=11&programId=4086

Molecule Variations 8 channels audio reactive paint mapping installation

Molecule Variations
Paint Mapping installation, 2013
Oil painting: Éva Köves
Digital animation: Andrea Sztojánovits
8 channel sound: Gábor Borosi
Size: 85×150 cm
Time length: loop

Molecule Variations is a ‘sensible painting’ in Molecule Collection. The aim of the collection is to induce a unique atmosphere within the given environment, which causes surprising, calming, transcendental feelings in the viewer/participant through deeply sensed audiovisual impressions.

Visual language used in the collection evokes the phenomenon of the blinking light through breath delicious layers and filmy occurrences, which – through continuously changing light and tones – automatically induce the eye to attend actively, shift out from calm, and stimulate cognition. Details show up and fade away, the viewer becomes observer by means of the active participation of the eyesight – for example, twinkling, amazement, that is, by alternate phases of openness-closeness. This circumstance, the eye’s ‘respiration’ provokes assertive action in the attentiveness to the picture.

Molecule Variations was exhibited at:
Oscillation – A38-MVM Light painting 02/22-23/2014, A38, Budapest, Hungary
Ludwig Next: Monochrome Clack 12/20/2013 – 01/19/2014, Ludwig Museum, Budapest, Hungary