科技藝術書報討論

Report: Link

Topic: MACHINE AUGURIES

Author: Dr. Alexandra Daisy Ginsberg, Johanna Just, Ness Lafoy, Ana Maria Nicolaescu

Reference: ARS Electronica Festival 2020 (Interactive Art)

Abstract:

Before sunrise, a redstart begins his solo with a warbling call. Other birds respond, together creating the dawn chorus: a back-and-forth that peaks thirty minutes before and after the sun emerges in the spring and early summer, as birds defend their territory and call for mates. Light and sound pollution from our 24-hour urban lifestyle affects birds, who are singing earlier, louder, for longer, or at a higher pitch. But only those species that adapt survive. Machine Auguries questions how the city might sound with changing, homogenizing, or diminishing bird populations.

In the multi-channel sound installation, a natural dawn chorus is taken over by artificial birds, their calls generated using machine learning. Solo recordings of chiffchaffs, great tits, redstarts, robins, thrushes, and entire dawn choruses were used to train two neural networks (a Generative Adversarial Network, or GAN), pitted against each other to sing. Reflecting on how birds develop their song from each other, a call and response of real and artificial birds spatializes the evolution of a new language. Samples taken from each stage (epoch) in the GAN’s training reveal the artificial birds’ growing lifelikeness.

The composition follows the arc of a dawn chorus, compressed into ten minutes. The listener experiences the sound of a fictional urban parkland, entering in the dim silvery light of pre-dawn. We start with a solo from a lone “natural” redstart. In response, from across the room, we hear an artificial redstart sing back, sampled from an early epoch. A “natural” robin joins the chorus, with a call and response set up between natural and artificial birds. The chorus rises as other species enter, reaching a crescendo five minutes in. As the decline starts and the room illuminates to a warm yellow, we realize that the artificial birds, which have gained sophistication in their song, are dominating.

SIGGRAPH 2021

Topic: Common Datum

Author: Tobias Klein, Jane Prophet

ppt：https://docs.google.com/presentation/d/1eqoim5uIjCwtd-o3YjbkrfZ2MsCRF_OpiAp23OErySM/edit?usp=sharing

Abstract:

“Common Datum” is an environmentally reactive, hygroscopic sculpture. A series of suspended vessels continuously absorb the humidity in the exhibition — generated through the breath of the audience. Slowly, each 3D-printed condenser accumulates water that drips into a series of glass volumes. Even though all vessels are of individual shapes, locally absorbing moisture at a different rate, a common datum is created throughout all of them. The work articulates a confluence between traditional and digital craft in the context of environmental, participatory art.

Topic: ElectroRing: Subtle Pinch and Touch Detection with a Ring [pdf] [ppt] [paper]

Author:Wolf Kienzle∗ & Eric Whitmire∗   FRL Research Redmond, WA, USA

Abstract:  We present ElectroRing, a wearable ring-based input device that

reliably detects both onset and release of a subtle fnger pinch, and more generally, contact of the fngertip with the user’s skin. ElectroRing addresses a common problem in ubiquitous touch interfaces, where subtle touch gestures with little movement or force  are not detected by a wearable camera or IMU. ElectroRing’s active electrical sensing  approach provides a step-function-like change in the raw signal, for both touch and release events, which can be easily detected using only basic signal processing techniques. Notably, ElectroRing requires no second point of instrumentation, but only the ring itself, which sets it apart from existing electrical touch detection methods. We built three demo applications to highlight the efectiveness of our approach when combined with a simple IMU-based 2D tracking system.

SIGGRAPH 2021

Topic: ChoreoMaster : Choreography-Oriented Music-Driven Dance Synthesis
ppt

Author: Kang Chen et al.

Abstract:

Despite strong demand in the game and film industry, automatically synthesizing high-quality dance motions remains a challenging task. In this paper, we present ChoreoMaster, a production-ready music-driven dance motion synthesis system. Given a piece of music, ChoreoMaster can automatically generate a high-quality dance motion sequence to accompany the input music in terms of style, rhythm and structure.To achieve this goal, we introduce a novel choreography-oriented choreomusical embedding framework, which successfully constructs a unified choreomusical embedding space for both style and rhythm relationships between music and dance phrases. The learned choreomusical embedding is then incorporated into a novel choreography-oriented graph-based motion synthesis framework, which can robustly and efficiently generate high-quality dance motions following various choreographic rules. As a production-ready system, ChoreoMaster is sufficiently controllable and comprehensive for users to produce desired results. Experimental results demonstrate that dance motions generated by ChoreoMaster are accepted by professional artists.

Paper:

https://dl.acm.org/doi/abs/10.1145/3450626.3459932

https://netease-gameai.github.io/ChoreoMaster/Paper.pdf

Introduction:

https://blog.siggraph.org/2021/09/how-choreomaster-combines-cutting-edge-ai-and-graphics-technologies.html/

https://netease-gameai.github.io/ChoreoMaster/

PPT: https://docs.google.com/presentation/d/1H8qDtTGeQOsDFDornnaXGuTo3aOVEhtj/edit?usp=sharing&ouid=103926017209371204990&rtpof=true&sd=true

Respire: Virtual Reality Art with Musical Agent Guided by Respiratory Interaction [Leonardo Music Jornal]

Website Link: https://kivanctatar.com/Respire

Video:

Report: Link

Topic: Stowaway City: An Immersive Audio Experience for Multiple Tracked Listeners in a Hybrid Listening Environment

Author: Michael McKnight

Original Article:

https://pureadmin.qub.ac.uk/ws/portalfiles/portal/241455682/McKnight_DEV.pdf

Abstract:

Report: Link

Topic: First Impression: AI Understands Personality

Author: Xiaohui Wang, Xia Liang, Miao Lu, Jingyan Qin

Reference: ACM Multimedia 2020

Abstract:

When you first encounter a person, a mental image of that person is formed. First impression, an interactive art, is proposed to let AI understand human personality at first glance. The mental image is demonstrated by Beijing opera facial makeups, which shows the character personality with a combination of realism and symbolism. We build Beijing opera facial makeup dataset and semantic dataset of facial features to establish relationships among real faces, personalities and facial makeups. First impression detects faces, recognizes personality from facial appearance and finds the matching Beijing opera facial makeup. Finally, the morphing process from real face to facial makeup is shown to let users enjoy the process of AI understanding personality.

U!Scientist: Designing for People-Powered Research in Museums – SIGCHI 2021, Best Paper

→ U!Scientist Web

→ Full-text Paper

→ Class Presentation

Authors –Mmachi God’sglory Obiorah et al.

Key words – Citizen science, museums, interactive tabletop displays

Abstract – Scientists have long sought to engage public audiences in research through citizen science projects. This project engages public audiences in contributing to real research as part of their visit to a museum. We present the design and evaluation of U!Scientist, an interactive multi-person tabletop exhibit based on the online Zooniverse project, Galaxy Zoo. We installed U!Scientist in a planetarium and collected video, computer logs, naturalistic observations, and surveys with visitors. Our findings demonstrate the potential of exhibits to engage new audiences in collaborative scientific discussions as part of people-powered research.

Tracking the Loving Gaze – Leonardo 2021, Artists’Article

→ Leonardo journal [MIT press]

→ Journal

→ Class Presentation

Authors – Theopisti Stylianou-Lambert & Omiros Panayides (Cyprus University of Technology, CY)

Key words – Personal photography, Eye tracker, Loving gaze

Abstract – Tracking the Loving Gaze is a futile attempt to follow, map and capture the way cherished personal photographs are viewed. The authors asked 30 survey subjects to use an eye tracker while looking at a preselected photograph that held a special meaning for them. The raw visual data from this process—heat maps, focus maps and scan paths—became the foundation of a body of work that includes darkroom prints, short videos and a limited-edition artist book. Apart from exploring the invisible viewing processes of personal photography, this article introduces the concepts of the detached and the invested viewer as well as the corresponding concepts of the cold and the loving gaze.

20211214_Dual LearningMM ’21 MultiMedia: October 20–24, 2021, Virtual Event, China

Topic: Dual Learning Music Composition and Dance Choreography [Paper][ppt][pdf]

Author: Shuang Wu et al.

Abstract:
Music and dance have always co-existed as pillars of human activities, contributing immensely to the cultural, social, and entertainment functions in virtually all societies. Notwithstanding the gradual systematization of music and dance into two independent disciplines, their intimate connection is undeniable and one artform often appears incomplete without the other. Recent research works have studied generative models for dance sequences conditioned on music. The dual task of composing music for given dances, however, has been largely overlooked.

In this paper, we propose a novel extension, where we jointly model both tasks in a dual learning approach. To leverage the duality of the two modalities, we introduce an optimal transport objective to align feature embeddings, as well as a cycle consistency loss to foster overall consistency. Experimental results demonstrate that our dual learning framework improves individual task performance, delivering generated music compositions and dance choreographs that are realistic and faithful to the conditioned inputs.

MM ’20: the 28th ACM International Conference on Multimedia

Topic: Anisotropic Stroke Control for Multiple Artists Style Transfer ppt

Author: XuanHong Chen et al.

Abstract:

Though significant progress has been made in artistic style transfer, semantic information is usually difficult to be preserved in a fine-grained locally consistent manner by most existing methods, especially when multiple artists styles are required to transfer within one single model. To circumvent this issue, we propose a Stroke Control Multi-Artist Style Transfer framework. On the one hand, we design an Anisotropic Stroke Module (ASM) which realizes the dynamic adjustment of style-stroke between the non-trivial and the trivial regions. ASM endows the network with the ability of adaptive semantic-consistency among various styles. On the other hand, we present an novel Multi-Scale Projection Discriminator to realize the texture-level conditional generation. In contrast to the single-scale conditional discriminator, our discriminator is able to capture multi-scale texture clue to effectively distinguish a wide range of artistic styles. Extensive experimental results well demonstrate the feasibility and effectiveness of our approach. Our framework can transform a photograph into different artistic style oil painting via only ONE single model. Furthermore, the results are with distinctive artistic style and retain the anisotropic semantic information.

Link:  https://dl.acm.org/doi/abs/10.1145/3394171.3413770

主題：《基於視覺之意識遞延科技藝術創作論述》
Vision-based Consciousness Transmit and Extend Techno Art Creation

作者：黃浩旻

摘要：
In the context start with the observation of the relationship between humans and technology. Can consciousness be carried by technology to receive and control information in the real world? To clarify this issue, need to research in the fields of knowledge, such as philosophy, psychology, biology, futurology, etc. This context as the main theme to create, and analyze the experience process to clarify, analyze the meaning and logic of the results of the work.

關鍵字：Consciousness, Human Augmentation, Interactive Art, Installation Art, Virtual Reality.

報告：LINK

主題：《返轉抑制：時間空間的光學具象 》
作者：洪梓倪

摘要：
本論⽂創作因主要創作之空間、聲⾳裝置作品媒材與重點概念有互相交錯牽引 關係遂將性質劃分不以年代劃分，以「空間」、「速度」、「⼈」為基軸排列，對 應「裝置」、「錄像」與「表演」，關鍵概念上互為有機網狀連結。以最近期創作 之作品《 返轉抑制 Reversal Inhibition 》作為主要出發，先調查搜集時間概念與其演 進⽅式，⽽後帶⼊展演形式衍⽣相關實作技術、理論或範例，進⽽交叉帶⼊⾃⾝之 動機與對科技之想像，進⽽相互辯證探討。

空間作品《 返轉抑制 Reversal Inhibition 》、《秩序 The Order 》與表演裝置 《Prism 聲⾳裝置》為筆者主要創作主軸遂以較多幅度探討，其核⼼媒材與概念為 「光線光學(ray optics)」之「成像(imaging)」與「折射(refraction)」在空間中所造成 的反饋作⽤(feedback)；前期之錄像類創作《 Hey Kiddo, sooner or later you will grow up. 》與《 ⼈間排泄 Excretion 》、《 台北無間 Taipei Nowhere 》概念核⼼則圍繞現 實空間中之「速度」在透過鏡框式影像限制後加以敘事之⽇常隨筆與概念實驗；表 演作品《 未來的凌遲 An afterlife torture 》則主要分析⾝體如何在場及作為展演之⾝ 體為何，並藉機回應第⼆章創作動機中所提到科技與⼈之間的種種假設。

作品皆有⼀個共同探討之議題——不論是城市中、空間中、⼈意識中「在某個 特定時間造成之點、線、⾯」及其中所造成的⼀切「速度」之於空間。遂將《 返轉 抑制：時間空間的光學具象 Reversal Inhibition : Optical Materialization of Time and Space 》定為此⼤綱論述之探討主題。

關鍵字： 時間、速度、折射(refraction)、光線光學 (ray optics)、環境節奏、Beats Per Minutes(BPM)、虹、⾊散、類⽐、點線⾯、聽覺、反饋作⽤(feedback)。

PPT：LINK

主題：《流變空間：虛實空間中的身體感知》

作者：許巽翔

摘要：

在科技媒體迅速發展蓬勃的今日，那條原本在最原始的真實空間與虛擬空間之間還能被劃分清楚的分界線，也因為爆炸性成長發展的科技技術而互相覆蓋並逐漸糊。現代人的身體感知在這樣實虛不斷加速交織的過程中也開始更加嚮往於虛擬空間中那些於現實生活中無法體驗的特殊經驗。逐漸數位化的感受經驗似乎成為了我們未來的唯一指向，而在真實與虛擬
之間的拉扯也成為了今日我們都必須面對的議題。
本文的章節將依序整理我從進入研究所之後對於人與實虛空間之相關議題的創作進行脈絡整理。從《Ultra Line》系列作為出發，以放置巨大尺度的光線比例尺於戶外空間進而探討在真實世界中人與人造建築和自然環境之間的尺度關係。到《闔眼之前》，藉由空間裝置的搭建再現並重新詮釋因科技指數型蓬勃發展的環境之下，人在實體空間中與電子載具平面所形成的虛擬沈浸空間的交互關係。到最後的《流變空間》則是將前兩件作品探討的面相做結合，試著透過媒材的介入使原本單純的現實幾何空間因隨機亂數切割的剖線而將其有機化並產生實虛難辨的空間邊界，進而在黑暗中創造出實虛組合的空間量體，使人對於空間的感受藉由奇觀式的視覺體驗重新回歸於最本能的身體感知。希望能夠藉由這些作品的特性進而去探討在數位時代中虛實空間與人之間的關係。

關鍵字：空間尺度、虛實空間、身體感知、光、雷射、空間裝置

PPT：https://docs.google.com/presentation/d/1h2IIf6s9kf7Sa1LDWtdkVdOSdBlNpKve/edit?usp=sharing&ouid=111916077752186800808&rtpof=true&sd=true

《「小而輕」展覽之創造——擴增實境作為博物館新體驗媒介》

→ 論文

→ 簡報

作者 – 馮歆宇

關鍵字 – 擴增實境，博物館體驗，迭代設計

主旨 – 傳統博物館在創造數位體驗上需要注意什麼？本論文從探討AR技術運用著手，作出回應。作者認為展覽數位化不應僅著重軟硬體數量，而應綜合技術應用、體驗沈浸、文化創新等多面向。她歸納出一些策略，並以自己參與企劃的舊展覽為原型，提出新的「更小、更輕」的具體方案，進一步說明如何應對AR展覽中物件敘事、結合場域等方面的問題。