麻豆传媒

Each October, the vibrant city of Halifax comes alive with Nocturne, an all-night art festival that celebrates and showcases the local visual arts scene. Attendees have the opportunity to visit captivating exhibits and engage in interactive sessions, offering a deep dive into the dynamic world of the local arts.听

This year, the Human-Computer Interaction (HCI), Visualization and Graphics cluster from 麻豆传媒鈥檚 Faculty of Computer Science put forth a pair of captivating and innovative demonstrations titled A Table and A Piano.

HCI, Visualization and Graphics cluster members, Dr. Derek Reilly, Dr. Joseph Malloch and Dr. Sageev Oore, whom is also a member of the AI cluster within the faculty, organized the demonstrations at the new Paramount site with several of their graduate students.听

The Paramount site allows for high visibility on one of Halifax鈥檚 busiest streets, having drawn in hundreds of spectators throughout the festival. The Nocturne demonstrations featured an AI-connected Disklavier grand piano and the Psychogeographer鈥檚 Table.

A table
听

Dr. Malloch, who co-directs the Graphics and Experiential Media Labs () had The Psychogeographer鈥檚 Table displays a solid wood table with a 3D map of the Halifax Explosion. It was previously a work of art in the 麻豆传媒 Art Gallery and the Maritime Museum of the Atlantic to mark the 100th anniversary of the Halifax Explosion. The top of the table forms a solid, 3D map of the region where the explosion took place.听

听鈥淭he table was carved out of birch wood by a听computer-controlled machine at the Faculty of Architecture. We project a variety of current and historical maps and aerial photographs onto the surface of the table,鈥� explains Dr. Malloch. 鈥淭here is also a holographic layer you can interact with using an augmented reality headset.鈥澨�

The interactive display enabled guests to try out the Microsoft HoloLens while other patrons could see what they were seeing on a large display in the lab.

A piano

As a pianist and AI researcher, Dr. Oore was thrilled to use his lab鈥檚 newly acquired - and already AI-enabled - Yamaha Disklavier grand piano to showcase the interactive generative music systems that his graduate students and interns are developing. The grand piano is equipped with sensors and actuators that are connected to machine learning systems developed in his lab. Once trained on data from human performers, the ML system can generate signals that are sent to the piano that tell it how and what keys to play.

鈥淥ne of the fun things about this research is that while its core is machine learning, at a certain point it becomes interdisciplinary, and I love the diversity of collaboration that brings," says Dr. Oore. "Dr. Malloch helped us a lot with our installation and I collaborate a lot with my brother who is a musician, Dr. Dani Oore."

Dr. Oore's research combines different areas of study. Using AI, they explore how sounds work and try out new creative ideas.

HCI, Visualization and Graphics
听

With many exciting research possibilities on the horizon, the cluster is thrilled to have state-of-the-art equipment and ample space to work in.听

鈥淭he cluster has been regular contributors to the festival over the years, with exhibits at landmarks throughout the city. This is the first exhibit we have hosted at the new Paramount research facility on Barrington Street,鈥� Dr. Reilly explains.听

This year鈥檚 contribution marks the group鈥檚 eleventh installation and the ninth year of participating in the Nocturne festival. With a new space, the research cluster looks forward to participating in and hosting more events in the years to come.听

Read more about the intriguing research by the HCI, Visualization and Graphics cluster through听,听Dr Malloch听and听Dr Reilly鈥檚 work.