THIS CONTENT IS BROUGHT TO YOU BY University of Oslo - read more

ZRob in action.

This newly developed robot can play the drums, listen, and learn

The robot ZRob can create new rhythms and play the drums faster than humans can.

Frilanser
Presented by: University of Oslo
Published

It seems simple: The robot ZRob, a small machine easily placed on a table, holds a drumstick and beats a drum.

In reality, it is anything but simple. ZRob's arm has a flexible grip, just like the human wrist. It also has an artificial intelligence (AI) that helps it optimise its movements.

If you put several ZRobs together, they can play drum rolls, which requires very fine movements. They can also play rhythms entirely different from what humans can achieve but with a touch of human sensitivity. 

“Playing together, the robots will find a pattern unlike everything else,” Mojtaba Karbasi says. 

He has developed ZRob as part of a doctoral thesis at the University of Oslo's RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion.

A bio-inspired approach

Humans still manage several tasks better than robots. Humans are far more complex. For instance, we can see a glass of water, estimate its weight, and thus lift it without spilling.

Mojtaba Karbasi is a researcher at the University of Oslo.

“Humans talk, move, and touch things. We have several senses and can act on what we sense with adapted movements. Machines cannot do this,” says Alexander Refsum Jensenius. 

He is a professor at RITMO and Karbasi's supervisor.

Jensenius believes that machines will have to become multimodal – meaning that they have more senses – if they are to interact well with people in the future. Karbasi had this in mind and used a so-called bio-inspired approach when developing ZRob and the AI model that comes with it.

Similar to a human wrist

“We are not trying to copy a human, but rather to take the human body as a starting point. Musical robotics is a controlled way of working with this. It does not have potentially dangerous consequences,” says Jensenius. 

One of the things that makes ZRob more human is his arm. Two springs – one on each side – give the arm some of the flexibility of the wrist.

The springs and the AI make the robot adaptable, an important feature when hitting a drumhead in motion.

ZRob has two senses: It listens and can sense where its arm is.

The body of the robot shapes the behaviour

Karbasi explains that the springs in the various versions of ZRob are of different sizes. The AI helps each robot to find its behaviour.

This is what ZRob looks like.

“If a robot is trying to play a double stroke, it wants to find the right action parameters to execute it. If you change the springs, the behaviour will change, too. The robotic body thus helps to shape the behaviour,” Karbasi says.

If several robots play simultaneously, you may hear rhythms humans cannot play. 

“Different physical characteristics completely shape the output. It is like a piano piece played by 40 fingers – unpredictable, and it is hard for humans to imagine how it was produced,” he says.

Unique in its own way

He does not believe that this kind of music can touch people the same way as human-made played music. Nevertheless, he believes that his robots can inspire musicians.

“A robot that precisely mimics human behaviour is not inspiring. Then humans could do the same, even better. However, if we manage to create robots that take some humanity into them but are unique in their way, it inspires to a much greater extent,” says Karbasi.

It also opens up new possibilities; he adds and mentions the newly developed robots of the company Boston Dynamics: The robots resemble humans, but have a different way of standing up and can even turn their upper body 360 degrees.

Robots cutting cucumbers?

Alexander Refsum Jensenius believes that ZRob is interesting for musicians since it can create new types of rhythms and play faster than humans play.

In addition, it can be a practical help.

“If you play the guitar and sing, you can get a drum robot to play with you. If you are a drummer who has lost an arm, you can use a robot as a replacement,” Jensenius says. 

The research also has a high transfer value, according to Jensenius.

“If we manage to create complex drum robots that sense and adapt their behaviour accordingly, we are closer to creating robots that can perform other types of actions, such as lifting a glass of water or cutting a cucumber without problems,” he says. 

More content from the University of Oslo:

music university of oslo partner technology robotics
Powered by Labrador CMS