Shimon, robotic marimba player, Georgia Tech Center for Music Technology, Georgia Institute of Technology, Atlanta, Georgia, USA

[Airicist]

Georgia Tech Center for Music Technology (https://pr.ai/showthread.php?10234)

Website - shimonrobot.com (https://www.shimonrobot.com)

facebook.com/ShimonRobot (https://www.facebook.com/ShimonRobot)

twitter.com/shimonrobot (https://twitter.com/shimonrobot)

instagram.com/shimontherobot (https://www.instagram.com/shimontherobot)

Artist - Mason Bretan (https://pr.ai/showthread.php?10232)

[Airicist]

https://youtu.be/qy02lwvGv3U

Human-Robot Jazz Improvisation (Full Performance)

Uploaded on Apr 22, 2009


The stage debut of Shimon, the robotic marimba player. Also, the world first human-robot rendition of Duke Jordan's "Jordu", for human piano and robot marimba.

Programmed and performed by:
Guy Hoffman (https://pr.ai/showthread.php?4666)

[Airicist]

https://youtu.be/gm9R05PMHDM

ZOOZbeat and Improvising Robot 'Shimon' Jammin'

Uploaded on Dec 9, 2009


ZOOZbeat Founder and Chief Technology Officer Dr. Gil Weinberg will jam live from SIGGRAPH Asia 2009 emerging technologies conference in Yokohama, Japan December 16-19, 2009 with Shimon; a perceptual and improvisational autonomous robotic marimba player he created at Georgia Tech Center for Music Technology.

At SIGGRAPH Asia 2009, musicians and non-musicians will also be ZOOZin' it with Shimon.

[Airicist]

https://youtu.be/jsGgo8pyNrw

Shimon - Georgia Tech Improvising Robot - US Science & Engineering Festival

Uploaded on May 3, 2011

[Airicist]

https://youtu.be/KoIQAmQQErk

N-400: Shimon highlights

Published on Apr 29, 2012


A compilation highlighting Shimon, the robotic marimba improvisor, interacting with conductor Andrea Brown and the Georgia Tech Orchestra playing N-400 by Gil Weinberg. Shimon programing: Yoantan Sasson, Sisi Sun and Yanlin Chen

[Airicist]

https://youtu.be/GAaibJvDsQQ

Published on Oct 27, 2014


Some highlights showcasing different functionalities for the Shimon robot

[Airicist]

https://youtu.be/HqqA3g_pgfc

Jazz With Robots: The Dance of Jupiter & Venus

Published on Apr 23, 2015


At the College’s 24th Annual Awards Ceremony, held April 21, 2015, attendees were treated to a musical performance only possible at Georgia Tech. Shimon, the robotic improvisational jazz musician created by Gil Weinberg of Georgia Tech’s Center for Music Technology, accompanied three graduate students in the performance of “The Dance of Jupiter and Venus.” Shimon’s fellow bandmates included Mason Bretan, a Ph.D. student in music technology, and Deepak Gopinath and Takahikio Tsuchiya, both M.S. students in music technology.

[Airicist]

https://youtu.be/o4tSY9aNeOI

Published on May 30, 2015

[Airicist]

https://youtu.be/X2Ht_jYAOao

Shimon robot and friends demo reel

Published on Aug 10, 2015

[Airicist]

https://youtu.be/wtiE19O3M-4

Shimon Robot and Friends in Istanbul

Published on Apr 19, 2016

[Airicist]

https://youtu.be/8UKEAKJtjEM

Google music 2

Published on May 30, 2016

[Airicist]

https://youtu.be/lDckZCORThw

Shimon In Flux

Published on Dec 14, 2016


Shimon listens and responds to In Flux. Triggers from drums and pitch detection from guitar drive Shimon's improvisation.

[Airicist]

https://youtu.be/j82nYLOnKtM

Deep Shimon

Published on May 3, 2017


The robot Shimon composes and performs his first deep learning driven piece. A recurrent deep neural network is trained on a large database of classical and jazz music. Based on learned semantic relationships between musical units in this dataset, Shimon generates and performs a new musical piece.

Developed by Mason Bretan, tHE Robotic Musicianship Group, Georgia Tech Center for Music Technology

[Airicist]

https://youtu.be/t0z9t5p2Sn8

AI Song - Shimon Robot at the Atlanta Science Festival

Published on Mar 14, 2018


A sneak peek of Zachary Robert Kondak's new song, as part of our new rock-opera composed and performed by both human, robots and cyborgs. Zach may be onto something here. With Shimon Robot, Richard Savery and Jason Barnes. Performed at the Ferst Center Presents as part of Atlanta Science Festival

[adi898]

My friend has got an awesome blog for acoustic guitar lover with the latest techs and training classes.
Check out masterguitarguide.com/blog/how-to-choose-an-acoustic-guitar-pickup (https://www.masterguitarguide.com/blog/how-to-choose-an-acoustic-guitar-pickup).

[Airicist]

https://youtu.be/mDleoK3xZsY

Shimon sings

Feb 24, 2020


Shimon the Robot has been reborn as a singer song writer.

[Airicist]

https://youtu.be/sHl-Cg2KDbg

Into your mind by Shimon the robot

Feb 24, 2020


A first single from the upcoming album "Shimon Sings," scheduled to be released 4/10/2020.

[Airicist]

https://youtu.be/BOck0kPtlfk

Shimon: singer and songwriter

Feb 26, 2020


Shimon, the marimba playing robot, has added a new skill to his musical repertoire: singing and songwriting. Dr. Gil Weinberg and his team of Ph. D. students have reconfigured Shimon to use deep learning and artificial intelligence to write his own lyrics and collaborate with human musicians to create completely original compositions.

[Airicist]

https://youtu.be/Ufk9Fv4h4Ao

Shimon: singer, songwriter robot

Mar 12, 2020


Shimon, the marimba-playing robot, has learned some new skills: He sings, he dances a little, he writes lyrics, he can even compose some melodies. Now he’s taking them on the road in a concert tour to support a new album — just like any other musician. The new album will have eight to 10 songs Shimon wrote with his creator, Georgia Tech Professor Gil Weinberg. It will drop on Spotify later this spring. “Shimon has been reborn as a singer-songwriter,” Weinberg said. “Now we collaborate between humans and robots to make songs together.”

Weinberg will start with a theme — say, space — and Shimon will write lyrics around the theme. Weinberg puts them together and composes melodies to fit them. Shimon can also generate some melodies for Weinberg to use as he puts together a song. Then, with a band of human musicians, Shimon will play the songs and sing. “I always wanted to write songs, but I just can’t write lyrics. I'm a jazz player,” Weinberg said. “This is the first time that I actually wrote a song, because I had inspiration: I had Shimon writing lyrics for me.”

Weinberg and his students have trained Shimon on datasets of 50,000 lyrics from jazz, prog rock, and hip-hop. Then Shimon uses deep learning, a class of machine learning algorithms, to generate his own words. “There are lots of systems that use deep learning, but lyrics are different,” said Richard Savery, a third-year Ph.D. student who has been working with Shimon over the past year on his songwriting. “The way semantic meaning moves through lyrics is different. Also, rhyme and rhythm are obviously super important for lyrics, but that isn't as present in other text generators. So, we use deep learning to generate lyrics, but it's also combined with semantic knowledge.”

Savery offered this example of how it might work: “You'll get a word like ‘storm,’ and then it'll generate a whole bunch of related words, like ‘rain.’ It creates a loop of generating lots of material, deciding what's good, and then generating more based on that.” When Shimon sings these songs, he really does sing, with a unique voice created by collaborators at Pompeu Fabra University in Barcelona. They used machine learning to develop the voice and trained it on hundreds of songs.

Along with his new skills — all developed in Weinberg’s lab — Shimon has some new hardware, too, that changes how he plays and moves on stage. To be clear, he’s still mostly stationary, but he has a mouth, new eyebrows, and new head movements designed to help convey emotion and interact with his bandmates. He also has new “hands,” that have totally changed how he plays the marimba.

“Shimon plays much faster — about 25 to 30 hertz at the maximum — and also much more expressively, playing from a soft dynamic range to a strong dynamic range,” said Ph.D. student Ning Yang, who designed all-new motors and hardware for Shimon. “That also allows [Shimon] to do choreography during the music being played.”

For example, Shimon can count in at the beginning of songs to cue the band, and sometimes he’ll wave his mallets around in time to the music. New brushless DC motors mean he has a much greater range of motion and control of that motion. Yang accomplished that by bringing his engineering knowledge and musical background together to create human-inspired gestures.

“It's actually a very, very good example at Georgia Tech that we can actually combine tech and arts together to create something that's brand new,” Yang said. He worked closely with fellow Ph.D. student Lisa Zahray, who created a new suite of gestures for the robot — including how he uses those new eyebrows.

“We have to think about his role at each time during the song and what he should be doing,” Zahray said. “We also want to make sure he's interacting with the other musicians around him to give that feel that he's performing with people.” That partnership with people is key for Weinberg. Teaching Shimon new skills isn’t about replacing musicians, he said.

“We will need musicians, and there will be more musicians that will be able to do more and new music because robots will help them, will generate ideas, will help them broaden the way they think about music and play music,” Weinberg said.

Shimon, Weinberg, and the entire band are building a touring schedule now with the goal of taking their unique blend of robot- and human-created music to more people. Weinberg said he hopes those shows will prove to be more than a novelty act.

Shimon was originally developed with support from the National Science Foundation Cyber-Human Systems program, grants No. 0713269, and 1017169.

[Airicist]

https://youtu.be/CtESlHUNsTo

Earth to see by Shimon the robot

Apr 23, 2020


Shimon the Robot's Performance at the Fox Theatre in Atlanta Georgia

[Airicist]

https://youtu.be/wcft3gcspzs

Gospel in Space by Shimon the Robot

Apr 23, 2020


Robotic singer song write Shimon wrote the lyrics for this song based on the theme of "space and time." Playing marimba, Shimon improvises in responds to the musical motifs composed by humans.

[Airicist]

Article "This Robot Can Rap—Really (https://www.scientificamerican.com/article/this-robot-can-rap-really)"
Deep-learning robot Shimon writes and rhymes in real time

by Shi En Kim
December 4, 2020