The Turing Test is a concept in artificial intelligence proposed by pioneering British mathematician and computer scientist Alan Turing. It is a test designed to evaluate whether a machine can exhibit intelligent behavior indistinguishable from that of a human.
A musical Turing test is a variation of the original Turing Test concept, but instead of testing a machine's ability to mimic human conversation, it evaluates whether AI-generated music can be distinguished from music created by human composers or performers.
This M.O. Free*Man website page describes a Musical Turing Test developed by M.O. Free*Man to test SUNO AI with regard to its capabilities in:
1. Writing Song Lyrics
2. Lead Vocal Performance in songs it produces
3. Musical composition and performance regarding melodies, instrumental performance, and song arrangement.
Details of how to take the Turing Test for SUNO AI are given below. The song Turing Test (click the link on this page to hear it) also gives additional information, along with being the first song in the Turing Test series of songs/albums.
If you wish to submit your answers to the test, in order for M.O. Free*Man to determine whether SUNO AI passes a Musical Turing Test, please email your Turing Test answers to: M.O.Free.Man.Music@gmail.com
(Text generated in part by ChatGPT. ChatGPT has passed a Turing Test, by the way.)
The M.O. Free*Man Turing Test for SUNO AI
There are six albums comprising the M.O. Free*Man Music Turing Test. This Turing Test is specifically for Suno AI.
These six albums are:
1. Turing Test 1: Contemporary Country
2. Turing Test 2: Blues Rock
3. Turing Test 3: Jazzy Pop
4. Turing Test 4: Jazz Instrumentals
5. Turing Test 5: Jazz Fusion Instrumentals
6. Turing Test 6: Instrumental Jazz Subgenres
The First aspect of the Test is a Turing Test regarding AI vs human generated lyrics. Lyrics Specifically! This is the first three albums, with three different sets of songs in different musical genres: Contemporary Country, Bluesy Rock, and Jazz-flavored Pop tunes. Listen to these albums, and for each of the 35 songs in those three albums score each song regarding whether you think the lyrics are:
A. Entirely Human Generated
B. Entirely/Almost Entirely AI Generated
C. Can’t Tell a Difference
Ignore the melody, the singing, and the musicianship. This aspect of the Turing Test is to ask you whether Suno AI’s generated lyrics are readily distinguishable from lyrics generated entirely by a human lyricist. It’s ok to only listen to one genre of music, and only score those songs, if you prefer. But for statistical reasons it is important to score all the songs on a single album if you choose to go that route.
The Second Aspect of the Turing Test is regarding the vocal performance of Suno AI. This aspect of the test also uses the first three albums of the test. Regarding the lead vocalist specifically, after listening to the songs, score the lead singer on the following scale:
1. Sounds nothing at all like a human
2. Easy to distinguish from a human
3. Hard to distinguish from a human
4. Sounds like a human
5. Sings better than most humans can sing
For this aspect of the test, the AI voice used for the lead singer is the same for all the songs. No human sang on any of the songs. You may only need to listen to a few songs to make your determination, but if you choose to use that approach please listen to at least 1 or 2 songs from each of the three genres of music. Vocal stylings may make a difference in your perception of the vocalist.
The Third Aspect of the Turing Test is regarding the melodic and instrumental performance of Suno AI. All the songs on all six albums are relevant to this aspect of the Turing Test. This is focused on the musical parts of the song, ignoring the vocals and lyrics for songs that have those components. No humans performed any of the instrumental parts on any of these albums. For this test listen to the musical performance, song arrangements, and musical melodies and score the songs overall on the following scale:
1. This doesn’t even qualify as instrumental music
2. Sounds like none of the musicians can play their instruments
3. Sounds like a mediocre garage band
4. Could be aspiring professional musicians or music students
5. On par with records made by professional musicians
To help you focus on the music without the distraction of lyrics and singing, the last three Turing Test albums are entirely instrumental songs. For the Third Aspect of the test you can just focus on one of these albums if you prefer to, in terms of making your evaluation.
All three of the “instrumental alone” albums were produced in the instrumental jazz genre, for several reasons. Jazz has a strong history of outstanding bodies of work that are entirely instrumental; jazz instrumentals tend to have a strong foundation in music theory and complexity; and in general instrumental jazz is one of the more demanding types of musical performance for human instrumentalists. In other words, the bar for musical performance is set pretty high for jazz instrumental recordings in particular, versus some other genres like ambient music or easy-listening background music. For these reasons Jazz was chosen as the preferred genre for evaluating musical performance by Suno AI.
More Background on Turing Tests…
According to ChatGPT**:
The Turing Test is a concept in artificial intelligence proposed by British mathematician and computer scientist Alan Turing in 1950. It is a test designed to evaluate whether a machine can exhibit intelligent behavior indistinguishable from that of a human.
How it works:
There are three participants: a human judge, a human, and a machine (AI).
The judge interacts with both the human and the machine through text-based communication (e.g., chat).
The judge’s task is to determine which participant is the human and which is the machine.
If the judge cannot reliably tell which is which, the machine is said to have "passed" the Turing Test.
Key idea:
The test doesn't evaluate whether the machine is intelligent, but whether it can simulate human conversation well enough to fool a person.
Why it matters:
The Turing Test was one of the earliest and most influential ideas in the philosophy of AI. It shifted the question from "Can machines think?" to "Can machines behave as if they think?"
What is a Musical Turing Test?
From ChatGPT**:
A musical Turing test is a variation of the original Turing Test concept, but instead of testing a machine's ability to mimic human conversation, it evaluates whether AI-generated music can be distinguished from music created by human composers or performers.
How It Typically Works:
Blind Listening Test:
Listeners are presented with a set of musical pieces.
Some pieces are composed or performed by humans, and others by AI or algorithms.
The listeners do not know which is which.
Judgment:
The listeners are asked to guess which tracks are human-made and which are machine-generated.
If they can't reliably tell the difference, or if AI pieces are frequently mistaken for human compositions, the AI is said to have passed the musical Turing test.
What Is Being Tested?
Creativity
Emotional expressiveness
Musical structure and coherence
Authenticity in style or genre
The core question is: Can a machine create music that feels human-made — in emotion, style, and structure — to a trained or untrained ear?
Examples in Practice:
AI composers like OpenAI’s MuseNet or Google’s Magenta have been tested in these ways.
In some experiments, even professional musicians have been fooled by AI-generated compositions.
Music competitions or academic studies sometimes include musical Turing test-like evaluations.
Why It Matters:
A musical Turing test shifts the question from "Can AI mimic human conversation?" to "Can AI be artistically expressive like humans?" It's a challenge not just of technical mimicry, but of creative authenticity.
** These descriptions of Turing Tests are the only components of the writing in this website that were generated entirely by an AI. The human part of M.O. Free*Man doesn’t really agree with these viewpoints completely, but let the descriptions stand as written by Chat GPT because it represents a valid and independent viewpoint.
-
Turing Test 3:520:00/3:52
-
0:00/3:39
-
Deerfoot Trail 4:170:00/4:17
-
0:00/3:52
-
0:00/4:08
-
0:00/4:11
-
0:00/4:26
-
Sweet Summer 4:250:00/4:25
-
Purple Heart 5:160:00/5:16
-
0:00/3:07
-
Last Night 2:290:00/2:29
-
A New Kind Of Blues 4:020:00/4:02
-
One More Try 4:180:00/4:18
-
Until You Saved Me 2:530:00/2:53
-
Blues Beyond Words 3:310:00/3:31
-
Fat Paycheck 3:140:00/3:14
-
0:00/2:55
-
Trouble Follows Me 3:130:00/3:13
-
You Come and Go 4:150:00/4:15
-
0:00/2:24
-
Mojo Black 3:180:00/3:18
-
0:00/3:00
-
0:00/4:17
-
You Light My Way 4:150:00/4:15
-
0:00/4:12
-
If I Could Only Fly 4:020:00/4:02
-
0:00/3:42
-
0:00/3:47
-
I'm Not Looking Back 4:260:00/4:26
-
Miami Breeze 4:200:00/4:20
-
0:00/3:50
-
Black to White 4:100:00/4:10
-
0:00/3:52
-
Faith Hope Love 3:130:00/3:13
-
0:00/3:35
-
168th Street Stop 5:200:00/5:20
-
Boys Night Out 4:280:00/4:28
-
1 Train 4:230:00/4:23
-
Washington Heights 3:000:00/3:00
-
Wall Street Keys 4:140:00/4:14
-
Three Cadenzas 3:420:00/3:42
-
Broadway Lights 4:200:00/4:20
-
M.O. Blues 4:250:00/4:25
-
JFK Express 3:370:00/3:37
-
Some Guys Named Moe 5:170:00/5:17
-
Encore 7:140:00/7:14
-
Wannabe Metheny 4:350:00/4:35
-
0:00/3:32
-
Wannabe Jarrett 4:260:00/4:26
-
0:00/4:05
-
Wannabe Carlton 4:470:00/4:47
-
0:00/3:29
-
Wannabe DiMeola 5:270:00/5:27
-
Wannabe Freddie 5:110:00/5:11
-
0:00/5:07
-
Wannabe Woodie 5:050:00/5:05
-
0:00/4:22
-
Mercury Experimental 3:260:00/3:26
-
Venus Experimental 3:300:00/3:30
-
Terra Experimental 4:280:00/4:28
-
Luna Experimental 2:410:00/2:41
-
Mars Experimental 3:320:00/3:32
-
Phobos Experimental 3:460:00/3:46
-
Saturn Swing 3:090:00/3:09
-
Jupiter Be Bop 3:140:00/3:14
-
Be Bop Uranus 3:370:00/3:37
-
Be Bop Neptune 2:580:00/2:58
-
Ganymede Hard Bop 6:430:00/6:43
-
Callisto Cool 3:290:00/3:29
-
Io Free 3:370:00/3:37
-
Free Europa 4:500:00/4:50
-
Rhea Modal 4:400:00/4:40
-
Titan Funk 4:120:00/4:12
-
Funk Dione 4:100:00/4:10
-
Iapetus Latin 3:030:00/3:03
-
Latin Tethys 4:570:00/4:57