Jukedeck's at Sónar+D Innovation Challenge: The composer’s assistant



thank you thank you guys if you wanna try the the prototype of the guys you have to go to the other side of the building passing the the market lab and you will find us there so now we will go back to the to Juke Tex team that they are going to introduce us to the composers assistants can we have the computer into the screen please so hello I am one of the mentors from tech tech innovation challenge we're not on based company and our mission is to create a music generation system using artificial intelligence and we want to fuel creativity using musical AI so our main product is called make and you can find it in our website where you can have a variety of music styles and you can generate a track with a particular mood and duration so we are here to present the API of our company which can produce the audio of a track also the MIDI representation of this audio track and also MIDI loops everything that you will hear today is provided by our system so everything is generated using artificial intelligence I can also show you some examples of this type of audio tracks that you can have this is one demo track from the style pop it's another demo track from piano style so yeah you can play around and you can create this type of audio tracks and so the challenge idea was to explore how we can assist human musical creativity using an AI system like the one we provide and we wanted to see how our API can be used as a tool for human creativity and the goal of this challenge was to create a high-level tool that had music makers create music using the Juke the KPI so we want to demonstrate how we can have amateur or professional musicians and collaborate with AI so I'm living now the microphone to one of the participants so what we came up with was play AI a tool for a I assisted jam sessions so we got inspiration from chat rooms and we thought it would be interesting to create this place where you can go and find the room to play music you like or create your own room so you could based on a style you like you could go find one and AI would help you create music so I'm going to show you a small demo of the interaction then if you want to go check out the real functioning deal you can check it out at the booth so the idea is that you go to this application and these rooms you can create your own or you can browse the ones that are there so for instance this is this one is playing synth music so if you want to join in you can see that the rhythm section is free so you could join in the rhythm section but let's say you want to check out what else is there and there's this really cool 8-bit Jam happening and so here the melody and bass is free so you could join in on on this or you could later and later implementations also join as as audience as part of a an actual chat where the the chat would be kind of the audience to the to the players would actually be playing in these rooms so let's say I want to go in this piano party room and I'd get the I I would help me out by so I'm playing the harmony and the I I would suggest me three MIDI loops that I could choose from and if I don't like them I could refresh and it would give me other loops so I could change I could add it to the composition and later I could change individual notes or apply effects or change instruments all kinds of things yeah so if you want to check out the real deal you can go to the boots later hi everybody well we had to achieve some goals so now it's the boring part the technical stuff so we actually wanted to build a web application because we wanted everyone in the world to access this application and collaborate to create music so we use this access express jes to create a web server in order to provide the application to the web then we had to fit to fit them to the collaborative stuff so we use WebSockets in order to keep the client connected synchronized and so each one can see the part that other player and other places are playing together and then we had to download and create asked the API to create the midi loops and download it and so we created a proxy that actually wraps the joke deck API so give to the user when he hit the refresh button on in the application to download new loops and start generating new new music and then we had the problem of real time so we want to make music in the browser actually so we decided to use Tanja yes and that is a library that's built on top of web audio api just like same experimental technology but it works quite fine and so this helps us to solve all our technical problems what we are gonna do in the future is to add new MIDI editing features so the fact that now you can download Middies but you actually cannot change it so we want to add some human interaction with the AI so it's human player can add notes and change what the API generates according to his taste and when his musical tastes also we were gonna had audio effects using Web Audio API and one of the featured most interesting features that we discussed is the audience participation we want to create also the possibility for the audience to interact with what the players are doing with the application so we create we're gonna create some kind of feedback that the player can get from the audience and maybe we will give some control on features that we are listening maybe on some some effects to the audience during the performance so at this point we have an AI player and the audience is one playing together [Applause]

2 thoughts on “Jukedeck's at Sónar+D Innovation Challenge: The composer’s assistant

  1. Looks good, so eventually hit music from AI the first ever AI tune in the top 100 will be the milestone

Leave a Reply

Your email address will not be published. Required fields are marked *