MUSEVERSE: Music into the metaverse

chevron-icon
Back
project-presentation-img
Patrik Gudev
Project Owner

MUSEVERSE: Music into the metaverse

Funding Awarded

$40,000 USD

Expert Review
Star Filled Image Star Filled Image Star Filled Image Star Filled Image Star Filled Image 0
Community
Star Filled Image Star Filled Image Star Filled Image Star Filled Image Star Filled Image 0 (0)

Status

  • Overall Status

    🛠️ In Progress

  • Funding Transfered

    $20,000 USD

  • Max Funding Amount

    $40,000 USD

Funding Schedule

View Milestones
Milestone Release 1
$5,000 USD Transfer Complete TBD
Milestone Release 2
$3,000 USD Transfer Complete TBD
Milestone Release 3
$3,000 USD Transfer Complete TBD
Milestone Release 4
$3,000 USD Transfer Complete 09 May 2024
Milestone Release 5
$4,000 USD Pending TBD
Milestone Release 6
$6,000 USD Pending TBD
Milestone Release 7
$6,000 USD Transfer Complete TBD
Milestone Release 8
$10,000 USD Pending TBD

Status Reports

Mar. 13, 2023

Status
🙂 Pretty good
Summary

We have delivered the AI for key counter, which we are very happy. VR Piano: - Our current focus is on ability to write effectively scripts for playing piano in VR with hand-tracking by using the VR cameras. We have some first successful test of technology Passthrough and we are able to play some first basic interactions. We are almost ready to showcase the milestone VR Camera scripting. Low Latency Solution: - We have the first code solution ready. We are currently preparing User interface (UI) for it. We have a first drafts of possible UI and we are fixing the details for aiming to have the final design. Once we are done with it we will be deploying the code on websites. Metaverse integration: - We are currently working in parallel on integration into Somnium Space metaverse. We have the 3D models of the environment done and we are integrating some basic interactions into the metaverse. 3D Piano Model: - We have the 3D model, just we haven't moved forward with the rigging of the piano. We are prioritizing the Passthrough programming at this moment."

Full Report

Jan. 23, 2023

Status
😀 Excellent
Summary

I am happy with the development. We have some great progress in multiple milestones.

Full Report

Dec. 16, 2022

Status
🙂 Pretty good
Summary

All is good. We are very busy with the development.

Full Report

Nov. 11, 2022

Status
🙂 Pretty good
Summary

All is good on our end. We were a bit busy with the Prague event NFCastle, which we believe was successful. We are overall quite happy with the progress. We have new people on the team. We found an AI team lab in India that we are currently discussing collaboration with on the ML model scanning the piano.

Full Report

Aug. 20, 2022

Status
🙂 Pretty good
Summary

We have managed to put high qualified team for the VR development part of the project. The team leader of the development got Covid so we had a setback for a few weeks. Anyway, we made the first part of the research of the technology we going to use. We also got in touch with one developer that already made a prototype of projecting piano to the metaverse. We are talking about collaboration on this project with him. He can be a valuable addition to the team. In parallel, we are creating 3D environment for playing music in Virtual Reality. We made significant progress with this part. We will be integrating it directly to Somnium Space metaverse. We are finalizing all the legal documents for establishing a company so we should be able to sign the contract with SingularityNET in the following weeks to finally commit to our Deep Funding proposal. We appreciate the patience about this part, as it was not the fastest to establish a company over here.

Full Report

Video Updates

Museverse – Team meeting 5

16 March 2023

Museverse – Team meeting 1

15 March 2023

Museverse – Kickoff Presentation

15 March 2023

Projects Links

Video of piano being layed in 3D

Description

The first prototype of the VR Piano. We still have to put the correct sounds in the right key piano positions, so the sounds don't match well at this point, but the mechanics work very well. I am very happy with the progress.

Project AI Services

No Service Available

Overview

Play, jam, and perform music in the metaverse. Our vision is to build AI tools for composing and performing music in the backend on SingularityNET.We want to create an AI for analyzing musical instruments from physical space and projecting them into virtual reality. This provides an immersive experience of bridging reality with virtual reality in music production. As the first musical instrument, we have chosen a piano keyboardOnce we have this technology ready, we want to integrate it into these metaverses. 

  • Somnium Space
  • Victoria VR
  • Decentraland
  • Sandbox 
  • SophiaVerse

Proposal Description

Compnay Name

Museverse

Problem Description

Musical Instruments in VR

There is no immersive technology on a decentralized market that would project physical musical instruments into virtual reality. This is a barrier to composing and jamming music immersive in virtual reality. 

Jamming Music in the Metaverse

There is no network that would provide jamming music in the metaverse. Metaverse experience is only a live show without interactive musical instruments and no solution on how to play the physical musical instruments in VR.

SNET music section

SingularityNET could have a dedicated section for music production and music performing.

Solution Description

Musical Instruments in VR

Finding the most effective solution to create an AI algorithm for analyzing musical instruments in physical space and projecting them into virtual reality. This solution would provide an opportunity for creating VR applications for playing, composing, and collaborating on music in VR. As a solution, we see a bridge between the SNET marketplace and the Unity game engine. Our first target would be to find a solution for how to project a piano keyboard Into virtual reality. Finding a solution for projecting and connecting existing musical instruments into the VR environment is the first step toward integrating them into the metaverse.

Jamming Music in the Metaverse

We have designed a collection of the first interactive musical instruments playable in VR as NFTs and we have built a prototype of an interactive musical instrument playable in VR with our team. That is the first step toward jamming in the VR. Our goal is to integrate our system with SingularityNET and Jam Galaxy and figure out how to connect our technologies to SNET marketplace, Hyper Cycle, and Jam Galaxy ecosystem.

SNET music section

With a growing number of AI music applications, we would like to build a section under the SingularityNET marketplace that would motivate AI developers to participate in building an ecosystem for music production. We as Museverse would take care of opening the doors for integration of these tools into the decentralized metaverses.

Project Benefits for SNET AI platform

Our goal is to start a category under SNET AI platform that would focus on music production. Our vision is to long term contribute to building AI Dapps that would help with creating solutions for music playing, performing, and jamming in the metaverse.

We build direct collaborations with developer teams of the biggest decentralized metaverses like Sandbox, Decentraland, Somnium Space and VictoriaVR. We want to build a bridge between these metaverses and the SingularityNET platform to help grow the ecosystem. 

Another aspect is to open collaboration and build an alliance of music projects on the Cardano blockchain. We have arranged two main collaborations. One is with Revo Music. https://revomusic.ai

 Second is with project DEMU on Cardano blockchain.

 

Marketing & Competition

Social Media

We will use the traditional social media: Twitter, Discord, Instagram, Telegram

Metaverse

Our strategy for a good marketing plan is to be present in the metaverses. Metaverses have already its users and social media. Their established network will provide us with a way how to target their communities.

Artists Collaborations

We believe that the best way to have good marketing is to partner with artists that already have their fanbase. We would be creating NFT music instruments that would be as an artist series.

Live Events

Good marketing needs good content. Our part of the strategy is to organize hybrid events where the artist will perform live in the real event and at the same time in the metaverse.

Needed Resources

We want to build a collaborative group of talented people that focus on creating tools for music production. 

In this matter, we want to connect with SingularityNET and Jam Galaxy and find a way how to motivate AI programmers to collaborate and create new unique ways of music interaction in VR metaverses.

Long Description

We believe that music is an international language and a universal culture shared by all people. We are building a platform for metaverses to connect musicians all over the globe and build a space for creating music. Virtual reality is a tool that brings entertainment and, with the right architecture, promotes a new economic system. Taking advantage of technologies like NFT and blockchain allows to create digital value and to empower musicians through a decentralized system.

Our ambition is to change the music industry by connecting all metaverses through the Cardano blockchain and SingularityNET marketplace and making music accessible for everyone.

Metaverse

Metaverse is going to be everywhere. It is already here, in the same position as the internet was in the 90s. We believe that after what we have seen as the NFT boom, metaverse and 3D objects are going to be next. Our strategy is to connect and build on existing metaverses. Access to multiple metaverses means a higher chance to be in the right place.

List of metaverses we are integrating our ecosystem:

  • Somnium Space - We have 8 M parcels connected to one complex with Club, Showroom, Jamming stations (work in progress)
  • Decentraland …………………….Work in progress
  • Sandbox ………………………………Work in progress
  • Victoria VR..........................Work in progress
  • Neos.................................... Work in progress
  • SophiaVerse…………………………Planning
  • Pavia....................................Planning
  • Mona....................................Planning
  • Wilder World........................Planning
  • DVision.................................Planning
  • Blocktopia............................Planning
  • Sensorium Galaxy...............Planning
  • RFox.....................................Planning
  • NTVRK.................................Planning
  • Solice...................................Planniing

Every metaverse has a bit different functions and it can allow us to do a bit different types of integration. Our preference is to build on metaverses that support Virtual Reality, decentralized ownership and possible AI integration.

Cardano

We consider Cardano as the most effective blockchain system for our vision. Starting building the system on Plutus smart contracts gives us powerful tools to build a solid music ecosystem. Future systems like Hydra and Voltaire provide us with the opportunity to effectively scale with the number of blockchains and integrate governance systems for music bands to manage them as a small DAO.

SingularityNET

SingularityNET has an incredible potential for being the leading decentralized ecosystem for AI algorithms forwarding to Artificial General Intelligence. Our goal is to build our AI solutions on top of the SingularityNET system. The future vision is to build an AI smart tools category for music production and smart tools for performing music in virtual reality.

These are segments of our future ambitions to be integrating for music production in the metaverse:

  • AI image segmentation as tool helping distributing rewarding pools for artists, club owners and developers
  • AI for creating original sounds
  • AI for automatic sound design balancing
  • AI for Instrument type recognition
  • AI for instrument shape recognition
  • AI for music recommendation
  • Reputation system
  • Future AI-DSL integration to interaction between musical AI
  • SophiaDAO integration as an AI operator in the metaverse

AI Services

Proposal Video

Placeholder for Spotlight Day Pitch-presentations. Video's will be added by the DF team when available.

  • Total Milestones

    8

  • Total Budget

    $40,000 USD

  • Last Updated

    13 May 2024

Milestone 1 - Project start

Status
😀 Completed
Description

Signed Contract

Deliverables

Budget

$5,000 USD

Link URL

Milestone 2 - VR Camera Scripting

Status
😀 Completed
Description

Ability to connect to the VR headset cameras and write codes for designing functions in the Unity engine.

Deliverables

Budget

$3,000 USD

Link URL

Milestone 3 - 3D Model Piano

Status
😀 Completed
Description

3D model rigged and mapped to be playable in virtual reality

Deliverables

Budget

$3,000 USD

Link URL

Milestone 4 - First Prototype

Status
😀 Completed
Description

The first prototype of projection of VR piano

Deliverables

Budget

$3,000 USD

Milestone 5 - Low - Latency Solution

Status
🧐 In Progress
Description

Technology that would allow as low as possible latency suitable for playing piano in VR

Deliverables

Budget

$4,000 USD

Link URL

Milestone 6 - AI Sync

Status
😐 Not Started
Description

AI solution for projecting keys into XYZ axes synced with the real piano

Deliverables

Budget

$6,000 USD

Link URL

Milestone 7 - AI Keys Counter

Status
😀 Completed
Description

AI solution for counting the number of keyboards

Deliverables

Budget

$6,000 USD

Link URL

Milestone 8 - SNET service

Status
😐 Not Started
Description

Back end servers infrastructure

Deliverables

Budget

$10,000 USD

Link URL

Join the Discussion (0)

Reviews & Rating

New reviews and ratings are disabled for Awarded Projects

Sort by

0 ratings

Summary

Overall Community

0

from 0 reviews
  • 5
    0
  • 4
    0
  • 3
    0
  • 2
    0
  • 1
    0

Feasibility

0

from 0 reviews

Viability

0

from 0 reviews

Desirabilty

0

from 0 reviews

Usefulness

0

from 0 reviews