Short Description: This project will extend KodaDot NFT explorer with the ability to showcase, render and interact with NFTs in extended reality. The main idea is to leverage existing technology to show NFT items in AR/VR, i.e. create interaction leveraging Subsocial on particular NFT items in XR, make it compatible with an existing headset like Oculus, Hololens, Magicleap and make it compatible viewable through usual Android or iOS smartphone device.
Original proposal document on past grant M1 and upcoming M2 could be found here
1. Context of the proposal
The main delivery is to implement basic WebXR (AR/VR) implementation of NFT assets to render them in customizable metaverses in a low-poly model and create an ability to interact with them, make transactions, manipulate them in space.
2. Problem statement
- Right now there is no metaverse movement around Kusama.network
- There is known bit.country yet doesn't provide anything accessible right now.
- We think that webXR Device API will be probably a new way to interact with future content on the web.
3. Functional objectives
- Linkable ephemeral scenes to explore in metaverse nature
- Model viewer of 3D models - Proof of work here
- Create a multi spatial experience in web XR using RMRK.app, i.e. interactive virtual galleries
- Possibility to set the position of objects in space and combine them together
- Integration Subsocial for deeper interaction within XR assets
- Specific web XR interface for better interaction with web XR devices
- Create collaboration surface in Metaverses for Kusama
Milestone 2: duration 6 weeks (covered on this treasury proposal) - 27,000 EUR
Deliverables
- Research on AR/VR architecture and how assets could be explored in metaverse
- Create page & components which displays selected NFTs in AR/VR space by user or address of asset
- Implement sharable ability through links
- Write implementation for showing metadata for particular NFT
- Ability to view collection in AR/VR - putting NFT in the 3D space
- Co-operation with AR/VR experts to get best industry standards in place in works
- Possibility to set position of objects in space and combine together
- Create WebXR scenes to combine multimedia assets (images, audio, video, 3d objects)
- Integration Subsocial for deeper interaction within XR assets
- Specific WebXR interface for better interaction with webXR devices
- Release open source library to interact with RMRK on Kusama through AR/VR
- Documentation of open source library
- Support for common AR and VR headsets like Oculus Quest (2) and AR headsets like nReal, Magic Leap and Holo Lens
- Cover partially acquisition costs for HW like
Oculus Quest 299USD
MagicLeap or HoloLens2, what’s more accessible to deliver to develop for best webXR experience for headsets (approx HL2 3500USD, ML 2440GBP)
- Device for creating LiDar scans - most viable option we’ve found is iPhone12 Pro (1150EUR)
The team behind it
- Matej Nemcek (@yangwao) - Co-Founder of KodaDot, VueJS background, more info hypersignal.xyz
- Viktor Valastin (@vikiival) - Co-Founder of KodaDot, Publication about carsharing dApp on ETH using ERC721 token composition. Working for a company which is creating car-management software(React, Spring) and R&D in blockchain.
Team Code Repositories
Work being already done towards this proposal