Overview
Imagine you want to teach the next generation of star DJs across the world how to become the best DJ they can, All without equipment. That's exactly what TribeXR has done and is still doing. TribeXR is funded by boostVC, the futureforward VC firm that has funded the likes of Coinbase and has exited over 22 companies. Tribe was looking to understand if users can effectively learn DJing in VR and to get feedback on the introductory lessons they crafted with the help of industry-leading DJs. They needed to do extensive playtesting and user research on the new beta content before releasing to all of their users. I was brought in as a consultant to help test the learning design experience and find out what users thought about the tutorials and if they were able to complete them.
Company Mission
The Tribe XR is a software company that makes it easy for anyone to learn real-world skills in VR and AR
The company harnesses VR and AR to enable people to learn real-world skills. Learning by doing is scientifically proven to cement knowledge better than watching videos, reading, or sitting in class.
With this in mind, I approached this research looking to see if f Tribe XR inspired curiosity, fun, immersion, and provided adequate learning comprehension.
The company harnesses VR and AR to enable people to learn real-world skills. Learning by doing is scientifically proven to cement knowledge better than watching videos, reading, or sitting in class.
With this in mind, I approached this research looking to see if f Tribe XR inspired curiosity, fun, immersion, and provided adequate learning comprehension.
Services Provided
Heuristic evaluation.
User testing with 2 participant live.
Tested the onboarding experience
Tested the Deck overview tutorial
Tested video calls, and rooms
Tested the live lesson experience in VR and web
User testing with 2 participant live.
Tested the onboarding experience
Tested the Deck overview tutorial
Tested video calls, and rooms
Tested the live lesson experience in VR and web
Technical Details
(Testing completed on oculus quest 2 Latest version update (35) 0.09.8.2 - Beta channel)
Standing room scale stationary guardian.
Standing room scale stationary guardian.
Qualitative User Testing Goals
- Testing Goals: Can a user go from 0 to 1 in understanding of DJing after completing onboarding?
- Can the tutorial reduce the fear of learning something new and complex like Djing and inspire curiosity to learn more?
- Did they have fun?
- Are they immersed?
- Track Heart Rate
- Did they learn?
- Can a user complete basic tasks (Example: change set, change avatar, etc) Task completion
- Can a User navigate through the menu with ease?
- Uncover usability problems
- Do they get motion sickness?
- Uncover Accessibility issues.
Heuristic evaluation Goals
Uncover bugs and usability issues from an expert perspective.
Look at the fine details, every pixel matters.
Keeping Tribe’s mission in mind, look for opportunities to innovate and better the experience in any way possible. "These include feature development and business"
Make things more understandable.
Reduce as much cognitive load as possible.
Content audit
Optimize information architecture.
Align with VR standards.
Look at the fine details, every pixel matters.
Keeping Tribe’s mission in mind, look for opportunities to innovate and better the experience in any way possible. "These include feature development and business"
Make things more understandable.
Reduce as much cognitive load as possible.
Content audit
Optimize information architecture.
Align with VR standards.
Test 1 findings
- Fonts on the deck screen appear small.
- Friendslist needs to be more of a friendslist.
- Users need to be able to adjust audio levels in a video call.
- Users need to be able to adjust screens in a video call.
- There are more opportunities to pitch tribe+ to the user in the app.
- The menu is blocked by users avatar’s in Rooms.
- Turning knobs could be more sensitive.
- What the settings do can be confusing to users and how changing them effects the experience is unclear.
- There is an awful static sound when someone joins a video call.
- There was a gamebreaking bug occurring where users could hear me at my home screen and I could not see them but could hear them
User Test Findings (Part 2)
- The order of teaching volume controls confused the user on the intro tutorials.
- Needle search label placement obstructs users view of deck timeline.
- DJ coach gets in the way forcing user to potentially exit playfield.
- DJ coach taking too long to demonstrate something.
- Muting the mic in a video call is too confusing to a user.
- Changing camera settings is confusing to a user.
- Starting to DJ with someone in a room is too confusing and difficult for a new user.
- User confused by deck breakdown tutorial // its not clear what the narrator is referring to on the deck.
- sticks block ray interaction with menu.
- State of tutorial in deck breakdown is confusing.
- The state of tooltips is confusing to a user.
Conclusion
After the UX research was concluded the team ended up shipping the beta version of the update which included a lot of new features which included things like the selfie stick, and the tutorial lessons covered to name a few.
All of the suggestions mentioned in the videos have been handed off to the game design team and have been resolved.
All of the suggestions mentioned in the videos have been handed off to the game design team and have been resolved.
Take a look at what the CEO of Tribe XR said regarding the work I did:
