Next AR is a project exploring NEW social interactions based on AR technology

“We are building a social AR experience for the future!”

Trailer video

Social Interactions

AR Experience

Multi-Player Game

Next-AR is a Carnegie Mellon University Entertainment Technology Center Silicon Valley (CMU ETC-SV) student project that is creating a multi-player social augmented reality(AR) experience for players who are not necessarily in the same physical space.

Since AR technology has been widely used in many fields mostly as a single-player experience in recent years, our team decided to explore more especially in whether the technology can be used to establish social connections and enhance relationships between players. We use various gesture interactions combining with shared virtual space forms to achieve an intuitive and innovative social AR experience.

Learn more through our Final presentation

Production Timeline

Week 1
Week 2
Week 3
Week 4

Week 1

Getting to know us
  1. Kick-off meeting with Carl and Melanie
  2. First faculty meeting, we make our goal clear: Create a multi-player AR experience for two players who are not necessarily in the same physical space. We are suggested to brainstorm more and do tons of prototypes. After that, we can decide on the most fun and engaging one then dive into it!
  3. We tried several existing projects and started brainstorming

Learn more: Blog-Week 1

Week 2

Research on existing projects
  1. We tried three demos of Pupil and tried Ako(Some parts didn’t work, but we got the experience).
  2. Jamie worked on the branding design and here are several sketches she made(Attached).
  3. We continued research on articles and papers related to social interactions.

Learn more: Blog-Week 2

Week 3

Social interactions
  1.  Brainstorming on the interactions/mechanism
  2. Metrics & Matrix renew
  3. Branding refine
  4. Network connection demo
  5. Leap Motion gesture works

Learn more: Blog-Week 3

Week 4

  1. Finished composition box.
  2. Prepared playable demo and project short presentation for Quarters.
  3. Collected feedback from EA employees and ETC faculty.
  4. Dug more with our idea, designed interactions that allow players to cooperate and ways to foster communication.
  5. Solved the technical networking problem between devices.

Learn more: Blog-Week 4


Find a direction
  1. Talked about the topic ”Why AR” again – Ideation: use physical furniture or props to let players feel that other players in the AR world can interact with their physical worlds.
  2. 3 directions of our experience: 
    1) Small games pack
    2) Survival experience
    3) Several isolated demos like Pupil
  3. Technical demo 1: two players in the AR world can clap and high five together.
  4. Technical demo 2: two players in the AR world can pick up objects and throw or give to each other.
  5. Voice chat feature on the network is partially working right now. The server can now talk to the client.

Learn more: Blog-Week 5


Balance board idea
  1. Decided on the new prototypes we are going to build.
    (We want to test some functions & ideas we can use later by these prototypes
  2. Ideation about emotional expression in the AR world and emotion system in our project.
  3. Decided on the art style, made some art assets for prototypes.
  4. Talked about what we are going to show on Halves.
  5. Build prototypes!!

Learn more: Blog-Week 6


Prepare for Halves
  1. Prepare for Halve presentation
  2. The Balance board demo works!
  3. Make all three demos good for Halve playtest
  4. Talked about physical object direction again, and come up with the magic box idea

Learn more: Blog-Week 7


Halve Presentation

Behind the camera! We spent a lot of time to practice every day and tried to polish our slides! Good job Team!

Learn more: Blog-Week 8


Complete Experience Flow
  1. Discussed the whole experience flow
  2. Write down all the mini-game ideas we brainstormed
  3. Tried to implement magic box idea
  4. Worked on the desktop observation feature

Learn more: Blog-Week 9


More Details
  1. Decided on the mini-game ideas/ More details
  2. New experience flow
  3. Improved magic box
  4. PC mode
  5. Start building basic functions for the construction idea

Learn more: Blog-Week 10


Narrow Down the Scope
  1. Keep working on the magic box feature
  2. Working on all 3D models
  3. Finish the draft version of physical campfire
  4. Narrow down our scope

Learn more: Blog-Week 11


Playtest & Improve
  1. Created two sets of physical probs: magic box and campfire
  2. Finished all the 3D models we need
  3. Collected feedback from ETC Remote Playtest day
  4. Created our script for soft-opening video
  5. Implemented new features and iterated our experience

Learn more: Blog-Week 12


Soft Opening
  1. Polished our experience: VFX, SFX, emotions, eating animation
  2. Soft opening playtest video
  3. Gathered feedback from soft opening and discussed our next plan

Learn more: Blog-Week 13


After Soft
  1. Improvements based on soft opening feedback:
    • Added gloves to give a safety warning feedback
    • Adjusted stone generate method
    • Added talking animation
  2.  Prepare for the final presentation

Learn more: Blog-Week 14


Prepare for Final Presentation
  1. We still polished our experience a little
  2. Prepare for Final Presentation

Learn more: Blog-Week 15

Meet our team

Advisors & Clients

Carl Rosendahl

Melanie Lam