Nasa Space Apps Challenge 2017

DEX: Mixed Reality Earth Dictionary

hackathon

Description

DEX is a mixed reality peer reviewed platform for indexing and discovering scientific knowledge. Explore the world, collect Knowledge Points and help others understand our planet with the power of crowdsourced based data gathering challenges!

Challenge

Develop a creative way for the public and scientists alike to learn the definitions of Earth-related scientific and technical terms, using the power of crowdsourcing.

Problem

Earth and space are both beautiful and complex, but scientists sometimes struggle to communicate how every aspect of nature is connected and how they interact with each other.

Themes & Trends

Starting from some common themes and trends, such as the will and need to protect Earth’s diversity and sustainability, we set out to create an app that aims to spread knowledge both in the scientific community and among the public alike.

  • NASA DEX – A MIXED REALITY EARTH DICTIONARY

Solution

Introducing DEX, an interactive and collective Earth dictionary based on crowdsourcing and mixed reality.

DEX stands on three main pillars:

1. Mixed Reality

An immersive way to experience content, in order to make complexity understandable, graspable and enjoyable by users.

2. Crowdsourcing

A peer reviewed system to collect and share knowledge, where scientists and enthusiasts can collaborate and validate content, while ensuring proper credit to be given through referencing.

3. Gamification

A gamified system where increasing knowledge is awarded with in-app points. Each user’s history is shown in their own personal diary, giving an overall sense of progression with total earned “knowledge points” and current level.

Discovering new content and learning new scientific terms is easy, intuitive and direct. It’s always possible to see the source of definitions, images and augmenting material such as explanatory schemes and visualizations. Additionally, the crowdsourced nature of the uploaded contents allows it to be always monitored and corrected if wrong or incomplete.

The user interface of DEX uses metaphors like paper and diaries to create a tactile experience, that paired with mixed reality has the aim to emulate the act of gathering and saving sheets and photos in a researcher’s journal.

Prototypes

We assembled a first prototype of how the app could work in the final product. You can explore all the app's core features, from the map, to the Explore page, down to the Discovery Diary where all progress is stored.

App Prototype

Our working prototype showcases the potential of the mixed reality feature of DEX. The prototype allows you to take a picture, which is then live processed by the Google Cloud Vision API, and returns text printed on screen detailing the recognized subject of the picture along with its description (automatically retrieved from Wikipedia), all of this with the form factor of the visual user interface showed in the video.

Computer Vision Prototype

Space Apps Challenge — Hackathon

The project was developed during the 2-day International Space Apps Challenge hackathon organized by NASA, April 29-30, 2017. The competition was taking place globally in 69 countries, in 187 locations, with over 25,000 participants. As a team, we were located in Milan, Italy.

  • DEX – A Mixed Reality Earth Dictionary
  • DEX – A Mixed Reality Earth Dictionary
  • DEX – A Mixed Reality Earth Dictionary
  • DEX – A Mixed Reality Earth Dictionary
  • DEX – A Mixed Reality Earth Dictionary
  • DEX – A Mixed Reality Earth Dictionary
  • DEX – A Mixed Reality Earth Dictionary
From left to right: Andrea Benedetti (team), Valeria Aufiero (team), David Orban (Jury), Alessandro Zotta (team), Alexio Cassani (Jury), James Simonetta (team), Francesco Nacchia (Jury & Organizer), Lorenzo Bracco (team), Alessandro Coltro (Jury), Hady Ghassabian (Jury & Mentor), Aureliano Rivolta (Jury).
Photos by Giulia D'Errico

Read more about the project on the challenge website.

Team

Valeria Aufiero
Andrea Benedetti
Lorenzo Bracco
Elena Mongelli
James Simonetta
Alessandro Zotta

All images on this site are Copyright © 2017 Alessandro Zotta or their respective copyright holders. Do not use without permission.