Mobile-based 3D reconstruction and XR visualization

Application domain(s)

  • Industry 4.0
  • Smart Communities
  • Telecommunication

Area(s) of expertise

  • 3D Modelling & Metrology
  • Computer Vision
  • Future Media
  • Human-Computer Interaction
  • ICT for Social Needs

Description

Distributed processing architecture enables anyone to turn real-world objects into digital 3D virtual models. No specific hardware required, or skills, just a mobile phone and an Internet connection (offline caching also possible). Users receive a real-time 3D-model on their screen showing reconstruction progress. Cloud-based, so people can collaboratively scan the same object. 3D objects can be visualized in AR or VR.

Figures:

  • Scanning application in use.
  • 3D textured models of captured cultural heritage objects, plus their reprojection into real space using Augmented Reality

Advantages & Applications

  • Product Design: Fast virtual-prototyping, 3D copy&print
  • Entertainment: Content generation for Gaming, Social media, Telepresence
  • Cultural Heritage: Anyone can preserve our heritage anywhere.
  • Education and training: Create new teaching media

Specifications

  • Mobile app (Android, but iOS is also possible);
  • Reconstruction server (PC or Cloud);
  • Tested with 10 users simultaneously scanning an object/building
  • First results appear in <1min, Final model in ~10min
  • Uses standardised 3D formats, e.g. obj

Status

TRL 4/5 – technology validated in relevant environment (industrially relevant environment in the case of key enabling technologies)

Related Media

Contacts

  • Reference people: Stefano Messelodi and Paul Chippendale
    Research Unit TeV: tev.fbk.eu
    Research Center ICT: ict.fbk.eu