IA Workshop at IEEE VR2016

This is the first research workshop on IA. Richard and Todd submitted a paper. We will soon know if it is accepted. Read this blog for details.

scikit-Learn + Unity3D

If the goal is turning analytics inside out within a virtual data world, then why not… Combine Python scikit-learn with Unity3D. And stir vigorously! Read this blog for details of this approach.

IA Example

ATLAS in silico is a physically interactive and immersive virtual reality art+science installation.  It presents the entire first release of 17.4 million metagenomics sequences from the Global Ocean Sampling Expedition in an installation blending virtual reality‚ spatialized audio‚ interactive computer graphics‚ and full-body interaction. The fully immersive and interactive virtual world enables participants to see‚ hear and interact with the scalable Metadata Environment (MDE). The project was initiated in 2007 at the University of California, San Diego‚ and relocated in 2014 to the University of North Texas. For more information, see atlasinsilico.net

An Immersive Experience

Explaining immersion is tough. But watching these two cats having an immersive experience is easy to understand. The intersection of a virtual space with an animal mind reveals how we might build practical data worlds. See this cute and insightful blog here.

IA Example

John Metcalfe of the Atlantic CityLab posted this blog on Science-On-A-Sphere Explorer – a 3D earth viewer with “tons of animated planetary data, from the age of the sea floor to the airborne migration of CO2 to hurricane tracks dating back to 1950”. This NOAA tool renders multiple layers of spherical data at full HD resolution. It is highly interactive, both in camera movement around the earth but also in time and altitude. This is an excellent example of 3D visualization of natural 3D data. Get your free copy here as a 5GB download.

What is Immersive?

…realistic feeling of being there or being present within a virtual space. With multi-person immersive spaces, it becomes being there with others, allowing for shared experiences and collaborative actions. Immersion is not new, occurring frequently around campfires for thousands of years. So, technology is not an essential ingredient. The challenge is determining whether immersion is effective for understanding a concept or performing a task. …more

plus sign

What is Analytics?

…augmentation of human judgments with analytical reasoning to generalize beyond known data. Without analytics, we can not handle the truth embedded in big data, being unable to comprehend its significance. This forces a symbiotic relationship of human and computer, with the balance sliding toward the latter. An analogy is eyeglasses, where the eyeglasses were telling the person where to go. Analytics should be turned inside out so that the person can constantly sense the analytic process. …more

equals

Immersive Analytics is…

…being there with others to generalize beyond data known about a system. The there is an unlimited immersive virtual space where scale and time are malleable. The others are persons with a common interest to understand and collaborative toward various goals. The generalizing is the augmentation of human judgment with analytic reasoning in a healthy symbiotic relationship. The system is the unit of analysis, the whole context within which insights and actions can be compared and contrasted.

The objective is to design and build data worlds that are immersive + analytical. …more

Defining Data Worlds

Data worlds are immersive virtual spaces whose objects are procedurally generated by data and represent the causal relationships within a complex system. The approach is to bring all the necessary data, into one context, to understand and manage that system, whether big or small. This contrasts from the usual data visualization analyses that focuses on one aspect of the system at a time.

Think of a data world as a well-designed themed park, where the system is fully laid out over a vast plain with data being refining at various places. The spirit of data worlds is similar to the enterprise data warehouse, whose focus is the entire organization across functional areas, as a single integrated system.

Potential venues (or usage modes) are: Visitor Gallery as a static viewpoint of a specific topic, Museum Tour as guided path to observe, Explorer for single discovery objective, Analysis Team to find collaborative insights, and Control Room for monitoring system behavior. …more

Designing Data Worlds

A key challenge is defining the design principles for data worlds, an initial set of which is: Engaging, Persistent, Information-Rich, Interactive, and Collaborative.

A basic architecture for a data world consists of a left-to-right flow of metadata from the data sources to the data world. IA-arch-basic v1The Design module adds the design configuration for that data world, created earlier by the World Designer utility. The Render engine generates the virtual objects with the proper appearance, behavior, and position and renders those objects within the 3D space. Actual data flows only to the remote Analytics module where various routines push analysis results as metadata into the Render engine. …more

Building Data Worlds

The best way to advance the thinking about IA is to build and build data worlds. Only through trying various combinations of design styles, rendering engines, rendering displays, and open datasets, will we discover practical use cases and effective design strategies.

For experimenting and sharing, the approach is to create several Hello Data Worlds apps, which are minimal architectures spanning various combinations and collected into a gallery of downloadable examples. Initial combinations are:

Other combinations of rendering engines could include: multi-user metaverses (High Fidelity, virBELLA, OpenSimulator) plus open sandox worlds (MineCraft). Combinations of analytic modules could include: cloud analytics (Spark/DataBricks, AWS Analytics MR) plus analytic flow IDE (RapidMiner, Alteryx).  …more