The use of augmented and virtual reality in chemistry is slowly starting to gain traction. The initial use of virtual reality in drug discovery is well documented but usually confined to highly specialised hardware which has limited it's exposure to a wider audience. However as described by Jonas Boström at the recent Chemistry on Mobile Devices Meeting Virtual reality smartphone apps making chemistry look and feel cool. This project aims to enhance the learning experience for school chemistry lessons by providing virtual reality viewing of molecules using inexpensive Google Cardboard viewers available online.
Virtual reality smartphone apps are making chemistry look and feel cool. This project aims to enhance the learning experience for school chemistry lessons by providing virtual reality viewing of molecules using inexpensive Google Cardboard viewers.
The power of the latest generation of smart phones has enabled scientists to also explore augmented reality. Augmented reality is now being used in a number of situations. To enhance publications as demonstrated by Alistair Crow, if you want to know how to do this instructions are available here. Many people have probably used the superb ChemTube3D website created by Nick Greeves at the University of Liverpool which is an invaluable education resource, this is also accessible via a Smartphone app.
ChemTube3D contains interactive 3D animations and structures, with supporting information for some of the most important topics covered during an undergraduate chemistry degree
More recently some of the pages have been enhanced to provide access to virtual reality models, if you would like to develop similar pages there is an AppleScript droplet to batch convert Jmol files into files suitable for AR.
More recently Mark Costner has released MoleculAR: an augmented reality (AR) app to view molecules in 3D.
Augmented reality is finding new applications in science, in particular the ability to enhance publications or lecture notes, and viewers can set up a free account with Augment to provide easy access.
I was asked recently if it might be possible to generate an AppleScript droplet that you could simply drop a chemical structure file onto to generate the desired files needed for the Augment, and this is an ideal use case for a droplet.
This script uses Jmol to generate the Wavefront .obj and .mtl files which can be used
You read more about the script and download it here.
A couple more examples of the use of augmented reality to display chemistry
This also looks interesting.
MoleculAR - sneak peak on an augmented reality app to help organic chemistry students visualise molecules in 3D, using just their lecture notes and mobile devices! pic.twitter.com/NOa9Q3bAYZ— Mark Coster (@MarkCoster_Chem) July 8, 2018
Touching proteins with virtual bare hands
….A more accessible and intuitive visualization of the three-dimensional configuration of the atomic geometry in the models can be achieved through the implementation of immersive virtual reality (VR). While bespoke commercial VR suites are available, in this work, we present a freely available software pipeline for visualising protein structures through VR. New consumer hardware, such as the HTC Vive and the Oculus Rift utilized in this study, are available at reasonable prices….
A short ‘how-to’ on making macromolecular structures viewable in the ‘Augment’ augmented reality app
Allister Crow recently posted a brilliant twitter post of a movie showing a crystal structure in augmented reality: https://twitter.com/Allister_Crow/status/933000138552901632 and he posted a simple HowTo. I've taken the original instructions and expanded them to include a few extra options including how to add colours based on a comment by @tomkazimiers.
You can read the detailed instructions here.