USING THE SYNERGY METHOD FOR IMPROVEMENT OF THE ACCURACY OF LOCATION BASED AUGMENTED REALITY

DOI: 10.24057/2414-9179-2018-2-24-396-407

View or download the article (Rus)

About the Authors

Alexey A. Kolesnikov

Siberian State University of Geosystems and Technologies,
Plakhotnogo str., 10, 630108, Novosibirsk, Russia,
E-mail: alexeykw@mail.ru

Pavel M. Kikin

Siberian State University of Geosystems and Technologies,
Plakhotnogo str., 10, 630108, Novosibirsk, Russia,
E-mail: it-technologies@yandex.ru

Sergey V. Seredovich

Siberian State University of Geosystems and Technologies,
Plakhotnogo str., 10, 630108, Novosibirsk, Russia,
E-mail: npcip@yandex.ru

Abstract

The key components of a location-based augmented reality application are data collected from various sensors and methods for processing these data.

However, the accuracy of the sensors does not always meets the requirements, processing the collected data require significant computational resources that have a negative effect to the power consumption and overall performance of the application.

The article considers possible ways of solving these problems by using various data analyses and processing methods.

One of the largest segments of augmented reality market is mobile software segment, which is mainly represented by software for smartphones.

At the same time, most of the used devices have disadvantages deriving from their small size and mobility.

These are: limited charge of a portable power source, low performance in comparison with desktop computers, inefficient cooling system and limited set of built-in sensors.

Augmented reality applications are focused on visualization of supplemented data at the right time and in the right place.

Location-based augmented reality relates to technologies that use the device capabilities to determine its spatial position based on GNSS data, as well as compass, gyro, depth camera and other sensors displaying the augmented reality around.

The need to research and analyse the data obtained from smartphone sensors is caused by the fact that in the location-based augmented reality application, developed by the authors, there were problems with the accuracy and stability of the visualization of 3D objects in virtual space.

Data, obtained from the smartphone sensors (compass, gyro, accelerometer, GPS/GLONASS), are used to position the virtual camera in a 3D scene with information tabs.

Since the visual “jitter” of 3D objects is significant, it was necessary to find out which of the sensors deals the greatest error.

Due to the lack of ready-made solutions to create location-based AR systems, the authors met problems associated with extremely high power consumption, accuracy and stability of visualization of augmented reality elements, and need of intellectual use of smartphone sensors, disabling those that can be ignored.

Unity software, which has all necessary tools for obtaining data from smartphone sensors, was used to analyze the data received from the smartphone, because it

Based on the analysis of the data received from various smartphone sensors, a number of recommendations on how to work with these data and use algorithms to smooth and reduce noise within the creation of location-based augmented reality application was made.

Keywords

location based AR, smartphone, gyro, accelerometer, compass

References

  1. Adler S., Schmitt S., Wolter K., Kyas M. A survey of experimental evaluation in indoor localization research // Proceedings of the IEEE International Conference on Indoor Positioning and Indoor Navigation (IPIN). Banff, Alberta, Canada, October 2015. P. 1–10.
  2. Bonnet S., Bassompierre C., Godin C. et al. Calibration methods for inertial and magnetic sensors. Sensors and Actuators A: Physical. 2009. V. 156, No 2. P. 302–311.
  3. Chen D., Cho K., Shin K.G. Mobile IMUs Reveal Driver’s Identity From Vehicle Turns. CoRR, abs/1710.04578, arXiv technical report 2017.
  4. Chen X. Human Motion Analysis with Wearable Inertial Sensors. PhD Dissertation, University of Tennessee, Knoxville, 2013.
  5. Colomar D.S., Nilsson J.-O., Handel P. Smoothing for ZUPT-aided INSs // Proceedings of the IEEE International Conference on Indoor Positioning and Indoor Navigation (IPIN). Sydney, Australia, November 2012. P. 1–5.
  6. Groves P.D. Principles of GNSS, Inertial, and Multisensor Integrated Navigation Systems, 2nd ed.: Artech House, Boston and London, 2013.
  7. Kikin P.M., Kolesnikov A.A., Komissarova E.V., Grishenko D.V. Analysis of data from smartphone sensors when developing an application of a geo-positional augmented reality. Mezhdunarodnaya nauchno-prakticheskaya konferentsiya “Ot karty proshlogo—k karte budushchego”, 28–30 noyabrya 2017, g. Perm’—g. Kudymkar. P. 95–105 (in Russian).
  8. Kok M., Hol J.D., Sch T.B. Using Inertial Sensors for Position and Orientation Estimation. CoRR, abs/1704.06053, arXiv technical report 2017.
  9. Kolesnikov A.A., Kikin P.M., Komissarova E.V. Creating virtual models of terrain and buildings. Interekspo GEO-Sibir’-2016. XII Mezhdunar. nauch. kongr., 18–22 apr. 2016, Novosibirsk. Mezhdunar. nauch. Konf. “Raneye preduprezhdeniye i upravleniye v krizisnykh situatsiyakh v epokhu bol’shikh dannykh”: Sb. materialov. V. 2. Novosibirsk: SSUGT, 2016. P. 37–40 (in Russian).
  10. Kolesnikov A.A., Kikin P.M., Komissarova E.V. Programming for GIS in the framework of the preparation of students studying in the specialty “Information Systems and Technologies”. Aktual’nyye voprosy obrazovaniya. Vedushchaya rol’ univ-ta v tekhn. i kadrovoy modernizatsii rossiyskoy ekonomiki: sb. mater. Mezhdunar. nauchno-metodich. konf. Part. 1. Novosibirsk: SSUGT, 2015. P. 87–90 (in Russian).
  11. Quan M., Piao S. Robust visual-inertial {SLAM:} combination of {EKF} and optimization method. CoRR, abs/1706.03648, arXiv technical report 2017.
  12. Reaserch Report “Global Augmented Reality (AR) Market Forecast by Product (HMD, HUD, Tablet PC, Smartphone) for Gaming, Automotive, Medical, Advertisement, Defense, E-learning & GPS Applications (2011–2016)”, Market and Markets, 2011.
  13. Restuccia F., Ghosh N., Bhattacharjee S. et al. Quality of Information in Mobile Crowdsensing: Survey and Research Challenges. CoRR, abs/1709.03583, arXiv technical report 2017.
  14. Wu Y., Pei L. Gyroscope Calibration via Magnetometer. CoRR, abs/1707.07082, arXiv technical report 2017.
  15. Wu Y., Shi W. On Calibration of Three-axis Magnetometer. IEEE Sensors Journal. 2015. T. 15. P. 6424–6431.
  16. Wu Y., Zou D., Liu P., Yu W. Dynamic Magnetometer Calibration and Alignment to Inertial Sensors by Kalman Filtering. IEEE Trans. on Control System Technology, 2016.
  17. Yakovlev B.S., Pustov S.I. Classification and perspective directions of using the augmented reality technology. Izvestiya TulGU. Tekhnicheskiye nauki. 2013. No 3 (in Russian).

For citation: Kolesnikov A.A., Kikin P.M., Seredovich S.V. USING THE SYNERGY METHOD FOR IMPROVEMENT OF THE ACCURACY OF LOCATION BASED AUGMENTED REALITY. Proceedings of the International conference “InterCarto. InterGIS”. 2018;24(2):396–407 DOI: 10.24057/2414-9179-2018-2-24-396-407 (in Russian)