1. Introduction to MEMS IMU and Error Significance
In the field of mobile robot positioning and inertial navigation, MEMS IMU is the most widely used inertial information measurement sensor. The gyroscope in MEMS IMU is responsible for sensing the rotational changes of the vehicle, while the accelerometer measures the force information of the vehicle. However, the raw measurement data of low-cost and medium-cost MEMS IMU is affected by a large amount of zero bias instability errors and random noise. Over time, uncorrected sensor errors will accumulate into motion state errors. Generally speaking, the gyroscope bias causes attitude, velocity, and position errors to increase with time in a linear, quadratic, and cubic manner, respectively. In addition, the bias of the accelerometer will cause velocity and position errors to increase respectively at the first power and second power of time 1. Therefore, the error of inertial sensors is the primary factor affecting the accuracy of inertial sensing, and controlling the error of inertial sensors is of crucial importance.
2. Calibration Methods for Deterministic Errors
For deterministic errors, commonly used error calibration methods include: discrete calibration methods and system-level calibration methods.
2.1 Discrete Calibration Methods
Most discrete calibration methods model the measurement output of MEMS IMU as a linear polynomial equation of systematic error. In the laboratory, reference information is obtained by using external high-precision alignment equipment, such as a three-axis turntable. Then, by comparing the bias between the measurement output of MEMS IMU and the reference information, the coefficients of the polynomial are calculated. Thereby calibrating the output of the MEMS IMU 2 3 4 5. When only significant errors are considered, almost all system-level deterministic errors can be compensated, and some random errors can also be estimated and compensated online through navigation algorithms. However, laboratory calibration is costly and overly idealistic, failing to reflect the actual application environment.
2.2 System-Level Calibration Methods
Unlike the discrete correction method, the system-level calibration method corrects the IMU error by estimating the inertial navigation result error based on the Kalman filter. In 2017, Qureshi et al. 6 proposed a field calibration method for MEMS IMU. The greatest advantage of this method is that it does not rely on external calibration equipment. By using the local gravity signal as a stable external reference data, a simpler and faster calibration process can be completed simply by placing the sensor in an approximate direction and performing a simple rotation. System-level calibration methods typically use zero velocity as a reference for estimating error parameters. However, in the case of base swaying, zero speed is ineffective, and traditional methods will reduce calibration accuracy. For the oscillating base environment, Dai et al. 7 proposed a filtering method for three-axis RINS in inertial systems, achieving full parameter calibration on the oscillating base based on the velocity error in the inertial system.
2.3 Challenges and Advances in Practical Calibration
In most cases, The deterministic error calibration of MEMS IMU is carried out in an ideal environment free from interference and disturbance. However, such an ideal environment and conditions are not always applicable in real-world scenarios. In addition, the calibration of MEMS IMU usually requires an expensive and bulky calibration system, which is unaffordable for the average user. Therefore, Peng et al. 8 developed a low-cost, lightweight and portable IMU calibration embedded platform, and proposed a calibration algorithm considering external perturbations, using an iterative weighted Levenberg-Marquardt algorithm to handle perturbations. Although system-level calibration methods reduce the reliance on external devices and are suitable for online calibration, it is difficult to denoise and compensate for nonlinear and non-Gaussian random errors.
| Calibration method category | Core Principles/Features | Major advantage | Main limitations/challenges |
| discrete calibration method | The reference information is obtained by using high precision equipment (such as three-axis rotary table) in the laboratory, and the polynomial coefficients of the system error are calculated and compensated by comparing the bias between the output and the reference. | Under ideal condition, it can compensate most of the system errors. | The cost is high; the environment is too ideal to reflect the actual application scenario; and it relies on a bulky and expensive calibration system. |
| system level calibration method | The IMU error is corrected by estimating the navigation result error based on the Kalman filter. Gravity signal and zero velocity are used as external reference. | It reduces the dependence on external calibration equipment and is suitable for on-line and on-site calibration. | In the case of the swing base, the traditional zero speed reference is invalid, and it is difficult to remove noise and compensate the non-linear and non-Gaussian random errors. |
| Improvements for Practical Challenges | The low-cost and portable embedded calibration platform is developed. The calibration algorithm considering external disturbance is proposed, such as iterative weighted L-M algorithm. | It is closer to real-world scenarios, improving practicality and accessibility. | It is still mainly aimed at the deterministic error, and the random error processing ability is limited. |
3. Techniques for Identifying and Modeling Random Errors
To identify and model random errors, researchers have proposed many representative MEMS IMU signal denoising techniques, which can mainly be divided into traditional signal processing-based methods and data-driven methods in recent years.
4. Traditional Signal Processing-Based Denoising Methods
Auto Regressive Moving Average Method (ARMA), Allan Variance method (AV), Kalman Filter (KF) and the Wavelet Transformation (WT) are the most representative signal processing methods.
4.1 The ARMA Method
The ARMA method is mainly used to analyze and study a set of random data arranged in sequence, and to establish mathematical models of different orders based on different error sequences. However, this method cannot identify the components of random errors one by one, and it is difficult to distinguish the sources of random errors.
4.2 The Allan Variance Method
The Allan variance method can identify various random error components and subdivide them into five parts: quantization noise, angular random walk, zero-bias instability, velocity random walk, and rate ramp. Therefore, the greatest advantage of Allan variance is that it can draw a double logarithmic curve to correlate and analyze the time-domain and frequency-domain characteristics of the data, thereby enabling intuitive and quantitative observation of random errors. When the data volume is large enough, the double logarithmic curve drawn will be more accurate 9.
4.3 The Kalman Filter Method
Kalman Filter is an effective linear quadratic estimator that can estimate the angular velocity or specific force information of the output of MEMS IMU through a series of observations with noise 10. When Kalman Filter conducts iterative estimation, it is necessary to conduct mathematical modeling of the MEMS IMU in advance, construct the corresponding system equations and observation equations, and manually set the covariance matrices of the system noise and observation noise to represent the confidence of the predicted values and observed values. However, the random error of MEMS IMU is a nonlinear and non-Gaussian signal, which will drift slowly over time and temperature, making it difficult to establish an accurate mathematical model. Therefore, the Kalman filter performs average in noise reduction for MEMS IMU.
4.4 The Wavelet Transform Method
The wavelet transform method is a commonly used signal processing method, which can be used to reduce the error of the high-frequency part of the random noise in MEMS IMU. Through wavelet transform, the original signal can be decomposed into wavelet coefficients of different frequencies. Then, according to actual needs, some of the wavelet coefficients can be retained or discarded, and ultimately a smoother signal can be reconstructed. However, the effectiveness of the wavelet transform method depends on the type and parameters of the selected wavelet function, as well as the threshold selection of the wavelet coefficients. For the low-frequency part error in the random noise of MEMS IMU, since the error in the low-frequency part is usually widely distributed in the wavelet coefficients, it is difficult to eliminate it through simple threshold selection or coefficient discarding, resulting in the poor effect of the wavelet transform method in removing the low-frequency error 11.
| Traditional signal processing methods | Core Principle/Function | major advantage | primary limitation |
| autoregressive moving average method | The mathematical model of different order is established for the random data sequence. | It can be used to analyze and study random data sequence. | It is difficult to identify the random error components one by one and distinguish the sources of errors. |
| Allen variance method | The time-domain and frequency-domain characteristics of the data are analyzed by double logarithmic curve correlation, and five kinds of errors such as quantization noise and angular random walk are identified. | It can observe and subdivide all kinds of random error components intuitively and quantitatively. | A large enough data volume is needed to ensure the accuracy of the curve. |
| Kalman filter | The optimal estimation (linear quadratic estimation) is performed by using the noisy observation sequence. | It is an effective estimator for linear Gaussian system. | The random error of MEMS-IMU is nonlinear, non-Gaussian and time-varying, which makes it difficult to establish an accurate mathematical model and results in average noise reduction effect. |
| wavelet transform method | The signal is decomposed into wavelet coefficients of different frequencies, and the coefficients are retained or discarded by thresholding to reconstruct the smooth signal. | The high frequency part of the random noise can be effectively reduced. | The effect depends on the choice of wavelet function and parameters, and the low frequency error removal effect is poor. |
| global assessment | The signal processing algorithm is used to reduce the noise. | It can reduce part of the random error. | The suppression effect on random error is limited. |
5. Machine Learning Approaches for Enhanced Noise Reduction
To enhance the noise reduction capability of traditional signal processing-based methods, many researchers have adopted machine learning approaches to improve the traditional noise reduction algorithms, such as Support Vector Machine (SVM) and Neural Network, and have achieved better noise reduction results than those based on traditional signal processing methods.
5.1 Applications of SVM and Neural Networks
In 2012, Zhang et al. 12 used SVM to model and compensate the angular rate error of MEMS gyroscope MG31-300, verifying that the SVM model has high accuracy and good ability in MEMS IMU noise reduction. Due to the optimal radial basis function neural network’s excellent nonlinear, adaptive, and self-learning characteristics, Leung et al.
13 successfully applied it in 2001 to predict the noisy time series signals of MEMS IMU. Gonzalez et al. 14 proposed a time-delay multilinear regression technique for reducing white noise in MEMS IMU in 2019, and conducted a strict feasibility analysis and proof for it.
5.2 Limitations of Static Machine Learning Models
Although these improvement methods have achieved certain results, their noise reduction effects mainly depend on the ability to identify complex patterns by learning the advanced features of the data, and most of the methods are based on static statistical models. This static model only models the current and previous moments of inertial information and does not consider the more historical moments of MEMS IMU dynamic information. However, MEMS IMU data is a time series data, and the errors in historical moments will inevitably affect the current measurement values.
In recent years, deep learning technology has demonstrated outstanding performance in computer vision 15 and natural language processing 16 due to its powerful feature representation and nonlinear modeling capabilities. Some researchers have introduced deep learning into inertial odometry, such as OriNet 17, IONet 18, and TLIO 19. These methods have achieved superior positioning performance compared to traditional methods. However, research on using deep learning to reduce random noise in MEMS IMU has just begun. Jiang et al. 20 in 2018 applied recurrent neural networks (RNN) to the raw signals of MEMS IMU for noise reduction and used the Allan variance tool to calculate the main error factors, namely quantization noise, angular random walk, and zero bias instability. However, due to the gradient vanishing and gradient explosion problems 21 of RNN, it performs poorly in long sequences.
6.1 Advancements with LSTM and Hybrid Models
In 2012, long short-term memory (LSTM) neural networks 22, 23 were proposed to enhance the learning ability of neural networks in handling long sequence problems. LSTM uses its unique internal input, forget, and output gate structures to selectively learn time series features based on current and historical data. In 2018, Jiang et al. 24 processed MEMS IMU output signals as time series and used LSTM to reduce noise in MEMS gyroscope output data. Experimental results showed that this denoising scheme effectively improved the measurement accuracy of the gyroscope in MEMS IMU. To further explore the role of LSTM in signal denoising of MEMS IMU, Han et al. 25 in 2021 evaluated the denoising effect of hybrid deep recurrent neural networks in both static and dynamic environments, including LSTM neural networks and gated recurrent units (GRU) neural networks. In 2021, Li et al. 26 and Zhu et al. 27 combined LSTM with Kalman filters to real-time estimate and compensate for the random drift of MEMS IMU gyroscope.
6.2 The Role of Convolutional Neural Networks
RNN can learn time correlations from the useful signals of the original data, but it is difficult to extract local features from noise components. In 2020, Brossard et al.28 compensated for the errors of MEMS IMU through a carefully designed convolutional neural network (CNN) structure and further improved the accuracy of the estimated attitude angles of MEMS IMU.
| Deep learning methods | Model characteristics | Applications and Effects | Limitations and Challenges |
| recurrent neural network (RNN) | Time correlation can be learned from the original data. | It is applied to the original signal denoising of MEMS-IMU and to the calculation of the Allan variance error factor. | It has the problems of gradient vanishing/ exploding, poor performance on long sequences, difficulty in extracting local features from noise components, and low computational efficiency. |
| long short-term memory network(LSTM) | It can selectively learn the temporal features based on current and historical data through the gate structure, and is good at dealing with long sequence problems. | The measurement accuracy of the gyroscope is improved effectively, and the real-time random drift compensation is realized by combining with KF. | It shares some limitations with RNN, such as computational efficiency. |
| gated recurrent unit(GRU) | A variant of recurrent neural networks similar to LSTM. | As part of the hybrid deep cycle network, it is evaluated for noise reduction. | The independent limitations of the literature are not detailed. |
| convolutional neural network(CNN) | The carefully designed structure can extract local features. | It compensates the MEMS-IMU error, and further improves the attitude angle estimation accuracy. | It may not be adept at modeling long-term dependencies directly. |
| mixed model/other network | By combining different network advantages (e.g. LSTM and KF). | The performance of the proposed method is better than that of the traditional method. | Most studies are based on single RNN model, which does not consider the local feature and long-term dependence of time series, and does not explore the importance of different time features. |
7. Current Research Status and Limitations
The current research status of the error compensation methods for MEMS IMU indicates that the noise reduction method based on deep learning is superior to the traditional signal processing-based noise reduction methods in most cases. However, most of the work based on data-driven principles to suppress the random errors of MEMS IMU is based on a single RNN model, without simultaneously considering the local features of the MEMS IMU measurement signals and the long-term dependencies in the time series. Moreover, the computational efficiency of RNN is low, and the importance of the time series features of MEMS IMU at different times has not been explored.
References
- EL-SHEIMY N, LI Y. Indoor navigation: State of the art and future trends[J]. Satellite Navigation, 2021, 2(1): 1-23.
- TEDALDI D, PRETTO A, MENEGATTI E. A robust and easy to implement method for imu calibration without external equipments[C]//2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2014: 3042-3049.
- GHANIPOOR F, HASHEMI M, SALARIEH H. Toward calibration of low-precision mems imu using a nonlinear model and tukf[J]. IEEE Sensors journal, 2020. 20(8): 4131-4138.
- FURGALE P, REHDER J, SIEGWART R. Unified temporal and spatial calibration for multi-sensor systems[C]//2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 2013: 1280-1286.
- LU J, LEI C, LIANG S, et al. An all-parameter system-level calibration for stellar-inertial navigation system on ground[J]. IEEE Transactions on Instrumentation and Measurement, 2017. 66(8): 2065-2073.
- QURESHI U, GOLNARAGHI F. An algorithm for the in-field calibration of a mems imu[J]. IEEE Sensors Journal, 2017, 17(22): 7479-7486.
- DAI M, LU J. A full-parameter self-calibration method based on inertial frame filtering for triaxis rins under swaying base[J]. IEEE Sensors Journal, 2018, 19(6): 2170-2180.
- PENG C C, HUANG J J, LEE H Y. Design of an embedded icosahedron mechatronics for robust iterative imu calibration[J]. IEEE/ASME Transactions on Mechatronics, 2021, 27(3): 1467-1477.
- EL-SHEIMY N, HOU H, NIU X. Analysis and modeling of inertial sensors using allan variance[J]. IEEE Transactions on instrumentation and measurement, 2007, 57(1): 140-149.
- CAI S, HU Y, DING H, et al. A noise reduction method for mems gyroscope based on direct modeling and kalman filter[J]. IFAC-PapersOnLine, 2018, 51(31): 172-176.
- DING M, SHI Z, DU B, et al. A signal de-noising method for a mems gyroscope based on improved vmd-wtd[J]. Measurement Science and Technology, 2021, 32(9): 095112.
- ZHANG Y S, YANG T. Modeling and compensation of mems gyroscope output data based on support vector machine[J]. Measurement, 2012, 45(5): 922-926.
- LEUNG H, LO T, WANG S. Prediction of noisy chaotic time series using an optimal radial basis function neural network[J]. IEEE Transactions on Neural Networks, 2001, 12(5): 1163-1172.
- GONZALEZ R, CATANIA C A. Time-delayed multiple linear regression for de-noising mems inertial sensors[J]. Computers & Electrical Engineering, 2019, 76: 1-12.
- HAN K, WANG Y, CHEN H, et al. A survey on vision transformer[J]. IEEE transactions on pattern analysis and machine intelligence, 2022, 45(1): 87-110.
- TENNEY I, DAS D, PAVLICK E. Bert rediscovers the classical nlp pipeline[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 2019: 4593-4601.
- ESFAHANI M A, WANG H, WU K, et al. Orinet: Robust 3-d orientation estimation with a single particular imu[J]. IEEE Robotics and Automation Letters, 2019, 5(2): 399-406.
- CHEN C, LU X, MARKHAM A, et al. Ionet: Learning to cure the curse of drift in inertial odometry[C]//Proceedings of the AAAI Conference on Artificial Intelligence: volume 32. 2018.
- LIU W, CARUSO D, ILG E, et al. Tlio: Tight learned inertial odometry[J]. IEEE Robotics and Automation Letters, 2020, 5(4): 5653-5660.
- JIANG C, CHEN S, CHEN Y, et al. Performance analysis of a deep simple recurrent unit recurrent neural network (sru-rnn) in mems gyroscope de-noising[J]. Sensors, 2018, 18(12): 4471.
- LECUN Y, BENGIO Y, HINTON G. Deep learning[J]. nature, 2015. 521(7553): 436-444.
- SHERSTINSKY A. Fundamentals of recurrent neural network (rnn) and long short-term memory (lstm) network[J]. Physica D: Nonlinear Phenomena, 2020, 404: 132306.
- GRAVES A, FERNÁNDEZ S, SCHMIDHUBER J. Bidirectional lstm networks for improved phoneme classification and recognition[C]//International conference on artificial neural networks. Springer, 2005: 799-804.
- JIANG C, CHEN S, CHEN Y, et al. A mems imu de-noising method using long short term memory recurrent neural networks (lstm-rnn)[J]. Sensors, 2018, 18(10): 3470.
- HAN S, MENG Z, ZHANG X, et al. Hybrid deep recurrent neural networks for noise reduction of mems-imu with static and dynamic conditions[J]. Micromachines, 2021, 12(2): 214.
- LI D, ZHOU J, LIU Y. Recurrent-neural-network-based unscented kalman filter for estimating and compensating the random drift of mems gyroscopes in real time[J]. Mechanical Systems and Signal Processing, 2021, 147: 107057.
- ZHU C, CAI S, YANG Y, et al. A combined method for mems gyroscope error compensation using a long short-term memory network and kalman filter in random vibration environments[J]. Sensors, 2021, 21(4): 1181.
- BROSSARD M, BONNABEL S, BARRAU A. Denoising imu gyroscopes with deep learning for open-loop attitude estimation[J]. IEEE Robotics and Automation Letters, 2020, 5(3): 4796-4803.
