Random_Body_Movement_Removal_Using_Adaptive_Motion
Random_Body_Movement_Removal_Using_Adaptive_Motion
1 National Key Laboratory of Microwave Imaging Technology, Aerospace Information Research Institute,
Chinese Academy of Sciences, Beijing 100190, China; [email protected] (S.Y.);
[email protected] (N.J.); [email protected] (J.C.);
[email protected] (Z.Z.)
2 School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences,
Abstract: In response to the pressing requirement for prompt and precise heart rate acquisition dur-
ing neonatal resuscitation, an adaptive motion artifact filter (AMF) is proposed in this study, which
is based on the continuous wavelet transform (CWT) approach and takes advantage of the gradual,
time-based changes in heart rate. This method is intended to alleviate the pronounced interference
induced by random body movement (RBM) on radar detection in neonates. The AMF analyzes the
frequency components at different time points in the CWT results. It extracts spectral peaks from
Citation: Yang, S.; Liang, X.; Dang,
each time slice of the frequency spectrum and correlates them with neighboring peaks to identify
X.; Jiang, N.; Cao, J.; Zeng, Z.; Li, Y. the existing components in the signal, thereby reducing the impact of RBM and ultimately extract-
Random Body Movement Removal ing the heartbeat component. The results demonstrate a reliable estimation of heart rates. In practi-
Using Adaptive Motion Artifact cal clinical settings, we performed measurements on multiple neonatal patients within a hospital
Filtering in mmWave Radar-Based environment. The results demonstrate that even with limited data, its accuracy in estimating the
Neonatal Heartbeat Sensing. resting heart rate of newborns surpasses 97%, and during infant movement, its accuracy exceeds
Electronics 2024, 13, 1471. 96%.
https://doi.org/10.3390/
electronics13081471 Keywords: MIMO mmWave radar; contactless sensing; vital signs; random body movement
Academic Editors: Changzhi Li and removal; adaptive motion artifact filtering
Emanuele Cardillo
recurrent episodes of apnea, and chronic lung injury. Consequently, these newborns re-
quire necessary respiratory and heart rate monitoring in the neonatal ward [5].
Existing contact-based methods for measuring heart rate in newborns primarily in-
clude auscultation, palpation, pulse oximetry, and electrocardiogram estimation. Pulse
oximeters and electrocardiograms have a higher accuracy, but it takes 1–2 min from the
birth of the newborn to obtain data using these instruments, which may surpass the opti-
mal resuscitation time [6]. Auscultation and palpation are convenient and relatively fast
but lack accuracy in measurement. Non-contact detection methods mainly include optical
cameras, WiFi, and radar detection [7,8]. In optical detection, using visible light for sens-
ing is susceptible to interference from ambient light and is affected by dark environments,
which can impact detection performance. Moreover, most optical flow calculation meth-
ods have poor noise resistance and require corresponding hardware support. Infrared-
based detection is susceptible to environmental temperature influences [9,10]. WiFi-based
detection faces the challenge of having multiple signals in the same frequency band in the
environment, making it susceptible to interference and affecting its measurement accu-
racy [11–13]. In order to compensate for the limitations of the aforementioned sensors,
radar technology has been widely adopted for vital sign detection in recent years due to
its superior penetration capabilities and anti-interference features, enabling continuous
monitoring throughout the day [14–17].
The detection principle of life signals based on radar primarily involves detecting
displacement changes caused by respiration and heartbeat. The shorter the wavelength of
the electromagnetic wave, the larger the phase shift caused by small movements, making
the system more sensitive. Using high-frequency MIMO mmWave radar enables a more
accurate detection of cardiac motion [18,19]. MIMO technology enhances the spatial reso-
lution of the radar and allows for beamforming, which enables the precise targeting of the
heart and spatial filtering to eliminate interference in the environment. The use of MIMO
mmWave radar in vital sign monitoring systems has significant practical significance in
medical diagnosis, nursing home supervision, driver fatigue detection, and other fields
[20]. However, even though previous proposed solutions based on mmWave radar have
been tested in ideal conditions, there are still some research gaps and limitations. For ex-
ample, the current methods have not considered special scenarios, such as non-healthy
newborns in hospitals, whose heartbeat amplitudes are relatively weak and whose fre-
quencies are much higher than those of adults [21–23]. During detection, RBM in new-
borns has a substantial impact on the system’s detection performance. Newborns have
small bodies, and the movements of their limbs and head will impact the radar echo, re-
sulting in an insufficient signal-to-noise ratio and a significant amount of interference in
the phase information. Traditional methods struggle to accurately determine the respira-
tory rate and heart rate in such cases.
Currently, scholars primarily employ two categories of methods to mitigate the in-
fluence of body motion on the extraction of vital signs. One approach is based on a phys-
ical model, utilizing multiple radar sensors to retrieve physiological signals through the
correlation of signals between sensors. Gu et al. proposed a multi-sensor fusion system
that employs a camera-assisted radar for random body motion cancellation (RBMC) [24].
A regular camera is used to measure body motion by tracking white dots on a small piece
of black paper attached to the subject’s shoulder. The phase information of the RBM, in
the opposite phase, is added to the radar’s demodulated signal to eliminate the effects of
the RBM. This method has certain limitations, such as the complexity of camera deploy-
ment. Li and Lin suggested using two Doppler radars to simultaneously measure the sub-
ject on the front and back to counteract the effects of RBM. With the successful calibration
of the DC offset, the system can successfully recover the respiratory and cardiac compo-
nents [25]. Wang et al. proposed using wireless mutual injection locking (MIL) of two
radars to counteract the influence of RBM on a subject [26]. Yu et al. developed a Doppler
radar array for two-dimensional non-contact vital sign detection using four radar sensors.
It achieved the elimination of random body motion noise in the human plane [27]. Zhang
Electronics 2024, 13, 1471 3 of 21
proposed a novel chest–abdomen joint cardiorespiratory signal method using two IR-
UWB radars simultaneously to detect respiration and heart rate. Considering the signal
overlap between vital signs and motion artifacts, the received radar signals are processed
with the empirical wavelet transform (EWT) to eliminate clutter and mitigate motion in-
terference [28]. This enabled non-contact heart rate estimations.
Another approach is the data-driven method, which utilizes a single radar to predict
physiological signals under motion interference through data analyses and inference. This
method typically processes the raw signals by filtering, decomposing, fitting, and match-
ing them to obtain physiological signals. However, it cannot capture the true measure-
ment values at each moment, resulting in potentially significant variations in accuracy
across different subjects or conditions. Lv et al. introduced a matched filter to invert the
respiratory and cardiac spectra completely hidden under broadband background noise
caused by large-scale body motion. However, this method requires accurate heartbeat and
respiration templates, which are impractical in real-world applications [29]. Tariq et al.
employed wavelet algorithms for detecting heart rate in phase-modulated Doppler radar
signals. The ability of the wavelet transform to preserve both time and frequency infor-
mation is utilized to analyze the phase-modulated Doppler radar signal, giving infor-
mation about changes in heartbeat over very small intervals of time. This method per-
forms well in ideal environments [30]. Mercuri et al. used CWT to identify the locations
of artifacts and then applied a moving average filter to smooth these identified artifacts.
They also utilized a discrete wavelet transform (DWT) to separate the heartbeat signal
from the respiratory signal, thereby achieving accurate detection [31]. However, this
method encounters issues whereby successful detection is not achieved even after
smoothing.
In the current research, detecting heart rate signals in the presence of RBM remains a
challenge. Existing studies indicate that the displacement changes on the chest surface
caused by the motion of the heart and respiration are different from those caused by RBM,
resulting in different radar echoes. The frequencies of respiration and heartbeats change
continuously over time, while the frequency of RBM changes discontinuously over time.
This fundamental distinction has inspired us to employ time–frequency analysis methods
to process radar echoes and filter out the influence of RBM on heart rate detection.
In this paper, the heartbeat signals were detected using MIMO mmWave radar, and
an adaptive motion artifact filtering method based on the continuous slow temporal var-
iations in heartbeat frequency was proposed, building upon the wavelet transform for
separating vital signs. This method combines cardiovascular motion models, data
knowledge, and graphical algorithms to explore RBM removal techniques. The contribu-
tions of this article are as follows:
(1) A novel method is proposed to enhance the quality of heartbeat measurements using
MIMO mmWave radar in the presence of RBM;
(2) The non-continuous nature of RBM is leveraged to mitigate its impact on the calcu-
lation of respiration and heart rates;
(3) By analyzing the time–frequency information on the chest surface, the spectra of
RBM and heartbeat are separated in the temporal domain, the continuously changing
heartbeat spectra are extracted, and the influence of RBM is reduced.
This paper is organized as follows: Section 2 provides a comprehensive overview of
the principles behind non-contact heartbeat perception using MIMO mmWave radar. It
includes a detailed analysis of the performance of other wavelet-based vital sign detection
methods and an elaborate exposition of the proposed AMF method for calculating respir-
atory and heartbeat frequencies under non-stationary body states. In Section 3, vital sign
detection experiments were conducted on three subjects to evaluate the performance of
the proposed method. The experimental results are used to assess the effectiveness of our
approach. Finally, a discussion and conclusion are presented to summarize our findings.
Electronics 2024, 13, 1471 4 of 21
2. Methodology
In this study, MIMO mmWave radar was employed for neonatal vital sign detection.
MIMO mmWave radar offers high resolution in range, azimuth, and elevation angles, fa-
cilitating precise localization of the participant’s chest and accurate sensing of chest move-
ments. Figure 1 illustrates the fundamental principle of vital sign detection using
mmWave radar. The surface movements of the chest caused by neonatal cardiopulmonary
activity modulate the radar echo signals, resulting in a micro-Doppler effect that can be
further processed to extract heartbeat information.
Figure 1. The principle of non-contact vital sign detection using mmWave radar.
Figure 2. An overview of the heart rate extraction method by adaptive filtering of RBM.
2 R(τ )
sR (t ) =A ⋅ s t − (3)
c
Electronics 2024, 13, 1471 6 of 21
where A denotes the amplitude of the received signal, c is the speed of light, τ is the
slow time, and R(τ ) represents the distance between the target and the radar, as well as
the target’s relative motion.
R (τ=
) R0 + ΔR (τ ) (4)
The radar echo is mixed with its corresponding carrier and down-converted to base-
band. The down-converted signal for each frame is then subjected to inverse Fourier trans-
form to achieve pulse compression [33], as shown in the following equation:
A j 4π f 0 R (τ ) j 2π ( K − 1) 2 KΔfR(τ ) 2 KΔfR(τ )
Sb ( f ) = ⋅ exp ⋅ exp f − ⋅ sinc T f − (5)
KT c K c c
sR HsT + n
= (6)
where
= n [ n1 , n2 , ⋅⋅⋅, nN ]T denotes the noise component.
An MIMO mmWave system utilizes a combination of a 2D antenna array and SFCW
signal to scan the RF reflections in 3D space. The target’s distance relative to the radar is
determined using Equation (5), and digital beamforming (DBF) is employed to steer the
antenna beams towards the target [34]. θ and ϕ represent the target’s elevation angle
and azimuth angle, respectively. The DBF results are presented as follows:
M 2π N 2π
j mdT cos θ j nd R sin θ cos ϕ
S (θ , ϕ ) = ∑ wm e λ
⋅ ∑ wn e λ (7)
=m 1=n 1
Sinusoidal waves combined with Gaussian noise were employed to simulate respir-
atory and heartbeat signals in the ideal posture of the human body. The respiratory rate
was set at 40 bpm with an amplitude of 10 mm, while the heart rate was set at 128 bpm
with an amplitude of 3 mm. The signal-to-noise ratio (SNR) between the respiratory and
heartbeat signals and the Gaussian noise was 30 dB, as shown in Figure 3a. Figure 3b
illustrates the resulting micro-movements on the chest surface after adding RBM to the
respiratory and heartbeat signals.
0.8
0.6
R/cm
0.4
0.2
0
0 1 2 3 4 5 6 7
(a)
3
2.5
2
R/cm
1.5
0.5
0
0 1 2 3 4 5 6 7
Time(s)
(b)
Figure 3. The simulated signal. (a) The respiratory and heartbeat signal. (b) The mixed signal com-
prising respiratory, heartbeat, and RBM components.
1 t−a
ψ a ,b (t ) = ψ( ) (11)
a b
Equation (11) represents the wavelet basis function, where a is the scale factor and
b is the translation factor. The mother wavelet undergoes scaling and shifting to generate
the daughter wavelets. The scaling factor controls the frequency of the daughter wavelets;
higher scales correspond to lower frequencies and vice versa. The wavelet coefficients are
obtained by convolving the daughter wavelets with the signal. To preserve energy at each
1
scale, the convolution is multiplied by a factor of [37]. The wavelet transform has the
a
capability to accurately localize both the time and frequency dimensions, thus offering
superior time resolution for fast events, such as cardiac activities, and significant fre-
quency resolution for slower events, such as respiratory actions.
According to [38], the analysis of the phase difference signal is performed using the
Morlet wavelet basis. The Morlet wavelet basis excels in time and frequency localization,
Electronics 2024, 13, 1471 8 of 21
making it suitable for time–frequency analysis of oscillatory signals [39]. The following
equation represents the time-domain mathematical expression of the Morlet wavelet:
t2
1 −
ψ (t ) = e j 2π f c t e fb
(12)
π fb
where f b represents the bandwidth of the Morlet wavelet, and f c denotes the central
frequency.
The phase difference signal is analyzed using a Morlet wavelet with a bandwidth of
3 and a central frequency of 3. The phase signal comprises components attributed to res-
piration, heartbeat, and RBM, with the amplitude of RBM progressively increasing from
0. The objective of the analysis is to investigate the influence of RBM on respiratory and
heartbeat signals. The analysis results are depicted in Figure 4. For 2D time–frequency
plot of the CWT, peak detection is obtained via spectral slices of each time point. The
frequency with the maximum spectral peak within the newborn heart rate range (80–180
bpm) is taken as the heart rate value. Finally, the results are smoothed for further analysis.
The magnitude of variation in RBM significantly affects the detection of respiratory
and heartbeat signals using CWT. Figure 4a illustrates changes in motion on the chest
surface when the amplitude of RBM is twice the amplitude of the simulated respiratory
and heartbeat signals. The corresponding wavelet transform results are shown in Figure
4c, indicating a stable and accurate estimation of heart rate without any abrupt changes.
Figure 4b represents changes in motion on the chest surface when the amplitude of RBM
is four times the amplitude of the simulated respiratory and heartbeat signals. The corre-
sponding wavelet transform results are depicted in Figure 4d, demonstrating a significant
impact of RBM on the results. The heart rate exhibits a sudden jump at 3 s, and the maxi-
mum peak does not correspond to the true heart rate, resulting in inaccurate estimations.
Through multiple experimental comparisons, it has been observed that the heart rate sig-
nal cannot be accurately identified when the magnitude of the RBM signal exceeds three
times that of the respiratory and heartbeat signals.
3 5
2.5
4
2
3
R/cm
1.5
2
1
1
0.5
0 0
0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7
(a) (b)
180 180
160 160
140 140
BPM
120 120
100 100
80 80
0 1 2 3 4 5 6 7 0 1 2 3 4 5 6 7
(c) (d)
Time(s)
Figure 4. Phase and the processing result. (a,b) The simulated time-domain signals with different
magnitudes of RBM. (c,d) The wavelet transform results corresponding to the phase signals.
After the increase in noise magnitude, direct analysis using CWT and employing the
strategy of extracting the maximum value can no longer effectively remove the RBM.
Electronics 2024, 13, 1471 9 of 21
According to [31], the fact that there is a higher time resolution in high-frequency compo-
nents and better frequency resolution in low-frequency components in wavelet transform
is utilized to localize motion artifacts. The motion artifacts at the identified locations are
then smoothed to attenuate the motion signal. Furthermore, the Meyer wavelet is em-
ployed for further signal decomposition. The decomposition level is 5. Upon obtaining
the decomposed signals, the frequency of the heartbeat signal is ascertained through the
application of the fast Fourier transform (FFT). The mathematical expression for the
Meyer wavelet is as follows:
ψ j , k ( x) 2− j / 2ψ (2− j x − k )
= (13)
where j and k are arbitrary integers, and ψ ( x) represents a smooth real bandlimited
function.
The simulated signal is processed using wavelet decomposition, and the effect of
wavelet decomposition on RBM is evaluated. The phase signal and the processing results
after wavelet decomposition are depicted in Figure 5. After performing wavelet decom-
position on the phase signal, the FFT spectrum is calculated. The frequency corresponding
to the peak with the highest intensity in the spectrum is considered as the heart rate.
The impact of RBM on the EWT analysis method varies with different magnitudes.
Figure 5a illustrates the changes in motion on the chest surface when the amplitude of the
RBM is equal to the amplitude of the simulated respiratory and heartbeat signals. The
processing results are shown in Figure 5c, in which the heart rate corresponds to the peak
with the highest intensity in the frequency spectrum. Figure 5b represents changes in mo-
tion on the chest surface when the amplitude of RBM is four times that of the simulated
respiratory and heartbeat signals. The processing results are depicted in Figure 5d, in
which the heart rate peak is overshadowed by interference from other components, lead-
ing to inaccurate estimations. Through multiple experimental comparisons, it has been
observed that the heart rate signal cannot be accurately identified when the magnitude of
the RBM signal exceeds three times that of the respiratory and heartbeat signals.
Figure 5. Phase and the processing result. (a,b) The simulated time-domain signals with different
magnitudes of RBM. (c,d) The results of phase signal being subjected to wavelet decomposition and
FFT.
Electronics 2024, 13, 1471 10 of 21
Identifying and attenuating RBM through the CWT and subsequent wavelet decom-
position can be somewhat effective. However, using a fixed number of decomposition
levels still fails to resolve RBM issues in more complex scenarios. EWT presents an adap-
tive wavelet construction method. It decomposes the signal into different modes by de-
signing appropriate wavelet filters, allowing for finer-grained analysis [40]. The EWT be-
gins by dividing the signal spectrum and decomposing the input signal into multiple sub-
band signals through the use of various filters. For a given signal s(t ) , FFT analysis is
performed to normalize its frequencies and map them to the range [0 ~ 2π ] . According
to the Shannon criterion, the discussion focuses only on the signal within the support in-
terval [0 ~ π ] . The support interval is divided into K segments based on the number of
components constituting the signal.
=Λk [ω
= k −1 , ωk ] , k 1, 2, , K (14)
1 (1 + γ )ωk ≤| ω |≤ (1 − γ )ωk +1
,
cos π β 1
2 2γω (| ω | −(1 − γ )ωk +1 ) (1 − γ )ωk +1 ≤| ω |≤ (1 + γ )ωk +1
,
k +1
ψˆ k (ω ) = (15)
π 1
sin 2 β 2γω (| ω | −(1 − γ )ωk ) (1 − γ )ωk ≤| ω |≤ (1 + γ )ωk
,
k
0 , otherwise
1 , | ω |≤ (1 − γ )ωk
π 1
=φˆk (ω ) cos β (| ω | −(1 − γ )ωn ) ,(1 − γ )ωk ≤| ω |≤ (1 + γ )ωk (16)
2 2γωk
0 , otherwise
According to [28], the simulated signal is processed using EWT, and the impact of
EWT on RBM is evaluated. After removing the influence of static interference in the signal,
the signal is subjected to FFT processing. The strategy of local maxima and minima is
employed to determine the number of segments for the support interval, thereby identi-
fying the frequency boundaries. Based on the obtained frequency boundaries, empirical
wavelets are constructed to decompose the simulated signal. The decomposed signals are
then subjected to FFT transformation to determine the heart rate.
In the analysis of the impact of the RBM on respiratory and heartbeat signals employ-
ing the EWT method, the RBM amplitude increases from zero. The phase signal and pro-
cessing results are illustrated in Figure 6. After performing EWT decomposition on the
signal, the segment containing the heart rate undergoes the FFT operation. The frequency
corresponding to the peak with the highest intensity in the spectrum represents the heart
rate.
The impact of RBM on the EWT analysis method varies with different magnitudes.
Figure 6a illustrates the changes in motion on the chest surface when the amplitude of the
RBM is equal to the amplitude of the simulated respiratory and heartbeat signals. The
processing results are shown in Figure 6c, in which the heart rate corresponds to the peak
with the highest intensity in the frequency spectrum. Figure 6b represents changes in mo-
tion on the chest surface when the amplitude of the RBM is three times the simulated
Electronics 2024, 13, 1471 11 of 21
respiratory and heartbeat signals. The processing results are depicted in Figure 6d, in
which the heart rate peak is overshadowed by interference from other components, lead-
ing to inaccurate estimations. Through multiple experimental comparisons, it has been
observed that when the magnitude of the RBM signal exceeds twice the magnitude of the
respiratory and heartbeat signal, the heart rate signal cannot be accurately identified.
Figure 6. Phase and the processing result. (a,b) The simulated time-domain signals with different
magnitudes of the RBM. (c,d) The results of the phase signal being subjected to the EWT and FFT.
Based on the analysis above, it is evident that decomposing and denoising the entire
signal is susceptible to strong amount of interference from noise. Additionally, using spec-
tral analysis to obtain the heart rate results in the loss of temporal information provided
by the CWT, thereby decreasing its correlation with the variations in heartbeats. Recog-
nizing the characteristics of heartbeat variations and considering the time information
within the CWT, this article proposes a novel method based on previous experiences.
the characteristics of heart rate frequency variations, the component corresponding to the
heartbeat signal is identified.
In the obtained spectrum peaks, it is not possible to solely differentiate clutter signal
components from heartbeat signal components based on the intensity of the peaks due to
the influence of clutter components’ strength. To address this issue, a method is proposed
to distinguish different signal components based on the frequency variation relationship
among the components. Consequently, a signal component segmentation approach uti-
lizing image processing techniques is employed [41]. The specific algorithmic procedure
is outlined as follows:
(a) Determine the position of each spectral peak at every time point;
(b) The spectral peaks within the time at t are selected as the starting points for com-
ponent fitting;
(c) Along the temporal axis, the frequency of the spectral peak corresponding to tk and
the differences in spectral peak frequencies between [tk +1 , tk + 2 , tk + 3 ] are calculated, re-
spectively. The spectral peak with the smallest difference is selected for fitting;
(d) The process described in (c) is repeated until all time points have been traversed;
(e) The peak-to-peak value of the fitted curve is calculated, and the signal component
with the smallest peak-to-peak value is selected as the heart rate curve.
The impact of different intensities of the RBM on the algorithm performance varies.
Figure 7a illustrates the motion variation on the chest surface when the simulated respir-
atory and heartbeat signals overlap with the RBM signal with an amplitude of 1. The pro-
cessing result is shown in Figure 7c, in which the heart rate continuously changes over
time and can be accurately extracted. In Figure 7b, the chest surface motion is depicted
when the simulated respiratory and heartbeat signals overlap with the RBM signal with
an amplitude of 6. The processing result is shown in Figure 7d, in which the spectral peak
corresponding to the heartbeat signal is completely submerged after 6 s, making it impos-
sible to extract the peak information and obtain accurate estimations. Through multiple
experimental comparisons, it was observed that when the amplitude of the RBM signal
exceeds five times the amplitude of the respiratory and heartbeat signals, the heart rate
signal cannot be accurately identified.
Figure 7. Phase and the processing result. (a,b) The simulated time-domain signals with different
magnitudes of RBM. (c,d) The results of the phase signal being subjected to the AMF.
Electronics 2024, 13, 1471 13 of 21
Figure 8. The simulation comparison results between the AMF and other methods are presented.
(a) The computational results of different algorithms under the RBM with an amplitude of one are
presented. (b) The computational results of different algorithms under the RBM with an amplitude
of five are presented.
3. Results
The algorithm’s performance was evaluated through experimental assessments us-
ing an MIMO mmWave radar. The results were compared with those obtained from a
contact-based sensor electrocardiogram (ECG) monitor and other recent techniques to
verify the efficacy of the proposed approach.
The experiments were conducted in a neonatal intensive care unit, as depicted in Fig-
ure 9, which illustrates the experimental setup including the radar sensors and electrocar-
diogram (ECG) monitor. The participants consisted of three infants with specific health
conditions, as outlined in Table 1. One participant was a mid-term premature infant, who
may have various risks due to the incomplete development of his or her organ systems
compared to those of full-term infants. These risks include respiratory complications such
as apnea and respiratory distress syndrome, resulting from an underdeveloped respira-
tory system. Additionally, the incomplete development of the circulatory system may lead
to complications such as persistent pulmonary hypertension and heart failure. Another
participant was a term infant diagnosed with neonatal wet lung, a condition characterized
by respiratory difficulties caused by the inadequate clearance of fluid from the lungs.
Symptoms may include grunting, froth, and inspiratory indrawing. The last participant
was also a term infant diagnosed with meconium aspiration and mild asphyxia. As-
phyxia-induced hypoxia may lead to oxygen deprivation in various systems, resulting in
complications such as feeding intolerance and necrotizing enterocolitis in the digestive
system, as well as hypoxic-ischemic encephalopathy in the nervous system.
Electronics 2024, 13, 1471 14 of 21
The MIMO mmWave radar used for evaluation was the vTrig mmWave sensor eval-
uation kit produced by Vayyar. The radar system was equipped with 20 transmitting (Tx)
and 20 receiving (Rx) onboard antennas, enabling the transmission of SFCW waveforms
in the frequency range of 62–69 GHz. The radio signal power emitted by the radar was
below −10 dBm, significantly lower than the radio power of mobile phones or WiFi de-
vices. The structure of the radar system is illustrated in Figure 10a. The MIMO architecture
allowed for an effective array of 400 virtual elements, as shown in Figure 10b. This radar
system had a large effective aperture, resulting in a high resolution in both the azimuth
and elevation directions. Table 2 presents the important parameters related to the radar
signal. For subsequent experiments, a bandwidth of 1.6 GHz was set to balance the data
rate and image resolution. The frame rate was set at 30 Hz.
Parameters Value
Frequency Band 62–69 GHz
ADC Samples 151
Stop–Start Min Step 150 MHz
EIRP (Effective Isotropic Radiated Power) −5 dBm
Max Range Resolution 2.14 cm
Max Angular Resolution 6.7°
Electronics 2024, 13, 1471 15 of 21
Rx21 Tx Waveform
MPU
Generator
Rx22
Digital
…
USB
Front End
Rx40
(a) (b)
Figure 10. Radar internal structure. (a) Radar system structure. (b) Radar virtual antenna array
element.
The accuracy of non-contact vital sign detection results needs to be compared with
that of the gold standard, contact-based heart rate measurements. Accurate heart rate
readings were obtained using the ePM 10 Neo patient monitor manufactured by Mindray.
The laptop computer was utilized for radar data acquisition and processing. The radar
measurements were synchronized with the reference values provided by the patient mon-
itor through the computer and the electrocardiogram (ECG) monitor’s internal clock.
After recording the data, the multi-channel data underwent beamforming pro-
cessing, aligning the beams towards the subject’s chest. The resulting echoes from the
beamforming process were extracted, and after removing the static clutter, the phase in-
formation on the surface of the subject’s chest was obtained, as depicted in Figure 11. Fig-
ure 11 consists of nine phase results, and each row represents the phase information of a
different newborn. Rows 1 to 3 correspond to baby 1, baby 2, and baby 3, respectively,
while each column represents a specific state. The first column represents the phase vari-
ation in a stationary state, whereas the second and third columns represent the phase var-
iation during the occurrence of RBM.
The first-order differencing technique was applied to the phase on the chest surface
to accentuate the heartbeat details. Then a signal analysis using the CWT was performed,
as illustrated in Figure 12. During periods of relative stillness, the intensity of the heart-
beat frequency component was relatively high. However, when the subjects experienced
RBM, the intensity of the heartbeat frequency component varied at different time points
and was sometimes overshadowed by other components.
The AMF method was applied to further process the results of the wavelet transform,
allowing for the separation of the cardiac component and the clutter component based on
the relationship between the spectral peaks at adjacent time points. Figure 13 illustrates
the extraction results of the CWT spectral peaks shown in Figure 12, as well as the final
obtained cardiac component. From Figure 13, it can be observed that the acquisition of the
cardiac component is not influenced by its intensity. Even when the intensity of the car-
diac component is lower than that of other components, as long as the cardiac component
is not completely overshadowed, it can be obtained through the continuous characteristics
of the heartbeat.
Electronics 2024, 13, 1471 16 of 21
Figure 11. The phase variations on the surface of the chest under different states were observed
across different subjects. Rows 1 to 3 correspond to babies 1 to 3. Column 1 corresponds to the sta-
tionary state, and columns 2 and 3 correspond to the RBM state.
Figure 12. Signal analysis using the CWT was applied to examine the variations across different
subjects and states. Rows 1 to 3 correspond to babies 1 to 3. Column 1 corresponds to the stationary
state, and columns 2 and 3 correspond to the RBM state.
Electronics 2024, 13, 1471 17 of 21
Figure 13. The processing results after applying the AMF method for different subjects under vari-
ous states. Rows 1 to 3 correspond to babies 1 to 3. Column 1 corresponds to the stationary state,
and columns 2 and 3 correspond to the RBM state.
The final results demonstrate that the proposed method successfully extracts the car-
diac component, which closely aligns with the heartbeat measurements obtained through
ECG, as depicted in Figure 14. In comparison to other methods, the proposed approach
fully utilizes the temporal and frequency characteristics of the signal. By decomposing the
signal, it effectively captures the frequency components at different time points and ex-
hibits an advantage in removing clutter components. Furthermore, it enables the assess-
ment of temporal variations in heart rate.
Figure 14. The comparison results between the AMF and other methods. Rows 1 to 3 correspond to
babies 1 to 3. Column 1 corresponds to the stationary state, and columns 2 and 3 correspond to the
RBM state.
Electronics 2024, 13, 1471 18 of 21
After acquiring the cardiac signal, the accuracy ( ACC ), average absolute error ( MAE
), and root mean square error ( RMSE ) of the measurement results were calculated [42,43].
The formulas for these calculations are shown as Equations (16)–(18).
HRest − HRref
ACC = 1 − (17)
HRref
1
MAE
=
N
∑ HR est − HRref (18)
1
RMSE
=
N
∑ ( HR est − HRref ).2 (19)
In order to further quantify the performance of the proposed adaptive RBM removal
method, multiple experiments were conducted using different subjects and various mo-
tion states. The first set of experiments involved subjects in a stationary state, while the
second set included subjects experiencing RBM, such as newborn hiccups, tremors, sei-
zures, and limb movements. The accuracy of the HR measurements for the multiple sets
of data in the stationary state was 97%, while in the motion state, they had a high accuracy
of 96%. Furthermore, a detailed analysis of the results was conducted.
The performance of the AMF method across different individuals is elaborated in
Table 3. The results indicate minimal variations in HR accuracy across the different states
among the individuals. However, significant differences were observed in the MAE and
RMSE among the different individuals, with baby 2 exhibiting particularly exceptional
results. A further analysis of the individual’s condition revealed that baby 2 was a prem-
ature infant with a low level of muscle tone and reduced physiological movement com-
pared to a typical newborn, resulting in a lower activity frequency. Hence, relatively bet-
ter results were obtained for this individual.
In the current experiments, the relative angle between the newborn and the radar
remains relatively fixed. However, in more complex neonatal resuscitation scenarios, the
angle between the newborn’s chest and the radar may vary. Therefore, in future studies,
it is necessary to explore more optimal beamforming techniques to focus the radar beam
on the chest and suppress the surrounding interference. In the presence of more severe
RBM, there may be instances in which the cardiac signal component is completely over-
whelmed. Hence, further explorations of signal decomposition methods are necessary to
mitigate the impact of RBM on the heartbeat.
The accuracy of the AMF method for detecting neonatal respiratory rate has been
validated in this article; however, it has been found that some steps still cannot be adap-
tively adjusted. For instance, after the neonate’s position changes, it has been observed
that the beamforming is unable to automatically identify the location of the neonate’s
chest. In future research, it is planned to determine the chest’s location by mining the dif-
ferences between the chest and other signal features in the space over a period of time.
This information will be utilized to guide the radar in performing adaptive beamforming
at the chest’s location, which is expected to further improve the accuracy of the detection.
Furthermore, preparations are being made to integrate the AMF system with other medi-
cal monitoring equipment, with the aim of providing a more comprehensive solution for
the detection of neonatal vital signs.
Author Contributions: Conceptualization, S.Y. and X.L.; methodology, S.Y. and Y.L.; software, S.Y.;
validation, S.Y., N.J., J.C. and Z.Z.; formal analysis, Y.L. and S.Y.; investigation, S.Y., X.L., Z.Z. and
J.C.; resources, X.L. and X.D.; data curation, X.L. and X.D.; writing—original draft preparation, S.Y.;
writing—review and editing, S.Y., Y.L. and X.D.; visualization, S.Y.; supervision, Y.L.; project ad-
ministration, X.D.; funding acquisition, Y.L. All authors have read and agreed to the published ver-
sion of the manuscript.
Funding: This research was funded by the National Natural Science Foundation of China (Grant
No. 62271471).
Institutional Review Board Statement: The study was conducted according to the guidelines of the
Declaration of Helsinki and approved by the Ethics Committee of Peking University Third Hospital
Medical Science Research Ethics Committee (Medical Ethics Approval No.062-02(2024)).
Data Availability Statement: The data can be shared up on request.
Acknowledgments: The authors would like to thank the reviewers and editors for their help in
improving our manuscript.
Conflicts of Interest: The authors declare no conflicts of interest.
References
1. Perin, J.; Mulick, A.; Yeung, D.; Villavicencio, F.; Lopez, G.; Strong, K.L.; Prieto-Merino, D.; Cousens, S.; Black, R.E.; Liu, L.
Global, regional, and national causes of under-5 mortality in 2000–19: An updated systematic analysis with implications for the
Sustainable Development Goals. Lancet Child Adolesc. Health 2022, 6, 106–115. https://doi.org/10.1016/s2352-4642(21)00311-4.
2. Wiswell, T.E. Neonatal resuscitation. Respir. Care 2003, 48, 288–294; discussion 294–285.
3. Garvey, A.A.; Dempsey, E.M. Simulation in Neonatal Resuscitation. Front. Pediatr. 2020, 8, 59. https://doi.org/10.3389/fped.2020.00059.
4. Fang, J.L.; Umoren, R.A. Telesimulation for Neonatal Resuscitation Training. Semin. Perinatol. 2023, 47, 151827.
5. Flower, A.A.; Moorman, J.R.; Lake, D.E.; Delos, J.B. Periodic heart rate decelerations in premature infants. Exp. Biol. Med. 2010,
235, 531–538. https://doi.org/10.1258/ebm.2010.009336.
6. Johnson, P.A.; Schmölzer, G.M. Heart rate assessment during neonatal resuscitation. Healthcare 2020, 8, 43.
Electronics 2024, 13, 1471 20 of 21
7. Topfer, F.; Oberhammer, J. Millimeter-wave tissue diagnosis: The most promising fields for medical applications. IEEE Microw.
Mag. 2015, 16, 97–113.
8. Anton, O.; Fernandez, R.; Rendon-Morales, E.; Aviles-Espinosa, R.; Jordan, H.; Rabe, H. Heart rate monitoring in newborn
babies: A systematic review. Neonatology 2019, 116, 199–210.
9. Verkruysse, W.; Svaasand, L.O.; Nelson, J.S. Remote plethysmographic imaging using ambient light. Opt. Express 2008, 16,
21434–21445.
10. Kumar, M.; Veeraraghavan, A.; Sabharwal, A. DistancePPG: Robust non-contact vital signs monitoring using a camera. Biomed.
Opt. Express 2015, 6, 1565–1588.
11. Ravichandran, R.; Saba, E.; Chen, K.-Y.; Goel, M.; Gupta, S.; Patel, S.N. WiBreathe: Estimating respiration rate using wireless
signals in natural settings in the home. In Proceedings of the 2015 IEEE International Conference on Pervasive Computing and
Communications (PerCom), St. Louis, MO, USA, 23–27 March 2015; pp. 131–139.
12. Patwari, N.; Brewer, L.; Tate, Q.; Kaltiokallio, O.; Bocca, M. Breathfinding: A wireless network that monitors and locates breath-
ing in a home. IEEE J. Sel. Top. Signal Process. 2013, 8, 30–42.
13. Liu, X.; Cao, J.; Tang, S.; Wen, J. Wi-sleep: Contactless sleep monitoring via wifi signals. In Proceedings of the 2014 IEEE Real-
Time Systems Symposium, Rome, Italy, 2–5 December 2014; pp. 346–355.
14. Lin, J.C. Noninvasive microwave measurement of respiration. Proc. IEEE 1975, 63, 1530.
15. Li, C.; Ling, J.; Li, J.; Lin, J. Accurate Doppler radar noncontact vital sign detection using the RELAX algorithm. IEEE Trans.
Instrum. Meas. 2009, 59, 687–695.
16. Xiong, Y.; Chen, S.; Dong, X.; Peng, Z.; Zhang, W. Accurate measurement in Doppler radar vital sign detection based on param-
eterized demodulation. IEEE Trans. Microw. Theory Tech. 2017, 65, 4483–4492.
17. Saluja, J.; Casanova, J.; Lin, J. A supervised machine learning algorithm for heart-rate detection using Doppler motion-sensing
radar. IEEE J. Electromagn. RF Microw. Med. Biol. 2019, 4, 45–51.
18. Feng, C.; Jiang, X.; Jeong, M.-G.; Hong, H.; Fu, C.-H.; Yang, X.; Wang, E.; Zhu, X.; Liu, X. Multitarget vital signs measurement
with chest motion imaging based on MIMO radar. IEEE Trans. Microw. Theory Tech. 2021, 69, 4735–4747.
19. Cardillo, E.; Caddemi, A. A review on biomedical MIMO radars for vital sign detection and human localization. Electronics 2020,
9, 1497.
20. Upadhyay, B.R.; Baral, A.B.; Torlak, M. Vital sign detection via angular and range measurements with mmWave MIMO radars:
Algorithms and trials. IEEE Access 2022, 10, 106017–106032.
21. Kim, J.D.; Lee, W.H.; Lee, Y.; Lee, H.J.; Cha, T.; Kim, S.H.; Song, K.-M.; Lim, Y.-H.; Cho, S.H.; Cho, S.H. Non-contact respiration
monitoring using impulse radio ultrawideband radar in neonates. R. Soc. Open Sci. 2019, 6, 190149.
22. Lee, W.H.; Lee, Y.; Na, J.Y.; Kim, S.H.; Lee, H.J.; Lim, Y.-H.; Cho, S.H.; Cho, S.H.; Park, H.-K. Feasibility of non-contact cardi-
orespiratory monitoring using impulse-radio ultra-wideband radar in the neonatal intensive care unit. PLoS ONE 2020, 15,
e0243939.
23. Park, J.-Y.; Lee, Y.; Heo, R.; Park, H.-K.; Cho, S.-H.; Cho, S.H.; Lim, Y.-H. Preclinical evaluation of noncontact vital signs moni-
toring using real-time IR-UWB radar and factors affecting its accuracy. Sci. Rep. 2021, 11, 23602.
24. Gu, C.; Wang, G.; Inoue, T.; Li, C. Doppler radar vital sign detection with random body movement cancellation based on adap-
tive phase compensation. In Proceedings of the 2013 IEEE MTT-S International Microwave Symposium Digest (MTT), Seattle,
WC, USA, 2–7 June 2013; pp. 1–3.
25. Li, C.; Lin, J. Random Body Movement Cancellation in Doppler Radar Vital Sign Detection. IEEE Trans. Microw. Theory Tech.
2008, 56, 3143–3152. https://doi.org/10.1109/TMTT.2008.2007139.
26. Wang, F.K.; Horng, T.S.; Peng, K.C.; Jau, J.K.; Li, J.Y.; Chen, C.C. Single-Antenna Doppler Radars Using Self and Mutual Injec-
tion Locking for Vital Sign Detection With Random Body Movement Cancellation. IEEE Trans. Microw. Theory Tech. 2011, 59,
3577–3587. https://doi.org/10.1109/TMTT.2011.2171712.
27. Yu, X.; Li, C.; Lin, J. Two-dimensional noncontact vital sign detection using Doppler radar array approach. In Proceedings of
the 2011 IEEE MTT-S International Microwave Symposium, Baltimore, MD, USA, 5–10 June 2011; pp. 1–4.
28. Zhang, X.; Yang, X.; Ding, Y.; Wang, Y.; Zhou, J.; Zhang, L. Contactless simultaneous breathing and heart rate detections in
physical activity using ir-uwb radars. Sensors 2021, 21, 5503.
29. Lv, Q.; Chen, L.; An, K.; Wang, J.; Li, H.; Ye, D.; Huangfu, J.; Li, C.; Ran, L. Doppler Vital Signs Detection in the Presence of
Large-Scale Random Body Movements. IEEE Trans. Microw. Theory Tech. 2018, 66, 4261–4270.
https://doi.org/10.1109/TMTT.2018.2852625.
30. Tariq, A.; Shiraz, H. Doppler radar vital signs monitoring using wavelet transform. In Proceedings of the 2010 Loughborough
Antennas & Propagation Conference, Loughborough, UK, 8–9 November 2010; pp. 293–296.
31. Mercuri, M.; Lorato, I.R.; Liu, Y.-H.; Wieringa, F.; Hoof, C.V.; Torfs, T. Vital-sign monitoring and spatial tracking of multiple
people using a contactless radar-based sensor. Nat. Electron. 2019, 2, 252–262.
32. He, M.; Nian, Y.; Xu, L.; Qiao, L.; Wang, W. Adaptive separation of respiratory and heartbeat signals among multiple people
based on empirical wavelet transform using UWB radar. Sensors 2020, 20, 4913.
33. Ren, L.; Kong, L.; Foroughian, F.; Wang, H.; Theilmann, P.; Fathy, A.E. Comparison Study of Noncontact Vital Signs Detection
Using a Doppler Stepped-Frequency Continuous-Wave Radar and Camera-Based Imaging Photoplethysmography. IEEE Trans.
Microw. Theory Tech. 2017, 65, 3519–3529. https://doi.org/10.1109/TMTT.2017.2658567.
Electronics 2024, 13, 1471 21 of 21
34. Harter, M.; Mahler, T.; Schipper, T.; Ziroff, A.; Zwick, T. 2-D antenna array geometries for MIMO radar imaging by Digital
Beamforming. In Proceedings of the 2013 European Microwave Conference, Nuremberg, Germany, 6–10 October 2013; pp.
1695–1698.
35. Wang, G.; Muñoz-Ferreras, J.M.; Gu, C.; Li, C.; Gómez-García, R. Application of Linear-Frequency-Modulated Continuous-
Wave (LFMCW) Radars for Tracking of Vital Signs. IEEE Trans. Microw. Theory Tech. 2014, 62, 1387–1399.
https://doi.org/10.1109/TMTT.2014.2320464.
36. Zhang, X.-D. Modern Signal Processing; Walter de Gruyter GmbH & Co KG: Berlin, Germany, 2022.
37. Rana, M.J.; Alam, M.S.; Islam, M.S. Continuous wavelet transform based analysis of low frequency oscillation in power system.
In Proceedings of the 2015 International Conference on Advances in Electrical Engineering (ICAEE), Dhaka, Bangladesh, 17–19
December 2015; pp. 320–323.
38. Hu, X.; Jin, T. Short-range vital signs sensing based on EEMD and CWT using IR-UWB radar. Sensors 2016, 16, 2025.
39. Addison, P.S.; Watson, J.N.; Feng, T. Low-oscillation complex wavelets. J. Sound Vib. 2002, 254, 733–762.
40. Gilles, J. Empirical wavelet transform. IEEE Trans. Signal Process. 2013, 61, 3999–4010.
41. Jähne, B. Digital Image Processing; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2005.
42. Xiong, Y.; Peng, Z.; Gu, C.; Li, S.; Wang, D.; Zhang, W. Differential Enhancement Method for Robust and Accurate Heart Rate
Monitoring via Microwave Vital Sign Sensing. IEEE Trans. Instrum. Meas. 2020, 69, 7108–7118.
https://doi.org/10.1109/TIM.2020.2978347.
43. Li, Z.; Jin, T.; Dai, Y.; Song, Y. Motion-Robust Contactless Heartbeat Sensing Using 4-D Imaging Radar. IEEE Trans. Instrum.
Meas. 2023, 72, 4011110. https://doi.org/10.1109/TIM.2023.3312477.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual au-
thor(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to
people or property resulting from any ideas, methods, instructions or products referred to in the content.