PhD Research

What I'm working on.

Introduction


Name: João Nuno Valente

Email: [email protected]

Affiliation: Department of Mechanical Engineering, TEMA – Centre for Mechanical Technology and Automation, LAR – Laboratory for Automation and Robotics, University of Aveiro

ORCID: https://orcid.org/0000-0002-9263-8495

CIÊNCIA ID: 061F-E0A3-117B

Title: Single-Laser 3D Vibrometry with Depth Camera Integration

Keywords: 3D Vibrometry, Depth Camera, Point Cloud Registration, CSLDV

This PhD research explores a new approach to 3D vibrometry using a single scanning laser Doppler vibrometer in combination with a depth camera. Traditional 3D modal analysis relies on multiple sensors, but this work proposes repositioning a single sensor and reconstructing its spatial orientation through point cloud registration.

By capturing the geometry of the object at each measurement viewpoint with an RGB-D camera, the system estimates the transformation between views, enabling accurate 3D vibration mapping with minimal hardware. The research also investigates optimal sensor placement, using algorithms to minimize measurement redundancy while maintaining modal resolution.

Applications include structural health monitoring, particularly in power transformers, where this technique can simplify equipment setup and reduce costs. Validation is performed through comparisons with conventional multi-sensor setups and piezoelectric accelerometers. This project contributes to the fields of experimental modal analysis, robotic perception, and vibration measurement innovation.

Rui Moreira has focused his research on structural dynamics, mechanical vibrations, noise, and acoustics, making relevant contributions to modal analysis and the dynamic simulation of mechanical components. He founded and directs the Structural Dynamics Laboratory (SDL) at the University of Aveiro.

He is responsible for setting the overall research question of the project: Is it possible to perform 3D vibrometry using only one vibrometer? This question encompasses the knowledge required to conduct modal analysis using laser vibrometry, as well as traditional techniques for measuring mechanical vibrations.

Vítor Santos's research focuses on mobile robotics, advanced perception, and humanoid robotics, with key contributions to autonomous driving and robotic competitions. He has led multiple projects, including ATLASCAR, and has extensively supervised academic research in these fields.

His contribution to this project consists of leading the integration of RGB-D cameras into the system being developed, suggesting paths to explore regarding point cloud registration and active perception, particularly in determining optimal camera placement.

In addition, he is responsible for the Laboratory for Automation and Robotics (LAR), where I am currently conducting my research.

Sérgio Tavares specializes in structural integrity, fatigue, and fracture mechanics, with a focus on aeronautical and industrial applications. His research includes advanced manufacturing processes and the development of lightweight structures for aerospace and mobility industries. He also works on additive manufacturing, digital twins, and lifecycle assessment of structural components.

His expertise in structural integrity, digital twins, and lifecycle assessment plays a key role in this research, particularly in modeling and validating the system’s behavior under operational conditions.

Additionally, his previous experience with EFACEC provides a valuable opportunity, facilitating access to a case study involving power transformers, enabling real-world validation of the proposed approach.

Research Framework


3D Vibrometry plays a vital role in the experimental analysis of structural dynamics, enabling full-field vibration measurements in all spatial directions. Several systems have been developed for 3D vibrometry, including the Polytec1 PSV-500-3D, which employs three synchronized Laser Doppler Vibrometers (LDVs) arranged orthogonally to capture out-of-plane and in-plane motion. Other approaches include setups using high-speed 3D digital image correlation [1] and scanning LDVs mounted on robotic arms [2].

Some researchers have explored Continuously Scanning Laser Doppler Vibrometry (CSLDV) to improve spatial resolution and efficiency [3]. These systems typically use two orthogonally mounted mirrors to steer a single laser beam along a predefined path. This contrasts with conventional point-by-point scanning systems and enables faster data acquisition [4]. CSLDV has been applied to curved or rotating structures [5], often incorporating reflective mirrors [6] and image-based tracking [7]. However, such setups are complex, requiring precise mirror control and advanced signal processing.

A notable gap in the literature is the absence of approaches using depth cameras in 3D vibrometry. Depth cameras can capture dense point clouds in real time and are widely used in robotics and computer vision. They could provide a low-cost, non-contact method to track a repositioned single LDV across viewpoints. This offers a promising direction for affordable, flexible 3D vibrometry systems. However, integrating these point clouds requires robust registration techniques that can handle noise, partial overlaps [8], and changing perspectives.

Point cloud registration is an active area of research. Traditional methods, such as ICP [9], SHOT [10], and FPFH [11], align point clouds based on geometric features or correspondences. Although widely used, these methods often struggle with large misalignments, non-distinctive surfaces, or occlusions.

Recent work has explored learning-based methods, including 3DMatch [12], FCGF [13], DCP [14], and GeoTransformer [15]. These learn local or global features and predict correspondences or transformations directly. Additional approaches such as DIP [16] and GeDi [17] extend this line of work by incorporating iterative refinement and geometry-guided diffusion, respectively. While effective, they require large labeled datasets and often generalize poorly to new structures.

To address these challenges, recent research has also explored featureless registration strategies. One such approach is the Exhaustive Grid Search (EGS) [18], which performs a brute-force search over rotation and translation parameters to maximize correlation between voxelized point clouds. EGS offers strong performance in challenging conditions, such as low overlap or sensor noise, and does not rely on learned features or prior alignment.

The main objective of this Ph.D. project is to develop a flexible and cost-effective methodology for 3D vibrometry using a single scanning Laser Doppler Vibrometer (LDV). This method is designed to overcome the expense and complexity of conventional multi-LDV systems by simplifying setup and reducing calibration requirements.

1. Depth Camera-Based Tracking and Registration

The system will use a depth camera to track the LDV’s position and orientation during repositioning. At each viewpoint, point clouds will be captured and aligned using robust registration algorithms such as Exhaustive Grid Search (EGS), which are effective even in noisy, partially overlapping, or occluded scenarios.

2. Viewpoint Planning and Optimization

This component addresses how to minimize the number of scanning positions required while maintaining full structural coverage and accurate modal representation. The process involves solving a combined geometric and experimental optimization problem.

3. Continuous Scanning with Galvanometer-Mounted Mirrors

The project will implement a continuous scanning mechanism where galvanometer-mounted mirrors steer the laser across predefined trajectories. This system will be evaluated against traditional point-by-point scanning methods, comparing speed, spatial resolution, and overall complexity.

4. Robotic Automation with a UR10e Arm

To automate LDV repositioning, a UR10e robotic arm will be integrated into the system. This automation improves measurement precision and repeatability, especially for complex or hard-to-access geometries.

5. Practical Applications and Deployment

The methodology will be validated for applications such as structural health monitoring and non-contact vibration testing in field and lab environments. Its flexibility makes it especially valuable for inspecting large or remote structures where setup time and manual access are limited.

  • Can 3D vibrometry be accurately performed using a single scanning LDV, repositioned across multiple viewpoints and tracked using depth camera data?

    This question explores the feasibility of replacing traditional multi-LDV setups with a lower-cost, single-sensor approach by estimating rigid transformations between measurements using point cloud registration.

  • How can the number and placement of scanning viewpoints be optimized to achieve complete and accurate 3D modal analysis?

    This question investigates strategies to minimize the number of required laser positions while ensuring full coverage of the structure and the reliability of the extracted modal parameters.

  • How can continuous scanning using galvanometer-mounted mirrors be implemented to ensure that the laser accurately targets consistent points on the structure?

    This question focuses on the engineering challenges of synchronization, calibration, and scan trajectory design, aiming to ensure spatial consistency across repeated measurements and across different scanning methods.

References

BibTeX

[1]
J. Javh, J. Slavič, and M. Boltežar, “Full-Field Modal Analysis Using a DSLR Camera,” in Structural Health Monitoring, Photogrammetry & DIC, Volume 6, Springer International Publishing, 2019, pp. 27–30. DOI: https://doi.org/10.1007/978-3-319-74476-6_4
[2]
M. Franck, D. Berft, and K. Hameyer, “Robotergestützte 3D-Laser-Doppler-Vibrometrie zur experimentellen Modalanalyse von elektrischen Maschinen,” e & i Elektrotechnik und Informationstechnik, vol. 140, no. 2, pp. 281–289, 2023. DOI: https://doi.org/10.1007/s00502-023-01126-4
[3]
W. Zhu, “Continuously Scanning Laser Doppler Vibrometry for Vibration Measurement: A Tutorial on Principles, Recent Developments, and Applications,” in Computer Vision & Laser Vibrometry, Vol. 6, Springer Nature Switzerland, 2025, pp. 9–12. DOI: https://doi.org/10.1007/978-3-031-68192-9_2
[4]
D. Di Maio, P. Castellini, M. Martarelli, S. Rothberg, M. Allen, W. Zhu, and D. Ewins, “Continuous Scanning Laser Vibrometry: A raison d’être and applications to vibration measurements,” Mechanical Systems and Signal Processing, vol. 156, p. 107573, 2021. DOI: https://doi.org/10.1016/j.ymssp.2020.107573
[5]
L. Lyu and W. Zhu, “Operational modal analysis of a rotating structure in an outdoor environment using a novel image-based long-range tracking continuously scanning laser Doppler vibrometer,” Measurement, vol. 253, p. 117337, 2025. DOI: https://doi.org/10.1016/j.measurement.2025.117337
[6]
K. Yuan and W. Zhu, “A novel mirror-assisted method for full-field vibration measurement of a hollow cylinder using a three-dimensional continuously scanning laser Doppler vibrometer system,” Mechanical Systems and Signal Processing, vol. 216, p. 111428, 2024. DOI: https://doi.org/10.1016/j.ymssp.2024.111428
[7]
D. A. Ehrhardt, M. S. Allen, S. Yang, and T. J. Beberniss, “Full-field linear and nonlinear measurements using Continuous-Scan Laser Doppler Vibrometry and high speed Three-Dimensional Digital Image Correlation,” Mechanical Systems and Signal Processing, vol. 86, pp. 82–97, 2017. DOI: https://doi.org/10.1016/j.ymssp.2015.12.003
[8]
S. Huang, Z. Gojcic, M. Usvyatsov, A. Wieser, and K. Schindler, “PREDATOR: Registration of 3D Point Clouds with Low Overlap,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA: IEEE, 2021, pp. 4265–4274. DOI: https://doi.org/10.1109/CVPR46437.2021.00425
[9]
S. Rusinkiewicz and M. Levoy, “Efficient variants of the ICP algorithm,” in Proceedings Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, Que., Canada: IEEE Comput. Soc, 2001, pp. 145–152. DOI: https://doi.org/10.1109/IM.2001.924423
[10]
S. Salti, F. Tombari, and L. Di Stefano, “SHOT: Unique signatures of histograms for surface and texture description,” Computer Vision and Image Understanding, vol. 125, pp. 251–264, 2014. DOI: https://doi.org/10.1016/j.cviu.2014.04.011
[11]
R. B. Rusu, N. Blodow, and M. Beetz, “Fast Point Feature Histograms (FPFH) for 3D registration,” in 2009 IEEE International Conference on Robotics and Automation, 2009, pp. 3212–3217. DOI: https://doi.org/10.1109/ROBOT.2009.5152473
[12]
A. Zeng, S. Song, M. Nießner, M. Fisher, J. Xiao, and T. Funkhouser, 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions, 2016. DOI: https://doi.org/10.48550/ARXIV.1603.08182
[13]
C. Choy, J. Park, and V. Koltun, “Fully Convolutional Geometric Features,” in 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South): IEEE, 2019, pp. 8957–8965. DOI: https://doi.org/10.1109/ICCV.2019.00905
[14]
Y. Wang and J. M. Solomon, Deep Closest Point: Learning Representations for Point Cloud Registration, 2019. DOI: https://doi.org/10.48550/ARXIV.1905.03304
[15]
Z. Qin, H. Yu, C. Wang, Y. Guo, Y. Peng, S. Ilic, D. Hu, and K. Xu, GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformer, 2023. DOI: https://doi.org/10.48550/ARXIV.2308.03768.
[16]
F. Poiesi and D. Boscaini, Distinctive 3D local deep descriptors, 2020. DOI: https://doi.org/10.48550/ARXIV.2009.00258
[17]
F. Poiesi and D. Boscaini, “Learning general and distinctive 3D local deep descriptors for point cloud registration,” 2021. DOI: https://doi.org/10.48550/ARXIV.2105.10382
[18]
D. Bojanić, K. Bartol, J. Forest, T. Petković, and T. Pribanić, “Addressing the generalization of 3D registration methods with a featureless baseline and an unbiased benchmark,” Machine Vision and Applications, vol. 35, no. 3, p. 41, 2024. DOI: https://doi.org/10.1007/s00138-024-01510-w