In the critical field of pathology, remote collaboration between experts and local surgeons is vital for accurate diagnosis and treatment planning. Traditional telemedicine, reliant on 2D images and video, lacks the depth information necessary for precise spatial guidance during procedures like tissue sampling. To bridge this gap, KFBIO has partnered with the Smart Computational Imaging Laboratory (SCI Lab) at Nanjing University of Science and Technology to develop a groundbreaking 3D Structured Light Imaging Instrument. This system not only captures high-resolution, color 3D models of biological tissues but also allows remote experts to project interactive cutting guides directly onto the sample in real-time.

The Challenge: From Flat Images to Actionable 3D Guidance

Pathology telemedicine aims to connect local medical teams with specialized experts worldwide. However, communicating complex three-dimensional anatomy and specifying exact incision lines through flat screens is fraught with ambiguity. Misunderstandings can lead to suboptimal tissue sampling. The need is clear: a system that digitizes the physical specimen into an accurate 3D model and enables intuitive, visual guidance as if the expert were physically present.

Our Solution: A Tri-View 3D Imaging and Interactive Projection System

The core of this collaborative innovation is a compact, robust system featuring one digital projector and three high-resolution color cameras. It operates on the principle of Fringe Projection Profilometry (FPP), where precisely designed sinusoidal light patterns are projected onto the tissue. By analyzing the distortion of these patterns from three different angles, the system reconstructs a detailed 3D point cloud with color texture.

Key Technological Advancements:

• Optimized Fringe Patterns: Unlike conventional systems, we designed custom fringe patterns with orientations perpendicular to the baseline between each camera and the projector. This optimization significantly improves the signal-to-noise ratio and measurement accuracy.

• Robust Calibration: We introduced a novel calibration method using the diagonal center of checkerboard squares, eliminating errors caused by perspective distortion and ensuring superior calibration accuracy for the projector.

• Intelligent 3D Denoising: Biological tissues present challenges like shadows, occlusions, and reflections. Our system employs a sophisticated denoising strategy that uses phase consistency checks and region identification to filter out noise, delivering clean and reliable 3D data.

• The Interactive Breakthrough – Reverse Projection: This is the system’s pivotal function. A remote expert can view the 3D model on their screen, draw cutting lines or markers directly on it, and with one click, project these guidelines precisely onto the physical sample in the local lab. This creates an intuitive “augmented reality” layer for perfect surgical guidance.

Validated Performance: Speed, Accuracy, and Reliability

The research validates the system’s capability for practical medical use:

• High Speed: Complete 3D reconstruction, including acquisition and processing, takes less than 3 seconds.

• Exceptional Accuracy: Evaluation with standard spheres and planes demonstrated a repeatability error of less than 10 µm over a field of view of 6×10 cm, meeting the stringent requirements for pathological analysis.

• Effective Denoising: Experiments on complex biological samples (like heart and gizzard tissue) show the system successfully removes artifacts while preserving critical morphological details.

From Lab to Clinic: Enhancing the KFBIO KF-GSC-200 Gross Sample Imaging System

This research is not confined to the laboratory. The core technology is integrated into KFBIO’s Gross Sample Imaging System, KF-GSC-200, significantly augmenting its capabilities.

• Beyond Documentation to Guidance: While traditional grossing stations document samples, the KF-GSC-200, empowered by this 3D technology, facilitates interactive remote collaboration. Experts can guide the grossing process step-by-step, ensuring optimal specimen selection for diagnosis.

• Improved Workflow Efficiency: The rapid, accurate 3D modeling provides a superior digital record compared to 2D photography, aiding in pathological assessment, archival, and review.

• A Foundation for Digital Pathology: This technology paves the way for advanced applications, such as 3D margin assessment and volumetric tumor analysis, within a comprehensive digital pathology ecosystem.

Conclusion: Redefining Remote Collaboration in Pathology

The collaborative work between KFBIO and SCI Lab represents a significant leap forward in pathology telemedicine. By fusing high-precision 3D imaging with real-time interactive projection, we are transforming how expert knowledge is delivered across distances. This technology enhances diagnostic confidence, improves surgical outcomes, and is a cornerstone of next-generation, intelligent pathology solutions like the enhanced KF-GSC-200 system.

---

Reference

This application is based on the collaborative research between KFBIO and the Smart Computational Imaging Laboratory:
Hu, Y., Liang, Z., Wang, K., Gui, K., Zhang, J., Chen, Q., & Zuo, C. (2023). Structured Light 3D Imaging Instrument for Biological Tissues With Potential Application in Telemedicine. IEEE Transactions on Instrumentation and Measurement, 73, 5001411. https://doi.org/10.1109/TIM.2023.3331396

Ready to bring interactive 3D guidance to your pathology workflow? Contact KFBIO to learn more about our advanced imaging solutions.