Low latency 3D image streaming in medicine
DOI:
https://doi.org/10.52846/stccj.2023.3.2.53Keywords:
Visualization, 3D visualization, multi-user, digital pathology, network communication, video streaming in medicine, virtual user generation, hardware utilization testingAbstract
3D visualization has been present in medicine for several decades, just think of the CT (Computer Tomography) imaging modality, which is capable of creating 3D images of the examined object by determining the radiation attenuation coefficient. In addition to CT equipment, there are many solutions capable of collecting and displaying various 3D data (MRI [Magnetic Resonance Imaging], PET [Positron Emission Tomography], OCT [Optical Computer Tomography]). In digital pathology, 3D visualization is not nearly as widespread as the previously mentioned solutions. One of the main reasons for this is the size of the digitized pathological samples and the hardware resources required for their 3D visualization. In the paper, we present a client-server architecture that can provide a solution to the existing hardware limitations during the 3D visualization of digitized pathological samples. In the paper, we present the basic structure of our solution, several main functionalities, and the testing of the server software we developed.
References
P. Baranyi, Á. Csapó, T. Budai, and G. Wersényi, ‘Introducing the Concept of Internet of Digital Reality – Part I’, ACTA POLYTECH HUNG, vol. 18, no. 7, pp. 225–240, 2021
A. Molnár, I. Lovas, and Z. Domozi, ‘Practical Application Possibilities for 3D Models Using Low-resolution Thermal Images’, ACTA POLYTECH HUNG, vol. 18, no. 4, pp. 199–212, 2021
Vincze, M.; Molnar, B.; Kozlovszky, M. 3D Visualization in Digital Medicine Using XR Technology. Future Internet 2023, 15, 284.
M. Falk, A. Ynnerman, D. Treanor, and C. Lundstrom, ‘Interactive Visualization of 3D Histopathology in Native Resolution’, IEEE Trans. Visual. Comput. Graphics, vol. 25, no. 1, pp. 1008–1017, Jan. 2019
R. K. P. Mok, E. W. W. Chan, and R. K. C. Chang, ‘Measuring the quality of experience of HTTP video streaming’, in 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops, Dublin, Ireland, May 2011, pp. 485–492.
N. Staelens, M. H. Pinson, P. Corriveau, F. D. Turck, and P. Demeester, ‘MEASURING VIDEO QUALITY IN THE NETWORK: FROM QUALITY OF SERVICE TO USER EXPERIENCE’, p. 6.
I. M. I. Zebari, S. R. M. Zeebaree, and H. M. Yasin, ‘Real Time Video Streaming From Multi-Source Using Client-Server for Video Distribution’, in 2019 4th Scientific International Conference Najaf (SICN), Al-Najef, Iraq, Apr. 2019, pp. 109–114.
S. Park, M. Hoai, A. Bhattacharya, and S. R. Das, ‘Adaptive Streaming of 360-Degree Videos with Reinforcement Learning’, in 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA, Jan. 2021, pp. 1838–1847.
Liu Yijun, Chen Wenbin, and He Xiaoman, ‘3D graphics engine technology research and implementation’, in 2010 3rd International Conference on Computer Science and Information Technology, Chengdu, China, Jul. 2010, pp. 697–700.
A. Thorn, Moving from Unity to Godot: An In-Depth Handbook to Godot for Unity Users. 2020.
Zhao, Y., Luo, C., Tang, C., Chen, D., Codella, N., & Zha, Z. J. (2023). Streaming Video Model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 14602-14612).
Li, B., Wang, Z., Liu, J., and Zhu, W. 2013. Two decades of Internet video streaming: A retrospective view. ACM Trans. Multimedia Comput. Commun. Appl. 9, 1s, Article 33 (October 2013), 20 pages.
Yin, G., Jiang, X., Jiang, S., Han, Z., Zheng, N., Yang, H., ... & Qiu, L. (2023). Online Video Streaming Super-Resolution with Adaptive Look-Up Table Fusion. arXiv preprint arXiv:2303.00334.
Dapeng Wu, Y. T. Hou, Wenwu Zhu, Ya-Qin Zhang and J. M. Peha, "Streaming video over the Internet: approaches and directions," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, no. 3, pp. 282-300, March 2001
U. Rahamathunnisa and D. R. Saravanan, ‘A SURVEY ON VIDEO STREAMING OVER MULTIMEDIA NETWORKS USING TCP’, . Vol., vol. 53, p. 6, 2005.
B. Li, Z. Wang, J. Liu, and W. Zhu, ‘Two decades of internet video streaming: A retrospective view’, ACM Trans. Multimedia Comput. Commun. Appl., vol. 9, no. 1s, pp. 1–20, Oct. 2013
S. Ando, Y. Hayashi, T. Mizuki, and H. Sone, ‘Basic Study on the Method for Real-Time Video Streaming with Low Latency and High Bandwidth Efficiency’, in 2015 IEEE 39th Annual Computer Software and Applications Conference, Taichung, Taiwan, Jul. 2015, pp. 79–82.
M. Michalos, S. Kessanidis, and S. L. Nalmpantis, ‘Dynamic adaptive streaming over HTTP’, Journal of Engineering Science and Technology Review, vol. 5, pp. 30–34, Jun. 2012.
Jae Chung and M. Claypool, "Analysis of active queue management," Second IEEE International Symposium on Network Computing and Applications, 2003. NCA 2003., Cambridge, MA, USA, 2003, pp. 359-366.
Morais, Wladimir Gonçalves de, Carlos Eduardo Maffini Santos, and Carlos Marcelo Pedroso. ‘Application of Active Queue Management for Real-Time Adaptive Video Streaming’. Telecommunication Systems 79, no. 2 (February 2022): 261–70.
Giménez, A.; Murcia, M.A.; Amigó, J.M.; Martínez-Bonastre, O.; Valero, J. New RED-Type TCP-AQM Algorithms Based on Beta Distribution Drop Functions. Appl. Sci. 2022, 12, 11176.
Yue-Dong Xu, Zhen-Yu Wang and Hua Wang, "ARED: a novel adaptive congestion controller," 2005 International Conference on Machine Learning and Cybernetics, Guangzhou, China, 2005, pp. 708-714 Vol. 2.
D. M. Raghuvanshi, B. Annappa and M. P. Tahiliani, "On the Effectiveness of CoDel for Active Queue Management," 2013 Third International Conference on Advanced Computing and Communication Technologies (ACCT), Rohtak, India, 2013, pp. 107-114.
I. Järvinen and M. Kojo, "Evaluating CoDel, PIE, and HRED AQM techniques with load transients," 39th Annual IEEE Conference on Local Computer Networks, Edmonton, AB, Canada, 2014, pp. 159-167.
H. H. Soliman, H. M. El-Bakry, and M. Reda, ‘Real-Time Transmission of Video Streaming over Computer Networks’, p. 13.
Davis CR, Rosenfield LK. Looking at plastic surgery through google glass: Part 1. Systematic review of google glass evidence and the first plastic surgical procedures. Plast Reconstr Surg. 2015;135:918–928
Yoon, Hyoseok, Sun Kyung Kim, Youngho Lee, and Jongmyung Choi. ‘Google Glass-Supported Cooperative Training for Health Professionals: A Case Study Based on Using Remote Desktop Virtual Support’. Journal of Multidisciplinary Healthcare Volume 14 (June 2021): 1451–62.
A. Schneider et al., ‘Wireless live streaming video of surgical operations: an evaluation of communication quality’, J Telemed Telecare, vol. 13, no. 8, pp. 391–396, Dec. 2007.
M. M. Jack, D. A. Gattozzi, P. J. Camarata, and K. J. Shah, ‘Live-Streaming Surgery for Medical Student Education - Educational Solutions in Neurosurgery During the COVID-19 Pandemic’, Journal of Surgical Education, vol. 78, no. 1, pp. 99–103, Jan. 2021.
Hanna, Matthew G., Ishtiaque Ahmed, Jeffrey Nine, Shyam Prajapati, and Liron Pantanowitz. ‘Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology’. Archives of Pathology & Laboratory Medicine 142, no. 5 (1 May 2018): 638–44.
Vitkovski, Taisia, Tawfiqul Bhuiya, and Michael Esposito. ‘Utility of Telepathology as a Consultation Tool between an Off-Site Surgical Pathology Suite and Affiliated Hospitals in the Frozen Section Diagnosis of Lung Neoplasms’. Journal of Pathology Informatics 6, no. 1 (January 2015): 55.
M. Y. Fuller, S. Mukhopadhyay, and J. M. Gardner, ‘Using the Periscope Live Video-Streaming Application for Global Pathology Education: A Brief Introduction’, Archives of Pathology & Laboratory Medicine, vol. 140, no. 11, pp. 1273–1280, Nov. 2016.
M. Vincze, B. Biricz, M. Kozlovszky and A. Benhamida, "Real-time video streaming in medicine using virtual reality," 2023 IEEE 17th International Symposium on Applied Computational Intelligence and Informatics (SACI), Timisoara, Romania, 2023, pp. 000183-000188.
Downloads
Published
Issue
Section
How to Cite
Accepted 2023-12-27
Published 2023-12-31
