Welcome to my academic portfolio. I am a dedicated researcher with a deep commitment to advancing the field of medical imaging and computer vision. My work primarily revolves around the development and refinement of multi-modal models, which integrate various forms of data to enhance learning and predictive accuracy.

Currently, I am engaged as a Part-Time Research Assistant (PT RA) at HKMU, where my research focuses on Natural Language Processing (NLP) and Vision-Language Models (VLM). I am particularly fascinated by the potential of foundation models in transforming information retrieval systems, making them more intuitive and efficient.

Through my research, I aim to bridge the gap between theoretical computer science and practical, impactful applications in healthcare and digital information systems. If you have any inquiries or need consultation, please feel free to contact me at 905152222jyf [AT] gamil [DOT] com.

Join me as I explore the cutting-edge of technology and medicine, striving to innovate solutions that improve both diagnostics and accessibility to information.

In my blog, you will find in-depth discussions and analyses on a broad range of topics including deep learning and medical imaging. I frequently share case studies and insights on how theoretical knowledge can be applied to solve real-world problems in the healthcare sector, particularly in the use of advanced technologies for diagnostic imaging. Additionally, my blog provides updates and commentary on the latest technological trends that are transforming both healthcare and digital information systems.

If you have a strong interest in these topics or specific questions, my blog also features an interactive area where you can post comments or ask questions. I highly encourage any form of interaction and discussion, as it helps us all learn and grow together. I hope my blog becomes a go-to resource for you as we explore the intersections of technology and medicine, collectively pushing forward the boundaries of science and technology.

🔥 News

• 2024.03-(now):  🎉🎉 I’m joining PolyU as a incoming Ph.D. student. Another new journey is coming!
• 2024.06-(now):  🎉🎉 I am currently working as a Research Assistant (RA) at HKMU, focusing on Natural Language Processing (NLP) research.

📝 Publications

📷 Computer Vision & Medical Imaging

ICSP 2022

COTS recognition and detection based on Improved YOLO v5 model

Yufeng Jiang

Project

• Research Focus: Utilizing YOLOv5 and WBF models to accurately detect and monitor the distribution of crown-of-thorns starfish (COTS), crucial for the protection of the Great Barrier Reef.
• Key Achievements:
  • Developed a high-precision detection model verified on KAGGLE, demonstrating significant improvement over traditional methods like Faster R-CNN.
  • Provided actionable insights for sustainable ecological management and protection strategies of the reef ecosystem.

MICCAI 2024

M⁴oE: A Foundation Model for Medical Multimodal Image Segmentation with Mixture of Experts

Yufeng Jiang, Yiqing Shen

Project

• Research Focus:
• The Medical Multimodal Mixture of Experts (M4oE) framework, based on SwinUNet architecture, addresses the challenge of multimodal medical image segmentation by employing modality-specific experts and a dynamic gating network for enhanced scalability and interpretability. M4oE not only achieves superior performance across multiple datasets but also significantly reduces computational overhead, making it highly efficient for handling diverse medical imaging data. The full implementation and experiments are detailed on the project’s GitHub repository, available at M4oE GitHub.

• ICA 2023 Enhancing Continuous Sign Language Recognition with Self-Attention and MediaPipe Holistic, Jiang, Yufeng., Li, F., Li, Z., Liu, Z., & Wang, Z.
• ICA 2023 American Sign Language Alphabet Recognition with YOLOv5 Enhanced by MediaPipe Hands., Wang, Zijian, Liu, Ziwei, Li, Zongxi, Jiang, Yufeng, and Li, Fengheng.

🎖 Honors and Awards

• 2020-2023 Dean’s List (6 times in my bachelor’s degree)
• 2022-2023 Outstanding Student Award (Top Student, 2 times in my bachelor’s degree)
• 2022-2023 Outstanding Student Scholarship (1 time in my bachelor’s degree)
• 2023.12 Distinction Scholarship (in my master’s degree)
• 2024.06 Distinction Scholarship (in my master’s degree)

📖 Educations

• 2024.09 - (now), Ph.D. in Computer Science, The Hong Kong Polytechnic University, Hong Kong.
• 2023.09 - 2024.06, M.S. in Computer Science, Hong Kong Baptist University, Hong Kong (cGPA 3.79/4, taught in Eng).
• 2019.09 - 2023.06, B.S. in Computer Science, Hong Kong Metropolitan University, Hong Kong (cGPA 3.54/4, taught in English).

💻 Internships

• 2024.06 - (now), Research Assistant, Hong Kong Metropolitan University.
• 2022.01 - 2022.02, Remote Internship, Nanyang Technological University.
  • Python for Data Analytics – Data Analysis using Python: Utilized Numpy, Pandas, Matplotlib, and Seaborn for data analysis and visualization. – Machine Learning Principles: Mastered unsupervised learning and supervised learning principles. – Scikit-learn: Proficient in using the scikit-learn machine learning library.
• 2022.01 - 2022.02, Remote Internship, Imperial College, London.
  • Innovating the Future with Robotics, IoT, and AI – Machine Learning with Python: Mastered using k-NN and k-means for image recognition processing, as well as decision trees for accurate image recognition. – Understanding Robotics and Artificial Intelligence: Gained insights into the challenges and opportunities in modern robotics and artificial intelligence development.