Proposal: Multi-Modal Language Model for Medical Image Analysis
The proposed research project focuses on developing an innovative multi-modal large language model (MLLM) tailored for automated medical image analysis (MIA), particularly in tasks like inspection and segmentation. By combining the capabilities of large language models with visual data processing, this project aims to create a unified framework capable of interpreting and generating human-like text while simultaneously analyzing medical images. The model will be trained on a diverse dataset of medical images paired with corresponding text prompts, enabling it to automatically label and analyze images based on provided textual input. This approach has the potential to transform medical image analysis by improving efficiency, accuracy, and accessibility. The successful completion of this project will provide advanced tools to support medical professionals in diagnosis, treatment planning, and patient care.
Key research tasks will include data collection and preprocessing, designing the model architecture, pre-training and fine-tuning, evaluation and benchmarking, and optimizing and deploying the model. Anticipated outcomes include a novel MLLM architecture, superior performance in MIA tasks, and publications in high-impact journals and conferences. This project aims to bridge the gap between large language models and medical image analysis, creating new opportunities for research and real-world applications in healthcare.
About the Postdoctoral Programme
The postdoctoral programme at Xi'an Jiaotong-Liverpool University (XJTLU) is jointly managed by the XJTLU Technology Transfer Centre Co., Ltd. (XTTC) Postdoctoral Work Station and a partner Mobile Station, typically a Chinese state university.
XTTC serves as a specialized platform at XJTLU, focusing on translating scientific achievements into practical innovations, incubating new technological projects, and fostering collaboration between industry and academia. Leveraging the international research environment of XJTLU and its partner universities, XTTC strives to drive technological innovation by integrating domestic and international research resources. It explores core industrial technologies and provides strong support for research and development.
Since March 2017, XTTC has been recognized by the National Postdoctoral Management Office as a branch station of the postdoctoral workstation in Suzhou Industrial Park. XTTC is now actively recruiting outstanding PhD graduates for its postdoctoral programme.
Responsibilities
Research: Design, conduct, and analyze experiments to advance the field of study.
Collaboration: Work closely with faculty, research staff, and fellow postdocs to foster interdisciplinary cooperation and knowledge exchange.
Publication and Dissemination: Write and publish research papers in high-impact scientific journals, and present findings at conferences and seminars.
Grant Proposal Development: Assist in preparing grant proposals, conducting literature reviews, developing research plans, and contributing to budgeting.
Stay Informed: Keep up with the latest developments in the field and actively participate in discussions and journal clubs within the research group.
Compliance and Safety: Ensure adherence to ethical guidelines, safety protocols, and regulatory requirements in all research activities.
Personal Attributes
Initiative: A proactive, self-driven approach to identifying research opportunities, proposing new ideas, and solving challenges.
Collaboration: Strong communication skills, active listening, and a constructive approach to group discussions.
Resilience: The ability to maintain a positive attitude and adapt in the face of setbacks or unexpected outcomes.
Ethical Conduct: Commitment to ethical research practices, ensuring the safety and well-being of yourself and others in the research environment.
These attributes, along with relevant qualifications and expertise, are essential for postdoctoral researchers striving to make meaningful contributions to their fields.
Essential Qualifications/Experience
PhD in a relevant field, with a strong background in deep learning, machine learning, statistics, or related disciplines.
Proven research and innovation abilities, with a commitment to full-time postdoctoral research.
Excellent English communication skills, both written and oral, suitable for an international academic environment.
Experience in collaborative research, particularly in interdisciplinary teams.
Prior experience in grant writing and proposal development is an advantage.
Commitment to maintaining a safe and inclusive research environment.
Must meet the requirements set by the National Postdoctoral Management Committee.
Citizenship and Visa Regulations
The selected candidate will sign a labor contract with XJTLU Technology Transfer Centre Co., Ltd. (XTTC), and their employment will be governed by Chinese labor laws, including regulations for work permits and visas.
Career Development
Professional Development: Postdoctoral researchers will have access to professional development training.
Future Opportunities: Those receiving a “Distinction” assessment at the end of their postdoctoral program may be offered permanent academic positions at XJTLU.
Research Funding Support
In addition to general research funding opportunities, postdoctoral researchers will have access to specific funding programs, such as the National Funding Program for Postdoctoral Researchers, the China Postdoctoral Science Fund, and various provincial and academic exchange programs.
Compensation and Benefits
The postdoctoral program offers a competitive salary and benefits package, with an initial two-year contract.
Salary: Total compensation of ¥600,000–700,000 over the two-year postdoc period, including both base salary and performance-based incentives.
Local Government Subsidy: An additional ¥7,500 monthly subsidy (for up to two years).
Relocation Allowance: Up to ¥300,000 for those who continue working in Suzhou after completing the postdoc.
Insurance: Comprehensive international insurance plans for both the researcher and their family.
Paid Leave: Including statutory holidays (11 days), annual leave (36 days), family leave, sick leave, marriage leave, paternity leave, parental leave, etc.
Work Visa and Residence Permit: XJTLU will sponsor work visas and residence permits for postdoctoral researchers.
How to Apply
Interested candidates should identify their research area, choose a potential supervisor, and submit their application including the following documents:
A cover letter and English CV, indicating country of citizenship and highest degree obtained.
Documentation of academic achievements, highlighting first-author or corresponding-author publications, funded research projects, patents, awards, and recent research activities.
For specific inquiries regarding the position, please contact Dr. Jionglong Su (jionglong.su@xjtlu.edu.cn) or Dr. Jia Meng (jia.meng@xjtlu.edu.cn).
.jpg)
0 Comments
If there is any doubt, he can ask me