Postdoctoral Researcher On Ai Models Evaluation

Postdoctoral researcher on AI Models Evaluation (R2) Join to apply for the Postdoctoral researcher on AI Models Evaluation (R2) role at Barcelona Supercomputing Center Job Reference: 733_25_LS_INB_R2 Closing Date: Monday, 15 December, **** Job TitlePostdoctoral researcher on AI Models Evaluation (R2) About BSCThe Barcelona Supercomputing Center - Centro Nacional de Supercomputación (BSC-CNS) is the leading supercomputing center in Spain. It houses MareNostrum, one of the most powerful supercomputers in Europe, was a founding and hosting member of the former European HPC infrastructure PRACE (Partnership for Advanced Computing in Europe), and is now hosting entity for EuroHPC JU, the Joint Undertaking that leads large-scale investments and HPC provision in Europe. The mission of BSC is to research, develop and manage information technologies in order to facilitate scientific progress. BSC combines HPC service provision and R&D into both computer and computational science (life, earth and engineering sciences) under one roof, and currently has over **** staff from 60 countries. Context And Mission The Technologies for Biomedical Research Lab (TechBio Lab) within the Life Sciences Department of the Barcelona Supercomputing Center (BSC) brings together specialised teams to enable research activities in the Life Sciences. These teams cover a range of areas, including research data and software, infrastructure for centralized and federated analysis and learning, etc. From a technical perspective, TechBio Lab's activities focus on developing infrastructures that support Life Sciences research, including software components for bioinformatics, research data management– especially in healthcare–and scientific and technical benchmarking of research software in close collaboration with various communities and projects. Special attention is given to technological developments enabling the analysis of sensitive data in federated settings. This approach facilitates the generation of AI models without requiring data to be moved from its original site. Complementing these efforts, the lab also contributes to the development of Trusted Research Environments that enable the use of research data on single sites under specific, configurable usage conditions. The laboratory coordinates the Spanish National Bioinformatics Institute (INB). The Spanish National Bioinformatics Institute (INB) is the major bioinformatics platform in Spain and the Spanish node of ELIXIR. ELIXIR (European Life Science Infrastructure for Biological Information) is a pan-European organization founded in **** which aims to integrate and harmonize European bioinformatics infrastructures. ELIXIR coordinates the participation of more than 22 countries; engages with other strategic European initiatives and projects, e.g. ESFRI, Research Data Alliance, EUDat and EGI; promotes specific training activities and workshops on ELIXIR resources, partners with industry, and play a key role in shaping the bioinformatics landscape. Within ELIXIR, the INB is responsible for the bioinformatics infrastructure offered by Spain and, therefore, should guarantee its alignment with the strategic areas put forward by ELIXIR. Since ****, the INB has two overarching objectives: deepen the alignment of its activities with ELIXIR, and increase the translational impact of INB actions towards the Spanish National Health System (SNS). For the latter objective, the INB has created and supported TransBioNet (Translational Bioinformatics Network), which aims to structure, bring together and work with bioinformatics groups in healthcare settings with a particular focus on the Health Research Institutes (IIS) recognized by the ISCIII. The INB coordinates the Data Science programme within the Spanish Infrastructure for Personalized Medicine associated with Science and Technology (IMPaCT in Spanish), which aims to establish an interoperable framework for biomedical data integration and analysis, addressing questions from clinicians through the implementation of computing systems in health environments. This programme will prepare clinical data in Spain for secondary use, including medical imaging, structured and non-structured clinical data and genomics, considering all the legal provisions for each possible use and setting. This programme will involve the liaison with diverse stakeholders, including hospitals, the ISCIII, companies in the biomedical sector, the Spanish Medicines Agency and biomedical researchers, among others. All developments will be aligned with the European initiatives in the area, including those from ELIXIR, 1+Million Genomes, the Global Alliance for Genomics and Health and data-sharing projects such as FAIR4Health, HealthyCloud and TEHDAS. In **** the INB, the Spanish Node of ELIXIR, renovated its portfolio of bioinformatics resources, including platforms, databases, individual tools and web-services. This portfolio, known as Service Delivery Plan (SDP), constitutes the scientific-technical contribution of Spain to ELIXIR. The candidate will join a dynamic Life Sciences department team, working in the highly cooperative, multidisciplinary, distributed context of ELIXIR and INB (Spanish National Bioinformatics Institute/ELIXIR-ES) and related national initiatives, such as TransBioNet. Key Duties Contribute towards the development of AI Models evaluation, including the evaluation of LLMs. Contribute to advance the knowledge and adoption of the AI-related technologies, including AI agentic frameworks. Contribute towards the evaluation of data used to train, refine and fine-tune AI models identifying potential biases. Contribute towards the indicators derived of the broad AI Models evaluation and associated assets, e.g. data used. Contribute to supervise junior members at the TechBio Lab and the INB Computational Unit at the BSC. Ensure the adoption of good practices for software development, following the guidelines of ELIXIR. Maintain communication with ELIXIR platforms, communities, and management, participate in regular meetings and discussions. RequirementsEducation Preferably a PhD in Bioinformatics, computational biology or computer sciences with significant bioinformatics experience. Minimum Level Required Is MSc.Essential Knowledge and Professional Experience Over 5 years' experience in Software Metadata evaluation. Over 5 years' experience in database design and management (SQL and noSQL). Over 5 years' experience in programming language ecosystems such as C++, Perl, Python, PHP and/or Java Over 2 years' experience in the use of LLMs for carrying on evaluation activities. Vast experience working with Unix/Linux systems. Additional Knowledge And Professional ExperienceExperience in the development, generation and use of software containers, e.g. Docker, Singularity and/or rkt, as well as their orchestration using docker-compose, Kubernetes, ansible and/or similar technologies. Experience with workflow managers such as Galaxy, Nextflow or similar. Experience in developing project technical specifications. Competences Ability to understand scientific literature, and software documentation. Ability to communicate scientific results. Ability to work independently. Ability to represent the team in international project meetings. Used to working under pressure under strict deadlines. Conditions The position will be located at BSC within the Life Sciences Department We offer a full-time contract (37.5h/week), a good working environment, a highly stimulating environment with state-of-the-art infrastructure, flexible working hours, extensive training plan, restaurant tickets, private health insurance, support to the relocation procedures Duration: Open-ended contract due to technical and scientific activities linked to the project and budget duration Holidays: 22 days of holidays + 6 personal days + 24th and 31st of December per our collective agreement Salary: we offer a competitive salary commensurate with the qualifications and experience of the candidate and according to the cost of living in Barcelona Starting date: 01/01/2026 Applications procedure and process All applications must be submitted via the BSC website and contain: A full CV in English including contact details A cover/motivation letter with a statement of interest in English, clearly specifying for which specific area and topics the applicant wishes to be considered. Additionally, two references for further contacts must be included. Applications without this document will not be considered. Development of the recruitment process The selection will be carried out through a competitive examination system ("Concurso-Oposición"). The Recruitment Process Consists Of Two PhasesCurriculum Analysis: Evaluation of previous experience and/or scientific history, degree, training, and other professional information relevant to the position. 40 points Interview phase: The highest-rated candidates at the curriculum level will be invited to the interview phase, conducted by the corresponding department and Human Resources. In this phase, technical competencies, knowledge, skills, and professional experience related to the position, as well as the required personal competencies, will be evaluated. 60 points. A minimum of 30 points out of 60 must be obtained to be eligible for the position. The recruitment panel will be composed of at least three people, ensuring at least 25% representation of women. In accordance with OTM-R principles, a gender-balanced recruitment panel is formed for each vacancy at the beginning of the process. After reviewing the content of the applications, the panel will begin the interviews, with at least one technical and one administrative interview. At a minimum, a personality questionnaire as well as a technical exercise will be conducted during the process. The panel will make a final decision, and all individuals who participated in the interview phase will receive feedback with details on the acceptance or rejection of their profile. At BSC, we seek continuous improvement in our recruitment processes. For any suggestions or comments/complaints about our recruitment processes, please contact ******. BSC-CNS is an equal opportunity employer committed to diversity and inclusion. We are pleased to consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or any other basis protected by applicable state or local law. Seniority level Internship Employment type Contract Job function Research, Analyst, and Information Technology Industries Research Services Referrals increase your chances of interviewing at Barcelona Supercomputing Center by 2x Get notified about new Postdoctoral Researcher jobs in Barcelona, Catalonia, Spain J-*****-Ljbffr