鶹ý

News

The research puzzle of when humans and AI don’t see eye to eye

Francesco Croce will be working on robustness in multi-modal foundation models at ELLIS Institute Finland and Aalto University.

A sticker on a traffic sign can cause a self-driving car to crash. A few pixels of noise can make a neural network decide that an image of a dog actually shows a bird. These are just some examples of how AI systems can behave unreliably, displaying an inconsistency that is a bit hard for people to understand. “Why this happens is a mystery,” says Francesco Croce. “Features that are very important for humans are not important for models and vice versa, and why models solve tasks in odd ways is also a safety and a legal concern.”

A person wearing a light grey hoodie stands indoors with a brick wall and green plants in the background.
Francesco Croce. Photo by Matti Ahlgren/Aalto University

Croce has just joined and Aalto University to work on these problems of adversarial robustness: making machine learning outcomes stable in the face of strange inputs or even malicious attacks. He is also interested in how AI systems do or don’t align with human perception, for example, do they caption or classify images correctly. Croce was previously a postdoctoral fellow at the Swiss Federal Institute of Technology Lausanne (EPFL) and he is now a PS Fellow and assistant professor at Aalto.

Croce’s career so far has taken him from his native Italy, where he studied mathematics, to Germany for a PhD in machine learning and to London for an internship with Google DeepMind. “It’s lucky that I've been to several places where there were great researchers,” he says. Though ending up in Finland was a bit random, Croce admits, the establishment of the ELLIS Institute was a motivator to apply. “There’s a solid plan for working with AI research in Europe, the computing power of course, and they are building something that will hopefully last long and have an impact.”

At the ELLIS Institute, Croce is now set to recruit PhD students and postdocs who are interested in applying adversarial robustness to multi-modal models. He previously developed , and is now keen to extend the work to other domains like generative AI.

Students should actually enjoy the research process, says Croce—“not just writing papers and getting lines on your CV”. Creativity is also an important trait for researchers: “To imagine something that doesn’t exist yet and find the good questions, to understand what’s currently missing and what’s relevant to push things forward.”

Contact:

Read more:

Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland welcomes 9 new professors as principal investigators and PS Fellows

Institute's first recruitment brings nine leading researchers to Finland

News
Group of people standing in a room holding a ribbon, with presentation screen and institute banner in the background.

New Fundamentals: ELLIS Institute Finland launches with bold scientific ambitions

AI and ML for transforming R&D, enhancing human-AI teamwork, and creating exciting new science

News
Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland is a world-class research hub in AI and machine learning and part of the European Laboratory for Learning and Intelligent Systems (ELLIS).

  • Updated:
  • Published:
Share
URL copied!

Read more news

Person at shared desk browsing a student course catalogue on a laptop, with plants and office supplies nearby
Cooperation, University Published:

Doctoral positions at Unite! universities now available in one place

Unite! students searching for doctoral positions can now explore a dedicated category in the Unite! Catalogue for Students.
Pauliina Ilmonen, photo by Nita Vera.
Appointments, Studies Published:

Professor Pauliina Ilmonen: Learning mathematical software in upper secondary school takes time away from learning the basics

Pauliina Ilmonen, Professor of Statistics at Aalto University, will step into the role of Dean of the School of Science at the beginning of June. She wants to emphasize the fundamentals in the study of mathematics.
Technology sector Finnish
Cooperation Published:

Integrating Finnish into English-language technology instruction: the opportunities and challenges of AI-generated videos

In this blog post, teaching assistant Rainer Ruuskanen explains how AI-generated videos can be used to bring some Finnish language into the teaching of subject content in English to support international students' learning of Finnish.
Brown-toned display of wood, pulp, fibre, thread cone and knitted fabric, showing stages from log to textile.
Research & Art Published:

The journey of a 17th-century shipwreck continues as a unique knitted dress

Researchers at Aalto University transformed surplus wood from the Hahtiperä shipwreck into textile fibre, spun it into yarn, and knitted it into a dress using new AI-assisted technology.