Research

Highlights

ECCV 24Full paper + 3 Workshop paper

ICML 20243 full paper

TMLR 242 journal paper

CVPR 2024full paper + 2 workshop paper

IJCV 24journal paper

ICLR 24full paper and 2 workshop paper accepted

Resources

Videoson YouTube

Find videos from our talks and online paper presentations in our YouTube Channel

Source CodeOn GitHub

We typically publish the code with our papers on our GitHub page.

Publications

Selected list of recent papers. A full list of all publications can be found at our Google Scholar page.

2024

Learning the essential in less than 2k additional weights - a simple approach to improve image classification stability under corruptions

Kai Bäuerle, Patrick Müller, Syed Muhammad Kazim, Ivo Ihrke, Margret Keuper

Transactions on Machine Learning Research (TMLR)  ·  01 Jun 2024

RobustnessCNN

Preprint

Implicit Representations for Constrained Image Segmentation

J. P. Schneider, M. Fatima, J. Lukasik, A. Kolb, Margret Keuper, M. Moeller

ICML 24  ·  01 Jun 2024

robustness

Preprint

MultiMax - Sparse and Multi-Modal Attention Learning

Y. Zhou, Mario Fritz, Margret Keuper

ICML 24  ·  01 Jun 2024

MultiModal

Preprint

CosPGD - an efficient white-box adversarial attack for pixel-wise prediction tasks

Shashank Agnihotri, Stefen Jung, Margret Keuper

ICML 24  ·  01 Jun 2024

robustness

Preprint

As large as it gets-Studying Infinitely Large Convolutions via Neural Implicit Frequency Filters

Julia Grabinski, Janis Keuper, Margret Keuper

Transactions on Machine Learning Research (TMLR)  ·  01 Jun 2024

RobustnessCNN

Preprint

Are Vision Language Models Texture or Shape Biased and Can We Steer Them?

Paul Gavrikov, Jovita Lukasik, Steffen Jung, Robert Geirhos, Bianca Lamm, Jehanzeb Mirza, Margret Keuper, Janis Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRw 2024)  ·  01 Jun 2024

Generalization

Preprint

Ambiguous Annotations - When is a Pedestrian not a Pedestrian?

Luisa Schwirten, Jannes Scholz, Daniel Kondermann, Janis Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRw 2024)  ·  01 Jun 2024

Generalization

Preprint

Can Biases in ImageNet Models Explain Generalization?

Paul Gavrikov, Janis Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024)  ·  01 Jun 2024

GeneralizationBias

PreprintSource

Intra- and extra-source exemplar-based style synthesis for improved domain generalization

Yumeng Li, Dan Zhang, Margret Keuper, Anna Khoreva

International Journal of Computer Vision (IJCV 24)  ·  01 Jun 2024

Generative

Preprint

Retail-786k - a Large-Scale Dataset for Visual Entity Matching

Bianca Lamm, Janis Keuper

DMLR Workshop at International Conference on Learning Representations (ICLR 24)  ·  01 Jun 2024

Classification

PreprintSource

Urban Sound Propagation - a Benchmark for 1-Step Generative Modeling of Complex Physical Systems

Martin Spitznagel, Janis Keuper

DMLR Workshop at International Conference on Learning Representations (ICLR 24)  ·  01 Jun 2024

Generative

PreprintSource

Adversarial Supervision Makes Layout-to-Image Diffusion Models Thrive

Yumeng Li, Margret Keuper, Dan Zhang, Anna Khoreva1

Proceedings of the Nineth International Conference on Learning Representations (ICLR 24)  ·  01 Jun 2024

Generative

PreprintSource

Top-GAP - Integrating Size Priors in CNNs for more Interpretability, Robustness, and Bias Mitigation

Lars Nieradzik, Henrike Stephani, Janis Keuper

eCVX Workshop at ECCV 24  ·  01 Jun 2024

Robustness

Preprint

Can Visual Language Models Replace OCR-Based Visual Question Answering Pipelines in Production? A Case Study in Retail

Bianca Lamm, Janis Keuper

EVAL-FoMo Workshop at ECCV 24  ·  01 Jun 2024

FoundationModels

Preprint

Fake or JPEG? Revealing Common Biases in Generated Image Detection Datasets

Patrick Grommelt, Louis Weiss, Franz-Josef Pfreundt, Janis Keuper

CEGIS Workshop at ECCV 24  ·  01 Jun 2024

DeepFake

Preprint

Improving Feature Stability during Upsampling-Spectral Artifacts and the Importance of Spatial Context

Shashank Agnihotri, Julia Grabinski, Margret Keuper

Proceedings of the 18th European Conference on Computer Vision (ECCV 24)  ·  01 Jun 2024

Robustness

Preprint

2023

Improving Native CNN Robustness with Filter Frequency Regularization

Jovita Lukasik, Paul Gavrikov, Janis Keuper, Margret Keuper

Transactions on Machine Learning Research (TMLR)  ·  01 Jun 2023

RobustnessCNN

Preprint

An In-Depth Study of U-net for Seismic Data Conditioning - Multiple Removal by Move-Out Discrimination

Ricard Durall, Ammar Ghanim, Norman Ettrich, Janis Keuper

Geophysics - Journal of the Society of Exploration Geophysicists and American Association of Petroleum Geologists  ·  01 Jun 2023

GeophysicsCNN

Preprint

On the unreasonable vulnerability of transformers for image restoration and an easy fix

Shashank Agnihotri, Kanchana Vaishnavi Gandikota, Julia Grabinski, Paramanand Chandramouli, Margret Keuper

Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (ICCVw 2023)  ·  01 Jun 2023

robustness

Source

On the Interplay of Convolutional Padding and Adversarial Robustness

Paul Gavrikov, Janis Keuper

Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (ICCVw 2023)  ·  01 Jun 2023

robustness

Preprint

Assessing Domain Generalization of Semantic Segmenters with Synthetic Data

Yumeng Li, Dan Zhang, Margret Keuper, Anna Khoreva

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023)  ·  01 Jun 2023

segmentation

Preprint

Intra-Source Style Augmentation for Improved Domain Generalization

Yumeng Li, Dan Zhang, Margret Keuper, Anna Khoreva

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023)  ·  01 Jun 2023

Generative

Preprint

Neural Architecture Design and Robustness -- A Dataset

Steffen Jung1, Jovita Lukasik, Margret Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023)  ·  01 Jun 2023

robustness

Preprint

Fine-Grained Product Classification on Leaflet Advertisements

Daniel Ladwig, Bianca Lamm, Janis Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023)  ·  01 Jun 2023

retail

Preprint

Happy People -- Image Synthesis as Black-Box Optimization Problem in the Discrete Latent Space of Deep Generative Models

Steffen Jung, Jan Christian Schwedhelm, Claudia Schillings, Margret Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023)  ·  01 Jun 2023

GAN

Preprint

An Extended Study of Human-like Behavior under Adversarial Training

Paul Gavrikov, Janis Keuper, Margret Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023)  ·  01 Jun 2023

robustness

Preprint

Deep diffusion models for seismic processing

Ricard Durall, Ammar Ghanim, Mario Fernandez, Norman Ettrich, Janis Keuper

Computers and Geosciences  ·  01 Jun 2023

geophysics

Preprint

Neural Architecture Design and Robustness - A Dataset

Steffen Jung, Jovita Lukasik, Margret Keuper

Proceedings of the Tenth International Conference on Learning Representations (ICLR 23)  ·  01 Jun 2023

NASrobustness

Preprint

2022

Trading off Image Quality for Robustness is not Necessary with Regularized Deterministic Autoencoders

Amrutha Saseendran, Kathrin Skubch, Margret Keuper

NeurIPS 22, proceedings of the thirty-sixth Conference on Neural Information Processing Systems  ·  01 Jun 2022

robustnessVAE

Preprint

Robust Models are less Over-Confident

Julia Grabinski, Paul Gavrikov, Janis Keuper, Margret Keuper

NeurIPS 22, proceedings of the thirty-sixth Conference on Neural Information Processing Systems  ·  01 Jun 2022

CNNrobustness

PreprintSource

Impact of realistic properties of the point spread function on classification tasks to reveal a possible distribution shift

Patrick Müller, Alexander Braun, Margret Keuper

NeurIPS 2022 Workshop on Distribution Shifts - Connecting Methods and Applications  ·  01 Jun 2022

CNNmedical imaging

Preprint

Does Medical Imaging learn different Convolution Filters?

Paul Gavrikov, Janis Keuper

NeurIPS 22 Workshop - Medical Imaging meets NeurIPS  ·  01 Jun 2022

CNNmedical imaging

Preprint

Physics-informed learning of aerosol microphysics

Paula Harder, Duncan Watson-Parris, Philip Stier, Dominik Strassel, Nicolas R Gauger, Janis Keuper

Environmental Data Science Journal  ·  01 Jun 2022

PINNclimate

Preprint

Learning Where To Look--Generative NAS is Surprisingly Efficient

Jovita Lukasik, Steffen Jung, Margret Keuper

ECCV 2022 - Proceedings of the 17th European Conference, Tel Aviv, Israel  ·  01 Jun 2022

NAS

PreprintSource

FrequencyLowCut Pooling--Plug & Play against Catastrophic Overfitting

Julia Grabinski, Steffen Jung, Janis Keuper, Margret Keuper

ECCV 2022 - Proceedings of the 17th European Conference, Tel Aviv, Israel  ·  01 Jun 2022

CNNrobustness

PreprintSourceYouTube

CNN Filter DB - An Empirical Investigation of Trained Convolutional Filters

Paul Gavrikov, Janis Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022)  ·  01 Jun 2022

ORALCNNrobustness

PreprintSourceYouTube

Adversarial Robustness Through the Lens of Convolutional Filters

Paul Gavrikov, Janis Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2022)  ·  01 Jun 2022

CNNrobustness

PreprintSourceYouTube

Aliasing and adversarial robust generalization of CNNs

Julia Grabinski, Janis Keuper, Margret Keuper

Machine Learning, Springer 2022  ·  01 Jun 2022

robustnessCNN

PreprintYouTube

Higher-Order Multicuts for Geometric Model Fitting and Motion Segmentation

Evgeny Levinkov, Amirhossein Kardoost, Bjoern Andres, Margret Keuper

IEEE Transactions on Pattern Analysis and Machine Intelligence  ·  01 Jun 2022

MulticutSegmentation

Preprint

Surrogate NAS benchmarks - Going beyond the limited search spaces of tabular NAS benchmarks

Arber Zela, Julien Niklas Siems, Lucas Zimmer, Jovita Lukasik, Margret Keuper, Frank Hutter

Proceedings of the Tenth International Conference on Learning Representations (ICLR 22)  ·  01 Jun 2022

NAS

Preprint

Robust Models are less Over-Confident

Julia Grabinski, Paul Gavrikov, Janis Keuper, Margret Keuper

ICML 22 Workshop on NEW FRONTIERS IN ADVERSARIAL MACHINE LEARNING  ·  01 Jun 2022

robustnessCNN

Preprint

Is RobustBench/AutoAttack a suitable Benchmark for Adversarial Robustness?

Peter Lorenz, Dominik Strassel, Margret Keuper, Janis Keuper

The AAAI-22 Workshop on Adversarial Machine Learning and Beyond  ·  01 Jun 2022

GAN

Preprint

Aliasing coincides with CNNs vulnerability towards adversarial attacks

Julia Grabinski, Janis Keuper, Margret Keuper

The AAAI-22 Workshop on Adversarial Machine Learning and Beyond  ·  01 Jun 2022

robustnessCNN

Preprint

2021

Spectral distribution aware image generation

Steffen Jung, Margret Keuper

AAAI  ·  01 Jun 2021

CNN

Preprint

Multi-Class Multi-Instance Count Conditioned Adversarial Image Generation

Amrutha Saseendran, Kathrin Skubch, Margret Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021)  ·  01 Jun 2021

VAErobustness

Preprint

An Empirical Investigation of Model-to-Model Distribution Shifts in Trained Convolutional Filters

Paul Gavrikov, Janis Keuper

NeurIPS 21 Workshop - Distribution shifts - connecting methods and applications (DistShift)  ·  01 Jun 2021

CNN

Preprint

Shape your Space - A Gaussian Mixture Regularization Approach to Deterministic Autoencoders

Amrutha Saseendran, Kathrin Skubch, Stefan Falkner, Margret Keuper

NeurIPS 21, proceedings of the thirty-sixth Conference on Neural Information Processing Systems  ·  01 Jun 2021

VAE

Preprint

Smooth variational graph embeddings for efficient neural architecture search

Jovita Lukasik, David Friede, Arber Zela, Frank Hutter, Margret Keuper

Proceedings of the Nineth International Conference on Learning Representations (ICLR 21)  ·  01 Jun 2021

NAS

PreprintSource

2020

Detection of point scatterers using diffraction imaging and deep learning

Valentin Tschannen, Matthias Delescluse, Norman Ettrich, Janis Keuper

Geophysical Prospecting  ·  01 Jun 2020

GeophysicsCNN

Preprint

Extracting horizon surfaces from 3D seismic data using deep learning

Valentin Tschannen, Matthias Delescluse, Norman Ettrich, Janis Keuper

Geophysics - Journal of the Society of Exploration Geophysicists and American Association of Petroleum Geologists  ·  01 Jun 2020

GeophysicsCNN

Preprint

Watch your Up-Convolution - CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributions

Ricard Durall, Margret Keuper, Janis Keuper

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020)  ·  01 Jun 2020

GANrobustnessdeepfake

PreprintSourceLink

A full list of all publications at our Google Scholar