Dr. Dimitri(o)s Mallis

Computer Vision Researcher @ SnT • PhD from the University of Nottingham.

Welcome!! 👋 I am a Postdoctoral Researcher at the Interdisciplinary Centre for Security, Reliability and Trust (SnT) of the University of Luxembourg, focusing on 3D Computer Vision and it’s applications for Computer-Aided Design (CAD).

I received my PhD in Computer Vision at the University of Nottingham under the supervision of Dr. Yorgos Tzimiropoulos. I was also a Research Intern at Samsung AI Cambridge (SAIC) and later a Senior Machine Learning Engineer for Taboola and Deeplab.

In this website you can find more info about me, check publications and recent news. You can also browse through my photography here 📸 !!

Research

Currently my focus in on 3D vision and it’s application towards accelerating parametric Computer-Aided Design (CAD). I am particularly interested in automated reverse engineering of 2D/3D CAD models, effective recovery of construction history and capturing of design intent.

During my PhD, I concentrated on learning with minimal manual supervision through self-supervised and semi-supervised learning, specifically for the tasks of landmark detection and human pose estimation. Later, I also looked into deep learning based recommender systems and the problem of click-through-rate (CTR) prediction.

News

Oct 01, 2023	Great news to share: Our paper on Interpretable Visual Question Answering Via Reasoning Supervision will be presented on ICIP 2023 as a lecture 🎉. Great work from Maria Parelli 🎉. Thanks to all authors, Markos Diomataris and Vassilis Pitsikalis and Deeplab for a great collaboration.
Sep 10, 2023	Happy to share that our paper entitled SHARP 2023 Challenge: Solving CAD History and pArameters Recovery from Point clouds and 3D scans. Overview, Datasets, Metrics, and Baselines will be presented at the SHARP2023 ICCV Workshop.
Jun 04, 2023	The 4th edition of the SHARP Challenge, organized in conjunction with ICCV 2023 is now officially announced and registrations are open. Join the challenge here! Total prize of 🔸 8k€ to win sponsored by Artec 3D 🏆
Apr 01, 2023	I have now started my new position as Postdoctoral Researcher at the SnT, Interdisciplinary Centre for Security, Reliability and Trust of the University of Luxembourg.
Jan 04, 2023	Our paper From Keypoints to Object Landmarks via Self-Training Correspondence: A novel approach to Unsupervised Landmark Discovery has been accepted for publication at IEEE Transactions on Pattern Analysis and Machine Intelligence. The paper extends our NeurIPS 2020 work on unsupervised landmark discovery both conceptually and experimentally!

Selected Publications [View All]

TPAM2023
From Keypoints to Object Landmarks via Self-Training Correspondence: A novel approach to Unsupervised Landmark Discovery

Dimitrios Mallis, Enrique Sanchez, Matt Bell, and Georgios Tzimiropoulos

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023

Abs arXiv Bib URL Code

This paper proposes a novel paradigm for the unsupervised learning of object landmark detectors. Contrary to existing methods that build on auxiliary tasks such as image generation or equivariance, we propose a self-training approach where, departing from generic keypoints, a landmark detector and descriptor is trained to improve itself, tuning the keypoints into distinctive landmarks. To this end, we propose an iterative algorithm that alternates between producing new pseudo-labels through feature clustering and learning distinctive features for each pseudo-class through contrastive learning. With a shared backbone for the landmark detector and descriptor, the keypoint locations progressively converge to stable landmarks, filtering those less stable. Compared to previous works, our approach can learn points that are more flexible in terms of capturing large viewpoint changes. We validate our method on a variety of difficult datasets, including LS3D, BBCPose, Human3.6M and PennAction, achieving new state of the art results.
@article{Mallis2023landm, author = {Mallis, Dimitrios and Sanchez, Enrique and Bell, Matt and Tzimiropoulos, Georgios}, journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence}, title = {From Keypoints to Object Landmarks via Self-Training Correspondence: A novel approach to Unsupervised Landmark Discovery}, year = {2023}, doi = {10.1109/TPAMI.2023.3234212}, }
NeurIPS2020
Unsupervised Learning of Object Landmarks via Self-Training Correspondence

Dimitrios Mallis, Enrique Sanchez, Matt Bell, and Georgios Tzimiropoulos

Neural Information Processing Systems, 2020

Abs Bib URL PDF Supp Code Slides

This paper addresses the problem of unsupervised discovery of object landmarks. We take a different path compared to existing works, based on 2 novel perspectives: (1) Self-training: starting from generic keypoints, we propose a self-training approach where the goal is to learn a detector that improves itself, becoming more and more tuned to object landmarks. (2) Correspondence: we identify correspondence as a key objective for unsupervised landmark discovery and propose an optimization scheme which alternates between recovering object landmark correspondence across different images via clustering and learning an object landmark descriptor without labels. Compared to previous works, our approach can learn landmarks that are more flexible in terms of capturing large changes in viewpoint. We show the favourable properties of our method on a variety of difficult datasets including LS3D, BBCPose and Human3.6M.
@article{unsupervLandm2020, title = {Unsupervised Learning of Object Landmarks via Self-Training Correspondence}, author = {Mallis, Dimitrios and Sanchez, Enrique and Bell, Matt and Tzimiropoulos, Georgios}, journal = {Neural Information Processing Systems}, year = {2020}, }

Research

News

Selected Publications [View All]

Open Source Projects