Basura Fernando

Publications

2023
	Interaction Visual Transformer for Egocentric Action Anticipation Debaditya Roy, Ramanathan Rajendiran, and Basura Fernando Ranked 1 team in EPIC-KITCHEN 100 PDF Bibtex @article{ inavit, title={Interaction Visual Transformer for Egocentric Action Anticipation}, author={Debaditya Roy and Ramanathan Rajendiran and Basura Fernando}, journal={arXiv}, year={2022}, } ×
	Predicting the Next Action by Modeling the Abstract Goal Debaditya Roy and Basura Fernando Ranked 1 team in EPIC-KITCHEN 55 PDF Code Bibtex @article{ royabstractgoal, title={Predicting the Next Action by Modeling the Abstract Goal}, author={Debaditya Roy and Basura Fernando}, journal={under review, IEEE Transactions on Image Processing}, year={2022}, } ×
2022
	Effective Multimodal Encoding for Image Paragraph Captioning Thanh-Son Nguyen and Basura Fernando IEEE Transactions on Image Processing (2022) PDF Bibtex @article{ son2022, title={Effective Multimodal Encoding for Image Paragraph Captioning}, author={Thanh-Son Nguyen and Basura Fernando}, journal={IEEE Transactions on Image Processing}, year={2022}, } ×
	TDAM: Top-Down Attention Module for Contextually Guided Feature Selection in CNNs Shantanu Jaiswal and Basura Fernando and Cheston Tan ECCV 2022 PDF Bibtex @inproceedings{ eccv2022shan, title={TDAM: Top-Down Attention Module for Contextually Guided Feature Selection in CNNs}, author={Shantanu Jaiswal and Basura Fernando and Cheston Tan}, booktitle={ECCV}, year={2022}, } ×
	3D Equivariant Graph Implicit Functions Yunlu Chen and Basura Fernando and Hakan Bilen and Matthias Niessner and Efstratios Gavves ECCV 2022 PDF Bibtex @inproceedings{ eccv22yunlu, title={3D Equivariant Graph Implicit Functions}, author={Yunlu Chen and Basura Fernando and Hakan Bilen and Matthias Niessner and Efstratios Gavves}, booktitle={ECCV}, year={2022}, } ×
	Not All Relations are Equal: Mining Informative Labels for Scene Graph Generation Arushi Goel, Basura Fernando, Frank Keller, and Hakan Bilen CVPR 2022 PDF Bibtex @inproceedings{ cvpr22, title={Not All Relations are Equal: Mining Informative Labels for Scene Graph Generation}, author={Arushi Goel and Basura Fernando and Frank Keller and Hakan Bilen}, booktitle={CVPR}, year={2022}, } ×
	Consistency Regularization for Domain Adaptation Kian Boon Koh and Basura Fernando ECCV 2022 (Workshop) PDF Bibtex @inproceedings{ eccv2022kianboon, title={Consistency Regularization for Domain Adaptation}, author={Kian Boon Koh and Basura Fernando}, booktitle={ECCV Workshops}, year={2022}, } ×
	Long-term Action Forecasting Using Multi-headed Attention-based Variational Recurrent Neural Networks Siyuan Brandon Loh, Debaditya Roy and Basura Fernando CVPR 2022 (Workshop) PDF Bibtex @inproceedings{ cvpr22w, title={Long-term Action Forecasting Using Multi-headed Attention-based Variational Recurrent Neural Networks}, author={Siyuan Brandon Loh and Debaditya Roy and Basura Fernando}, booktitle={CVPR}, year={2022}, } ×
	Action anticipation using latent goal learning Debaditya Roy and Basura Fernando WACV 2022 PDF Code Bibtex @inproceedings{ wacv22, title={Action anticipation using latent goal learning}, author={Debaditya Roy and Basura Fernando}, booktitle={WACV}, year={2022}, } ×
2021
	Neural Feature Matching in Implicit 3D Representations Yunlu Chen, Basura Fernando, Hakan Bilen, Thomas Mensink, and Efstratios Gavves ICML 2021 PDF Bibtex @article{ Chen21, title={Neural Feature Matching in Implicit 3D Representations}, author={Yunlu Chen and Basura Fernando and Hakan Bilen and Thomas Mensink and Efstratios Gavves}, booktitle={ICML}, year={2021}, } ×
	Anticipating human actions by correlating past with the future with Jaccard similarity measures Basura Fernando and Samitha Herath CVPR 2021 PDF Bibtex @article{ Fernando21, title={Anticipating human actions by correlating past with the future with Jaccard similarity measures}, author={Basura Fernando and Samitha Herath}, booktitle={CVPR}, year={2021}, } ×
	Action Anticipation using Pairwise Human-Object Interactions and Transformers Debaditya Roy and Basura Fernando IEEE Transactions on Image Processing 2021 Impact factor 10.856 PDF Bibtex @article{ 2021_TIP_ROY, title={Action Anticipation using Pairwise Human-Object Interactions and Transformers}, author={Debaditya Roy and Basura Fernando}, journal={IEEE Transactions of Image Processing}, year={2021}, } ×
	Weakly supervised action segmentation with effective use of attention and self-attention. Yan Bin Ng and Basura Fernando Computer Vision and Image Understanding 2021 PDF Bibtex @article{ CVIU_2021, title={Weakly supervised action segmentation with effective use of attention and self-attention.}, author={Yan Bin Ng and Basura Fernando}, journal={Computer Vision and Image Understanding}, year={2021}, } ×
	A Log-likelihood Regularized KL Divergence for Video Prediction with A 3D Convolutional Variational Recurrent Network Haziq Razali and Basura Fernando WACV 2021 Generation of Human Behavior Workshop PDF Bibtex @article{ Haziq20, title={A Log-likelihood Regularized KL Divergence for Video Prediction with A 3D Convolutional Variational Recurrent Network}, author={Haziq Razali and Basura Fernando}, booktitle={WACV}, year={2021}, } ×
	FlowCaps: Optical Flow Estimation with Capsule Networks For Action Recognition Vinoj Jayasundara, Debaditya Roy and Basura Fernando WACV 2021 PDF Bibtex @article{ Vinoj, title={FlowCaps: Optical Flow Estimation with Capsule Networks For Action Recognition}, author={Vinoj Jayasundara and Debaditya Roy and Basura Fernando}, booktitle={WACV}, year={2021}, } ×
	DORi: Discovering Objects Relationship for Temporal Moment Localization of a Natural-Language Query in Video Cristian Rodriguez, Edison Marrese-Taylor, Basura Fernando, Hongdong Li, and Stephen Gould WACV 2021 PDF Bibtex @article{ Rodriguez2021, title={DORi: Discovering Objects Relationship for Temporal Moment Localization of a Natural-Language Query in Video}, author={Cristian Rodriguez and Edison Marrese-Taylor and Basura Fernando and Hongdong Li, and Stephen Gould}, booktitle={WACV}, year={2021}, } ×
2020
	Forecasting future action sequences with attention: a new approach to weakly supervised action forecasting Yan Bin Ng, and Basura Fernando IEEE Transactions on Image Processing 2020 Impact factor 10.856 PDF Web Bibtex @article{ YanBin2020, title={Forecasting future action sequences with attention: a new approach to weakly supervised action forecasting}, author={Yan Bin Ng, Basura Fernando}, booktitle={IEEE Transactions on Image Processing}, year={2020}, } ×
	What do CNNs gain by imitating the visual development of primate infants? Shantanu Jaiswal, Dongkyu Choi, Basura Fernando BMVC 2020 PDF Bibtex @inproceedings{ Jaiswal2020, title={What do CNNs gain by imitating the visual development of primate infants?}, author={Shantanu Jaiswal, Dongkyu Choi, Basura Fernando}, booktitle={The British Machine Vision Conference (BMVC)}, year={2020}, } ×
	Injecting Prior Knowledge into Image Caption Generation Arushi Goel, Basura Fernando, Thanh-Son Nguyen, Hakan Bilen ECCV 2020 In European Conference on Computer Vision Workshops PDF openreview Bibtex @inproceedings{ Goel2020injecting, title={Injecting Prior Knowledge into Image Caption Generation}, author={Arushi Goel, Basura Fernando, Thanh-Son Nguyen, Hakan Bilen}, booktitle={European Conference on Computer Vision Workshops}, year={2020}, url={https://openreview.net/forum?id=f75kMo1dnKD} } ×
	Inferring Temporal Compositions of Actions Using Probabilistic Automata Rodrigo Santa Cruz, Dylan Campbell, Anoop Cherian, Basura Fernando and Stephen Gould CVPR 2020 Conference on Computer Vision and Pattern Recognition Workshops PDF arxiv Bibtex @InProceedings{santa2020inferring, title={Inferring Temporal Compositions of Actions Using Probabilistic Automata}, Author = {Santa Cruz, Rodrigo and Cherian, Anoop and Fernando, Basura and Campbell, Dylan and Gould, Stephen}, Booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops}, Year = {2020}, } ×
	Weakly Supervised Gaussian Networks for Action Detection Basura Fernando and Cheston Tan and Hakan Bilen WACV 2020 PDF arxiv Bibtex @InProceedings{FernandoWACV20, Title = {Weakly Supervised Gaussian Networks for Action Detection}, Author = {Fernando, Basura and Chet, Cheston Tan Yin and Bilen, Hakan}, Booktitle = {Winter Conference on Applications of Computer Vision (WACV ’20)}, Year = {2020}, } ×
	Human Action Sequence Classification Yan Bin Ng and Basura Fernando PDF Bibtex @misc{ng2019human, title={Human Action Sequence Classification}, author={Yan Bin Ng and Basura Fernando}, year={2019}, eprint={1910.02602}, archivePrefix={arXiv}, primaryClass={cs.CV} } } ×
2019
	Hallucinating Unaligned Face Images by Multiscale Transformative Discriminative Networks Xin Yu and Fatih Porikli and Basura Fernando and Richard Hartley International Journal of Computer Vision (IJCV) 2019 PDF Link Bibtex @Article{IJCV_Xin_Yu, Title = {Hallucinating Unaligned Face Images by Multiscale Transformative Discriminative Networks}, Author = {Xin Yu, Fatih Porikli,Basura Fernando,Richard Hartley}, Journal = {International Journal of Computer Vision}, Year = {2020}, } ×
	Using Temporal Information for Recognizing Actions from Still Images Samitha Herath, Basura Fernando and Mehrtash Harandi Pattern Recognition Journal, 2019 PDF web Bibtex @article{PR19Herath, Title = {Using Temporal Information for Recognizing Actions from Still Images}, Author = {Samitha Herath and Basura Fernando and Mehrtash Harandi}, Booktitle = {Pattern Recognition}, Year = {2019}, } ×
	Semantic Face Hallucination: Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes Xin Yu and Basura Fernando and Richard Hartley and Fatih Porikli To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2019 PDF IEEE Access Bibtex @article{TPAMI_XINYU2019, Title = {Semantic Face Hallucination: Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes}, Author = {Xin Yu and Basura Fernando and Richard Hartley and Fatih Porikli}, Booktitle = {TPAMI}, Year = {2019}, } ×
	Min-Max Statistical Alignment for Transfer Learning Samitha Herath, Mehrtash Harandi, Basura Fernando, and Richard Nock CVPR 2019 PDF Web Bibtex @InProceedings{HerathCVPR19, Title = {Min-Max Statistical Alignment for Transfer Learning}, Author = {Samitha Herath and Mehrtash Harandi and Basura Fernando and Richard Nock}, Booktitle = {CVPR}, Year = {2019}, } ×
	Visual Permutation Learning Rodrigo Santa Cruz, Basura Fernando, Anoop Cherian and Stephen Gould IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2019 PDF IEEE PDF Bibtex @article{Cruz18, Title = {Visual Permutation Learning}, Author = {Rodrigo Santa Cruz and Basura Fernando and Anoop Cherian and Stephen Gould}, Booktitle = {IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2018}, Year = {2019}, } ×
2018
	Action Anticipation with RBF Kernelized Feature Mapping RNN Yuge Shi, Basura Fernando and Richard Hartley ECCV 2018 PDF Bibtex @InProceedings{Yuge18, Title = {Action Anticipation with RBF Kernelized Feature Mapping RNN}, Author = {Yuge Shi and Basura Fernando and Richard Hartley}, Booktitle = {ECCV}, Year = {2018}, } ×
	Face Super-resolution Guided by Facial Component Heatmaps Xin Yu, Basura Fernando, Bernard Ghanem, Fatih Porikli, and Richard Hartley ECCV 2018 PDF Bibtex @InProceedings{Yu18, Title = {Face Super-resolution Guided by Facial Component Heatmaps}, Author = {Xin Yu and Basura Fernando and Bernard Ghanem and Fatih Porikli and Richard Hartley}, Booktitle = {ECCV}, Year = {2018}, } ×
	VIENA2: A Driving Anticipation Dataset Mohammad Sadegh Aliakbarian, Fatemehsadat Saleh, Mathieu Salzmann, Basura Fernando, Lars Petersson, Lars Andersson Asian Conference on Computer Vision (ACCV 2018) PDF Bibtex @InProceedings{Aliakbarian18, Title = {VIENA2: A Driving Anticipation Dataset}, Author = {Mohammad Sadegh Aliakbarian and Fatemehsadat Saleh and Mathieu Salzmann and Basura Fernando and Lars Petersson and Lars Andersson}, Booktitle = {Asian Conference on Computer Vision (ACCV 2018)}, Year = {2018}, } ×
	Action Anticipation by Predicting Future Dynamic Images Cristian Rodriguez, Basura Fernando and Hongdong Li ECCV'18 workshop on Anticipating Human Behavior PDF Bibtex @InProceedings{Yuge18, Title = {Action Anticipation by Predicting Future Dynamic Images}, Author = {Cristian Rodriguez and Basura Fernando and Hongdong Li}, Booktitle = {ECCV'18 workshop on Anticipating Human Behavior}, Year = {2018}, } ×
	Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes Xin Yu, Basura Fernando, Richard Hartley, and Fatih Porikli CVPR 2018 PDF Bibtex @InProceedings{Yu18, Title = {Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes}, Author = {Xin Yu and Basura Fernando and Richard Hartley and Fatih Porikli}, Booktitle = {CVPR}, Year = {2018}, } ×
	Neural Algebra of Classifiers Rodrigo Santa Cruz, Basura Fernando, Anoop Cherian, and Stephen Gould Winter Conference on Applications of Computer Vision (WACV) 2018 PDF Bibtex @InProceedings{Cruz18, Title = {Neural Algebra of Classifiers}, Author = {Rodrigo Santa Cruz and Basura Fernando and Anoop Cherian and Stephen Gould}, Booktitle = {WACV}, Year = {2018}, } ×

2017
	Action Recognition with Dynamic Image Networks Hakan Bilen, Basura Fernando, Efstratios Gavves, Andrea Vedaldi IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) (Accepted) arxiv IEEE PDF Bibtex @article{DBLP:journals/corr/BilenFGV16, author = {Hakan Bilen and Basura Fernando and Efstratios Gavves and Andrea Vedaldi}, title = {Action Recognition with Dynamic Image Networks}, journal = {CoRR}, volume = {abs/1612.00738}, year = {2016}, url = {http://arxiv.org/abs/1612.00738}, timestamp = {Mon, 02 Jan 2017 11:09:15 +0100}, biburl = {http://dblp.uni-trier.de/rec/bib/journals/corr/BilenFGV16}, bibsource = {dblp computer science bibliography, http://dblp.org} } × State of the art results on UCF101 (96.0%) and HMDB51 (74.9%) !
	Unsupervised Domain Adaptation Based on Subspace Alignment Basura Fernando, Rahaf Aljundi, Remi Emonet, Amaury Habrard, Marc Sebban and Tinne Tuytelaars Advances in Computer Vision and Pattern Recognition book series (ACVPR) PDF Bibtex @InBook{Fernando2017book, Title = {Unsupervised Domain Adaptation Based on Subspace Alignment}, Author = {Fernando, Basura and Aljundi, Rahaf and Emonet, R{\'e}mi and Habrard, Amaury and Sebban, Marc and Tuytelaars, Tinne}, Editor = {Csurka, Gabriela}, Pages = {81--94}, Publisher = {Springer International Publishing}, Year = {2017}, Address = {Cham}, Booktitle = {Domain Adaptation in Computer Vision Applications}, Doi = {10.1007/978-3-319-58347-1_4}, ISBN = {978-3-319-58347-1}, Url = {https://doi.org/10.1007/978-3-319-58347-1_4} } ×
	Encouraging LSTMs to Anticipate Actions Very Early Mohammad Sadegh Aliakbarian, Fatemehsadat Saleh, Mathieu Salzmann, Basura Fernando, Lars Petersson and Lars Andersson ICCV 2017 State-of-the-art in action anticipation! PDF arxiv Bibtex @InProceedings{Aliakbarian2017, Title = {Encouraging LSTMs to Anticipate Actions Very Early}, Author = {Mohammad Sadegh Aliakbarian and Fatemehsadat Saleh and Mathieu Salzmann and Basura Fernando and Lars Petersson and Lars Andersson}, Booktitle = {arxiv}, Year = {2017}, Url = {https://arxiv.org/abs/1703.07023} } ×
	Discriminatively Learned Hierarchical Rank Pooling Networks Basura Fernando and Stephen Gould International Journal of Computer Vision (IJCV) PDF PDF (published) arxiv Code Project Bibtex @article{Fernando2017ijcv, Title = {Discriminatively Learned Hierarchical Rank Pooling Networks}, Author = {Basura Fernando and Stephen Gould}, journal = {International Journal of Computer Vision}, volume = {}, year = {2017}, url = {}, } ×
	Self-Supervised Video Representation Learning With Odd-One-Out Networks Basura Fernando, Hakan Bilen, Efstratios Gavves, Stephen Gould CVPR 2017 PDF arxiv Bibtex @InProceedings{Fernando2017, Title = {Self-Supervised Video Representation Learning With Odd-One-Out Networks}, Author = {Basura Fernando and Hakan Bilen and Efstratios Gavves and Stephen Gould}, Booktitle = {CVPR}, Year = {2017}, Url = {http://arxiv.org/abs/1611.06646} } ×
	Generalized Rank Pooling for Activity Recognition Anoop Cherian, Basura Fernando, Mehrtash Harandi, Stephen Gould CVPR 2017 PDF arxiv Bibtex @InProceedings{Cherian2017, Title = {Generalized Rank Pooling for Activity Recognition}, Author = {Anoop Cherian and Basura Fernando and Mehrtash Harandi and Stephen Gould}, Booktitle = {CVPR}, Year = {2017} } ×
	DeepPermNet: Visual Permutation Learning Rodrigo Santa Cruz, Basura Fernando, Anoop Cherian, Stephen Gould CVPR 2017 PDF arxiv Bibtex @InProceedings{Cruz2017, Title = {Visual Permutation Learning}, Author = {Rodrigo Santa Cruz and Basura Fernando and Anoop Cherian and Stephen Gould}, Booktitle = {CVPR}, Year = {2017}, } ×
	Unsupervised Human Action Detection by Action Matching Basura Fernando, Sareh Shirazi, Stephen Gould CVPR Workshops 2017 PDF arxiv Bibtex @InProceedings{Fernando2017, Title = {Unsupervised Human Action Detection by Action Matching}, Author = {Basura Fernando and Sareh Shirazi and Stephen Gould}, Booktitle = {CVPR Workshops}, Year = {2017}, Url = {https://arxiv.org/abs/1612.00558} } ×
	Deep Learning Based Decision Support System for Automated Diagnosis of Age-related Macular Degeneration (AMD) Sajib Kumar Saha, Di Xiao, Basura Fernando, Mei-Ling Tay-Kearney, Dong An, and Yogesan Kanagasingam. Investigative Ophthalmology & Visual Science, 58(8):25--25, 2017. Impact factor for 2016: 3.303
	Zero-Shot Image Captioning with Constrained Beam Search Peter Anderson, Basura Fernando, Mark Johnson and Stephen Gould Conference on Empirical Methods in Natural Language Processing (EMNLP), 2017. arxiv Bibtex @InProceedings{Anderson2017, Title = {Zero-Shot Image Captioning with Constrained Beam Search}, Author = {Peter Anderson and Basura Fernando and Mark Johnson and Stephen Gould}, Booktitle = {Conference on Empirical Methods in Natural Language Processing (EMNLP)}, year = {2017}, } ×
	Generalized BackPropagation, Etude De Cas: Orthogonality Mehrtash Harandi and Basura Fernando arxiv arxiv Bibtex @InProceedings{Harandi2017, Title = {Generalized BackPropagation, Étude De Cas: Orthogonality}, Author = {Mehrtash Harandi and Basura Fernando}, Booktitle = {arxiv}, Year = {2017}, Url = {https://arxiv.org/abs/1611.05927} } ×
2016
	SPICE: Semantic Propositional Image Caption Evaluation Peter Anderson, Basura Fernando, Mark Johnson, Stephen Gould ECCV 2016 PDF Project Bibtex @inproceedings{Anderson:ECCV2016, author = {Peter Anderson and Basura Fernando and Mark Johnson and Stephen Gould}, title = {SPICE: Semantic Propositional Image Caption Evaluation}, booktitle = {ECCV}, year = {2016} } ×
	Learning End-to-end Video Classification with Rank-Pooling Basura Fernando, Stephen Gould ICML 2016 PDF JMLR PDF project Bibtex @inproceedings{Fernando:ICML2016, author = {Basura Fernando and Stephen Gould}, title = {Learning End-to-end Video Classification with Rank-Pooling}, booktitle = {ICML}, year = {2016} } × Rank pooling and variants
	Rank Pooling for Action Recognition Basura Fernando, Efstratios Gavves, Jose Oramas, Amir Ghodrati and Tinne Tuytelaars IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) PDF(academia) PDF Code Bibtex project @article{Fernando2016b, title={Rank Pooling for Action Recognition}, author={Fernando, Basura and Gavves, Efstratios and Oramas, Jose and Ghodrati, Amir and Tuytelaars, Tinne}, journal={IEEE Transactions on Pattern Analysis and Machine Intelligence}, year={2016}} × Rank pooling and variants
	Dynamic Image Networks for Action Recognition Hakan Bilen*, Basura Fernando*, Efstratios Gavves, Andrea Vedaldi and Stephen Gould * Equal contributions CVPR 2016 (oral) PDF project Bibtex Read more @inproceedings{Bilen2016, year={2016}, booktitle={CVPR}, title={Dynamic Image Networks for Action Recognition}, author={Hakan Bilen and Basura Fernando and Efstratios Gavves and Andrea Vedaldi and Stephen Gould}} × Simple Dynamic Image Code Dynamic Image Nets Code Download Dynamic Images for UCF101 We introduce the concept of dynamic image, a novel compact representation of videos useful in the context of convolutional neural networks (CNNs). The dynamic image is based on the rank pooling and is obtained as the parameters of a ranking machine that reconstructs the order of the frames of the video. For dynamic images rank pooling is applied directly at the level of image pixels, in RGB space, producing a vector of parameters that can be interpreted as a single RGB image. This idea is simple but powerful as it is allows applying CNNs pre-trained for still image classification, where supervised data is abundant, to video classification, where supervised data is scarce. We also show how to efficiently approximate rank pooling, speeding it up orders of magnitude, and use this approximation to construct a general-purpose rank pooling CNN layer, genaralizing dynamic images to dynamic feature maps. We demonstrate the power of our new representations on standard benchmarks in action recognition achieving state-of-the-art performance. × Dynamic images for UCF 101 dataset Original dynamic image paper based on VideoDarwin is explained here. Rank Pooling for Action Recognition, Basura Fernando, Efstratios Gavves, Jose Oramas, Amir Ghodrati, Tinne Tuytelaars Download data CNN version of Dynamic Images with approximate rank pooling is explained here. Dynamic Image Networks for Action Recognition Hakan Bilen*, Basura Fernando*, Efstratios Gavves, Andrea Vedaldi and Stephen Gould Accepted to CVPR 2016 Download data × Rank pooling and variants
	Discriminative Hierarchical Rank Pooling for Activity Recognition Basura Fernando, Peter Anderson, Marcus Hutter and Stephen Gould CVPR 2016 PDF Code project Bibtex Read more @inproceedings{Fernando2016a, year={2016}, booktitle={CVPR}, title={Discriminative Hierarchical Rank Pooling for Activity Recognition}, author={Basura Fernando and Peter Anderson and Marcus Hutter and Stephen Gould}} × We present hierarchical rank pooling, a video sequence encoding method for activity recognition. It consists of a network of rank pooling functions which captures the dynamics of rich convolutional neural network features within a video sequence. By stacking non-linear feature functions and rank pooling over one another, we obtain a high capacity dynamic encoding mechanism, which can be used for activity recognition. We present a method for jointly learning the video representation and activity classifier parameters. Our method obtains state-of-the art results on three important activity recognition benchmarks: 76.7% on Hollywood2, 66.9% on HMDB51 and, 91.4% on UCF101. × Rank pooling and variants
2015
	Learning to rank based on subsequences Basura Fernando, Efstratios Gavves, Damien Muselet and Tinne Tuytelaars ICCV 2015 PDF arxiv Supplementary (120Mb) Bibtex Code Read more @inproceedings{Fernando2015b, year={2015}, booktitle={ICCV}, title={Learning-to-rank based on subsequences}, author={Basura Fernando and Efstratios Gavves and Damien Muselet and Tinne Tuytelaars}} × We present a supervised learning to rank algorithm that effectively orders images by exploiting the structure in image sequences especially focusing on image re-ranking applications. Most often in the supervised learning to rank literature, ranking is approached either by analyzing pairs of images or by optimizing a list-wise surrogate loss function on full sequences. In this work we propose MidRank, which learns from moderately sized sub-sequences instead. These sub-sequences contain useful structural ranking information that leads to better learnability during training and better generalization during testing. By exploiting sub-sequences, the proposed MidRank improves ranking accuracy considerably on an extensive array of image re-ranking applications and datasets. ×
	Guided Long-Short Term Memory for Image Caption Generation Xu Jia, Efstratios Gavves, Basura Fernando and Tinne Tuytelaars ICCV 2015 PDF arxiv Bibtex Read more @inproceedings{Jia2015, year={2015}, booktitle={ICCV}, title={Guided Long-Short Term Memory for Image Caption Generation}, author={Xu Jia and Efstratios Gavves and Basura Fernando and Tinne Tuytelaars}} × In this work we focus on the problem of image caption generation. We propose an extension of the long short term memory (LSTM) model, which we coin Guided LSTM or G-LSTM for short. In particular, we add semantic information extracted from the image as extra input to each unit of the LSTM block, with the aim of guiding the model towards solutions that are more tightly coupled to the image content. Additionally, we explore different length normalization strategies for beam search in order to prevent it from favoring short sentences. On various benchmark datasets, we obtain results that are on par with or even outperform the current state-of-the-art. ×
	Modeling Video Evolution For Action Recognition Basura Fernando, Efstratios Gavves, Jose Oramas, Amir Ghodrati and Tinne Tuytelaars CVPR 2015 (oral) PDF Code project Bibtex @inproceedings{Fernando2015a, year={2015}, booktitle={CVPR}, title={Modeling Video Evolution For Action Recognition}, author={Basura Fernando and Efstratios Gavves and Jose Oramas and Amir Ghodrati and Tinne Tuytelaars}}
	Dataset Fingerprints: Exploring Image Collections Through Data Mining Konstantinos Rematas, Basura Fernando, Frank Dellaert and Tinne Tuytelaars CVPR 2015 PDF Project Bibtex @inproceedings{Rematas2015, year={2015}, booktitle={CVPR}, title={Dataset Fingerprints: Exploring Image Collections Through Data Mining}, author={Konstantinos Rematas and Basura Fernando and Frank Dellaert and Tinne Tuytelaars}}
	Location Recognition Over Large Time Lags Basura Fernando, Tatiana Tommasi and Tinne Tuytelaars Computer Vision and Image Understanding arxiv PDF Project & Code Bibtex @article{Fernando2015CVIU, title = "Location recognition over large time lags ", journal = "Computer Vision and Image Understanding ", volume = "139", number = "", pages = "21-28", year = "2015", note = "", issn = "1077-3142", doi = "http://dx.doi.org/10.1016/j.cviu.2015.05.016", url = "http://www.sciencedirect.com/science/article/pii/S107731421500137X", author = "Basura Fernando and Tatiana Tommasi and Tinne Tuytelaars", }
	Joint cross-domain classification and subspace learning for unsupervised adaptation Basura Fernando, Tatiana Tommasi and Tinne Tuytelaars Pattern Recognition Letters PDF Code Project Bibtex @article{Fernando2015PRL, title = "Joint cross-domain classification and subspace learning for unsupervised adaptation", journal = "Pattern Recognition Letters", volume = "", number = "", pages = " - ", year = "2015", note = "", issn = "", doi = " 10.1016/j.patrec.2015.07.009", url = "", author = "Basura Fernando and Tatiana Tommasi and Tinne Tuytelaars", }
2014
	Subspace Alignment For Domain Adaptation Basura Fernando, Amaury Habrard, Marc Sebban and Tinne Tuytelaars arXiv.org PDF arxiv Code Bibtex @article{Fernando2014c, author = {Basura Fernando and Amaury Habrard and Marc Sebban and Tinne Tuytelaars}, title = {Subspace Alignment For Domain Adaptation}, journal = {CoRR}, volume = {abs/1409.5241}, year = {2014}, url = {http://arxiv.org/abs/1409.5241}, timestamp = {Wed, 01 Oct 2014 15:00:04 +0200}, biburl = {http://dblp.uni-trier.de/rec/bib/journals/corr/FernandoHST14}, bibsource = {dblp computer science bibliography, http://dblp.org}
	Color Features For Dating Historical Color Images Basura Fernando, Damien Muselet, Rahat Khan and Tinne Tuytelaars International conference of image processing (ICIP) PDF Bibtex @article{Fernando2014b, year={2014}, BOOKTITLE={IEEE International Conference on Image Processing 2014 (ICIP 2014)}, title={Color Features For Dating Historical Color Images}, Basura Fernando and Damien Muselet and Rahat Khan and Tinne Tuytelaars}, }
	Local Alignments for Fine-Grained Categorization Efstratios Gavves, Basura Fernando, Cees G.M. Snoek, Arnold W.M. Smeulders and Tinne Tuytelaars International Journal of Computer Vision (IJCV) January 2014, Volume 111, Issue 2, pp 191-212,Issn 0920-5691 PDF (Accepted author version) Bibtex @article{Gavves2014, year={2015}, issn={0920-5691}, journal={International Journal of Computer Vision}, volume={111}, number={2}, doi={10.1007/s11263-014-0741-5}, title={Local Alignments for Fine-Grained Categorization}, url={http://dx.doi.org/10.1007/s11263-014-0741-5}, publisher={Springer US}, keywords={Alignment; Image representation; Object classification}, author={Gavves, Efstratios and Fernando, Basura and Snoek, CeesG.M. and Smeulders, ArnoldW.M. and Tuytelaars, Tinne}, pages={191-212}, language={English} }
	Mining Mid-level Features for Image Classification Basura Fernando, Elisa Fromont, Tinne Tuytelaars International Journal of Computer Vision (IJCV) July 2014, Volume 108, Issue 3, pp 186-203 PDF (Accepted author version) PDF (Springer) Bibtex @article{Fernando2014a, year={2014}, issn={0920-5691}, journal={International Journal of Computer Vision}, volume={108}, number={3}, doi={10.1007/s11263-014-0700-1}, title={Mining Mid-level Features for Image Classification}, url={http://dx.doi.org/10.1007/s11263-014-0700-1}, publisher={Springer US}, keywords={Frequent itemset mining; Image classification; Discriminative patterns; Mid-level features}, author={Fernando, Basura and Fromont, Elisa and Tuytelaars, Tinne}, pages={186-203}, language={English} }
2013
	Mining Multiple Queries for Image Retrieval: On-the-fly learning of an Object-specific Mid-level Representation Basura Fernando and Tinne Tuytelaars ICCV 2013 PDF Suppl. Material Dataset Bibtex @inproceedings{Fernando2013a, author = {Basura Fernando and Tinne Tuytelaars}, title = {Mining Multiple Queries for Image Retrieval: On-the-fly learning of an Object-specific Mid-level Representation}, booktitle = {ICCV}, year = {2013}, }
	Unsupervised Visual Domain Adaptation Using Subspace Alignment Basura Fernando, Amaury Habrard, Marc Sebban and Tinne Tuytelaars ICCV 2013 PDF Suppl. Material Code Bibtex @inproceedings{Fernando2013b, author = {Basura Fernando and Amaury Habrard and Marc Sebban and Tinne Tuytelaars}, title = {Unsupervised Visual Domain Adaptation Using Subspace Alignment}, booktitle = {ICCV}, year = {2013}, }
	Fine-Grained Categorization by Alignments Efstratios Gavves, Basura Fernando, Cees Snoek, Arnold Smeulders and Tinne Tuytelaars ICCV 2013 PDF Demo Bibtex @inproceedings{Efstratios2013a, author = {Efstratios Gavves and Basura Fernando and Cees Snoek and Arnold Smeulders and Tinne Tuytelaars}, title = {Fine-Grained Categorization by Alignments}, booktitle = {ICCV}, year = {2013}, }
	Does Evolution cause a Domain Shift? Konstantinos Rematas, Basura Fernando, Tatiana Tommasi and Tinne Tuytelaars International Workshop on Visual Domain Adaptation and Dataset Bias - ICCV 2013 PDF Project Bibtex @inproceedings{Konstantinos2013a, author = {Konstantinos Rematas and Basura Fernando and Tatiana Tommasi and Tinne Tuytelaars}, title = {Does Evolution cause a Domain Shift?}, booktitle = {International Workshop on Visual Domain Adaptation and Dataset Bias - ICCV 2013}, year = {2013}, }
	The AXES submissions at TrecVid 2013 Robin Aly, Relja Arandjelovic, Ken Chatfield, Matthijs Douze, Basura Fernando, Zaid Harchaoui, Kevin McGuinness, Noel E OConner, Dan Oneata, Omkar M Parkhi, Danila Potapov, Jerome Revaud, Cordelia Schmid, Jochen Schwenninger, David Scott, Tinne Tuytelaars, Jakob Verbeek, Heng Wang, Andrew Zisserman TRECVid 2013 PDF
2012
	Effective Use of Frequent Itemset Mining for Image Classification Basura Fernando, Elisa Fromont, Tinne Tuytelaars ECCV 2012 PDF Project Code Bibtex @inproceedings{Fernando2012b, author = {Basura Fernando and Elisa Fromont and Tinne Tuytelaars}, title = {Effective Use of Frequent Itemset Mining for Image Classification}, booktitle = {ECCV}, year = {2012}, }
	Discriminative Feature Fusion for Image Classification Basura Fernando, Elisa Fromont, Damien Muselet, Marc Sebban CVPR 2012 PDF Bibtex @inproceedings{Fernando2012a, author = {Basura Fernando and Elisa Fromont and Damien Muselet and Marc Sebban}, title = {Discriminative Feature Fusion for Image Classification}, booktitle = {CVPR}, year = {2012}, }
	AXES at TRECVID 2012: KIS, INS, and MED Aly, Robin and McGuinness, Kevin and Chen, Shu and O'Connor, Noel E. and Chatfield, Ken and Parkhi, Omkar and Arandjelovic, Relja and Zisserman, Andrew and Fernando, Basura and Tuytelaars, Tinne and Oneata, Dan and Douze, Matthijs and Revaud, Jerome and Schwenninger, Jochen and Potapov, Danila and Wang, Heng and Harchaoui, Zaid and Verbeek, Jakob and Schmid, Cordelia TRECVid 2012 PDF
	Supervised learning of gaussian mixture models for visual vocabulary generation Basura Fernando, Elisa Fromont, Damien Muselet, Marc Sebban Journal of Pattern Recognition Volume 45, Issue 2, February 2012 PDF Bibtex @article{Fernando2012pr, author = {Basura Fernando and Elisa Fromont and Damien Muselet and Marc Sebban}, title = {Supervised learning of Gaussian mixture models for visual vocabulary generation}, journal = "Pattern Recognition ", volume = "45", number = "2", pages = "897 - 907", year = "2012", }

Area Chair for ECCV 2022.

SPC for IJCAI 2022.

Area Chair for ICCV 2021.

Area Chair for IJCAI 2021.

Area Chair for CVPR 2021.

Area Chair for BMVC 2020.

Senior Program Committee member at IJCAI-2020

Area Chair for BMVC 2019.

Senior Program Committee member at IJCAI-2019

Area Chair for BMVC 2018

Associate Editor ICRA 2018.

Organising CVPR17 workshop on Brave New Ideas for Motion and Spatio-Temporal Representations.

Organising ECCV 2016 workshop titled Brave New Ideas For Motion Representations.

Co-chairing the CVPR 2016 oral and spotlight session on Learning and CNN Architectures.

Program committee member of Robotic Vision RVSS 2016 Summer School.

Program committee member of RoboVis 2016 workshop.

CVPR 2013, 2015, 2016, 2017, 2018, 2019 reviewer

ICCV 2013, 2017 reviewer

ECCV 2014, 2016, 2018 reviewer

NIPS 2016, 2017, 2018, 2019 reviewer

ICML 2016, 2017, 2018, 2019 reviewer

TPAMI: IEEE Transactions on Pattern Analysis and Machine Intelligence

IJCV: International Journal of Computer Vision

Machine Learning Journal

IEEE Transactions on Image Processing

PR: Pattern Recognition Journal

PRL: Pattern Recognition Letters Journal

IEEE Transactions on Neural Networks and Learning Systems

IEEE Transactions on Multimedia

CVIU: Computer vision and image understanding journal

Guest lecture 2017 Semester1 : ENGN4528: Computer Vision at ANU

Tutorial on Action recognition and Semitic Vision at the "Robotic Vision Summer School" RVSS 2017

Guest lecture in Advanced Topics in Mechatronics Systems ENGN8536 ANU

Guest lecture 2016 Semester1 : ENGN4528: Computer Vision at ANU

2015 Spring : H09J2A: Pattern Recognition and Image Interpretation (TA) at KU Leuven

2014 Spring : H09J2A: Pattern Recognition and Image Interpretation (TA) at KU Leuven

2013 Spring : H09J2A: Pattern Recognition and Image Interpretation (TA) at KU Leuven

Dr. Paritosh Parmar (Research Scientist)

Dr. Hao Zhang (Research Scientist)

Dr. Thanh-Son Nguyen (Research Scientist)

Dr. Alexander Matyasko (Research Scientist)

Dr. Debaditya Roy (Research Scientist)

Dr. Rajendiran Ramanathan (Research Scientist)

Eric Peh (Research Engineer)

Dhruv Verma (Research Engineer)

Ee Yeo Keat (Research Engineer)

Yang Hong (Research Engineer)

Jaiswal Shantanu (Research Engineer)

2020-2023 - PhD thesis co-supervisor - Arushi Goel (University of Edinburgh)

2022-2026 - PhD thesis co-supervisor - BURTON-BARR JONATHAN WESTON (NTU)

2022-2026 - PhD thesis co-supervisor - Chinthani Sugandhika (NTU)

2018-2019 Arushi Goel (Research Engineer)
(Now a PhD student at University of Edinburgh)

2019-2021 Yan Bin Ng (Research Engineer)

2019-2021 Haziq Razali (Research Engineer)

2019-2020 Vinoj Jayasundara (Research Engineer)

2020-2021 Brandon Loh (Research Engineer)

2021-2022 Johnathon Toh (Research Engineer)

2022-2022 Venkata Sai Vijay Kumar (Research Engineer)

1. 2016-2018 - PhD thesis co-supervisor - Xin Yu (ANU)
(Graduated, the first appointment: a research Fellow at ANU.)

2. 2016-2018 - PhD thesis co-supervisor/adviser - Peter Anderson (ANU)
(Graduated, Graduated, the first appointment: a research Scientist at Georgia Tech.)

3. 2015-2018 - PhD thesis co-supervisor - Rodrigo Santa Cruz (ANU)
(Graduated, the first appointment: a postdoctoral research fellow at CSIRO)

4. 2016-2019 - PhD Chair of the panel and thesis co-supervisor - Mohammad Sadegh Aliakbarian (ANU)
(Graduated)

5. 2016-2019 - PhD thesis co-supervisor - Samitha Herath (ANU)
(Graduated, the first appointment: a research Fellow at the University of Monash.)

6. 2016-2020 - PhD thesis co-supervisor - Cristian Rodriguez Opazo (ANU)
(Graduated, the first appointment: a research Fellow at the University of Adelaide.)

2022: Final year project (NTU) - ERIC PEH ZHENG QUAN - Learning to anticipate and forecast human actions from videos (Bachelor thesis)

2020: Final year project (NTU) - Adipraja Widjaja, Sergi - Deep learning methods for weakly supervised video temporal action localization (Bachelor thesis)

2018: ENGN4712 - Engineering Research and Development Project (ANU) - Tengda Han - Video object segmentation (Bachelor thesis)

2018: ENGN4200 - Individual Project (ANU) - Yuge Shi -Video action prediction (Bachelor thesis)

2013: Learning object categories from the web - Alberto Dominguez (Master thesis KU Leuven)

May 24, 2016 - Rank pooling and variants for action and activity recognition - ACRV The Australian National University

March 17, 2016 - Action and Activity Recognition Research at ANU - Australian Centre for Visual Technologies, The University of Adelaide, Australia

July 15, 2015 - Effective Image and Video Representations - Australian Centre for Robotic Vision, ANU, Australia

March 30, 2015 - Image Representations for Improving Object Recognition - VISICS Lab, Leuven, Belgium

Dec 12, 2013 - Unsupervised Visual Domain Adaptation Using Subspace Alignment - VISICS Lab, Leuven, Belgium

Dec 12, 2013 - Mining Multiple Queries for Image Retrieval- VISICS Lab, Leuven, Belgium

Dec 04, 2012 - Learning mid-level features for classification and retrieval - Intelligent Systems Lab, Amsterdam

Nov 22, 2012 - Learning mid-level features for image retrieval - Hubert-Curien Lab, Saint Etienne, France

May 15, 2012 - Discriminative Feature Fusion for Image Classification - VISICS Lab, Leuven, Belgium

Conference/workshops/meetings attended.

Jun. 2017 - CVPR - Hawaii, USA
Jun. 2016 - CVPR - Las Vegas, USA
Jun. 2016 - ICML - New York, USA
Dec. 2015 - ICCV - Santiago, Chile
Dec. 2013 - ICCV - Sydney, Australia
Aug. 2013 - iMinds Opportunity Recognition - Leuven, Belgium
Jul. 2013 - ROKS - Leuven, Belgium
Oct. 2012 - ECCV - Florence, Italy
July 2012 - INRIA Visual Recognition and Machine Learning - Grenoble, France

Bachelor of Science in Engineering
University of Moratuwa Sri Lanka
Computer Science and Engineering
2003-2007

Master of Science - Color in Informatics and Media Technology
University of Saint-Etienne France and University of Gjovik Norway
Color in Informatics and Media Technology
2009-2011

PhD
KU Leuven, Belgium
Computer Vision
2011-2015

Scholarships and awards

Mahapola Scholarship (Sri Lanka)
2003-2007

Erusmus Mundus Scholarship (European Union)
2009-2011

Ph.D Fellowship (KU Leuven, Belgium)
01-Oct-2011 to 31-March-2015

Research Fellowship (ARC Centre of Excellence for Robotic Vision, The Australian National University)
02-July-2015 to 31-December-2018