Adopting attention and cross-layer features for fine-grained representation

Sun, Fayou and Ngo, Hea Choon and Sek, Yong Wee (2022) Adopting attention and cross-layer features for fine-grained representation. IEEE Access, 10. pp. 82376-82383. ISSN 2169-3536

Text ADOPTING_ATTENTION_AND_CROSS-LAYER_FEATURES_FOR_FINE-GRAINED_REPRESENTATION.PDF Download (1MB)

Abstract

Fine-grained visual classification (FGVC) is challenging task due to discriminative feature representations. The attention-based methods show great potential for FGVC, which neglect that the deeply digging inter-layer feature relations have an impact on refining feature learning. Similarly, the associating cross-layer features methods achieve significant feature enhancement, which lost the long-distance dependencies between elements. However, most of the previous researches neglect that these two methods are mutually correlated to reinforce feature learning, which are independent of each other in related models. Thus, we adopt the respective advantages of the two methods to promote fine-gained feature representations. In this paper, we propose a novel CLNET network, which effectively applies attention mechanism and cross-layer features to obtain feature representations. Specifically, CL-NET consists of 1) adopting self attention to capture long-rang dependencies for each element, 2) associating cross-layer features to reinforce feature learning, and 3) to cover more feature regions, we integrate attention-based operations between output and input. Experiments verify that CLNET yields new state-of-the-art performance on three widely used fine grained benchmarks, including CUB-200-2011, Stanford Cars and FGVC-Aircraft. The url of our code is https://github.com/dlearing/CLNET.git.

Item Type:	Article
Uncontrolled Keywords:	Associating cross-layer features, Attention-based operations, Self-attention, CLNET
Divisions:	Faculty of Information and Communication Technology
Depositing User:	mr eiisaa ahyead
Date Deposited:	23 Feb 2023 11:46
Last Modified:	23 Feb 2023 11:46
URI:	http://eprints.utem.edu.my/id/eprint/26209
Statistic Details:	View Download Statistic

Actions (login required)

View Item