BARN: Behavior-Aware Relation Network for multi-label behavior detection in socially housed macaques

Quantification of behaviors in macaques provides crucial support for various scientific disciplines, including pharmacology, neuroscience, and ethology. Despite recent advancements in the analysis of macaque behavior, research on multi-label behavior detection in socially housed macaques, including consideration of interactions among them, remains scarce. Given the lack of relevant approaches and datasets, we developed the Behavior-Aware Relation Network (BARN) for multi-label behavior detection of socially housed macaques. Our approach models the relationship of behavioral similarity between macaques, guided by a behavior-aware module and novel behavior classifier, which is suitable for multi-label classification. We also constructed a behavior dataset of rhesus macaques using ordinary RGB cameras mounted outside their cages. The dataset included 65 913 labels for 19 behaviors and 60 367 proposals, including identities and locations of the macaques. Experimental results showed that BARN significantly improved the baseline SlowFast network and outperformed existing relation networks. In conclusion, we successfully achieved multi-label behavior detection of socially housed macaques with both economic efficiency and high accuracy.