Evidence map›Paper›PMID 37534292›Full record

ArticleFrontiers in plant science2023

Real-time dense small object detection algorithm based on multi-modal tea shoots.

Luyu Shuai, Ziao Chen, Zhiyong Li, Hongdan Li, Boda Zhang, Yuchao Wang, Jiong Mu

Abstract read
In one paragraph

Article in Frontiers in plant science, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Luyu ShuaiCollege of Information Engineering, Sichuan Agricultural University, Ya'an, China.
Ziao ChenCollege of Law, Sichuan Agricultural University, Ya'an, China.
Zhiyong LiCollege of Information Engineering, Sichuan Agricultural University, Ya'an, China.
Hongdan LiCollege of Information Engineering, Sichuan Agricultural University, Ya'an, China.
Boda ZhangCollege of Information Engineering, Sichuan Agricultural University, Ya'an, China.
Yuchao WangCollege of Mechanical and Electrical Engineering, Sichuan Agricultural University, Ya'an, China.
Jiong MuCollege of Information Engineering, Sichuan Agricultural University, Ya'an, China.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Introduction: The difficulties in tea shoot recognition are that the recognition is affected by lighting conditions, it is challenging to segment images with similar backgrounds to the shoot color, and the occlusion and overlap between leaves. Methods: To solve the problem of low accuracy of dense small object detection of tea shoots, this paper proposes a real-time dense small object detection algorithm based on multimodal optimization. First, RGB, depth, and infrared images are collected form a multimodal image set, and a complete shoot object labeling is performed. Then, the YOLOv5 model is improved and applied to dense and tiny tea shoot detection. Secondly, based on the improved YOLOv5 model, this paper designs two data layer-based multimodal image fusion methods and a feature layerbased multimodal image fusion method; meanwhile, a cross-modal fusion module (FFA) based on frequency domain and attention mechanisms is designed for the feature layer fusion method to adaptively align and focus critical regions in intra- and inter-modal channel and frequency domain dimensions. Finally, an objective-based scale matching method is developed to further improve the detection performance of small dense objects in natural environments with the assistance of transfer learning techniques. Results and discussion: The experimental results indicate that the improved YOLOv5 model increases the mAP50 value by 1.7% compared to the benchmark model with fewer parameters and less computational effort. Compared with the single modality, the multimodal image fusion method increases the mAP50 value in all cases, with the method introducing the FFA module obtaining the highest mAP50 value of 0.827. After the pre-training strategy is used after scale matching, the mAP values can be improved by 1% and 1.4% on the two datasets. The research idea of multimodal optimization in this paper can provide a basis and technical support for dense small object detection.

Indexed as

attention mechanismdense small object detectionfrequency domainmultimodal image fusionRGB-D-IRscale matchingtea shoots

Identifiers

PMID37534292
PMCPMC10391178

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.