Evidence map›Paper›PMID 37754133›Full record

ArticleBiomimetics (Basel, Switzerland)2023

A Hierarchical Framework for Quadruped Robots Gait Planning Based on DDPG.

Yanbiao Li, Zhao Chen, Chentao Wu, Haoyu Mao, Peng Sun

Abstract read
In one paragraph

Article in Biomimetics (Basel, Switzerland), 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Special Issue: Design and Control of a Bio-Inspired Robot.Biomimetics (Basel, Switzerland) · 2024
    Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Yanbiao LiCollege of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China.
Zhao ChenCollege of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China.
Chentao WuCollege of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China.
Haoyu MaoCollege of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China.
Peng SunCollege of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China.ORCID 0000-0002-6489-2330

Funding

National Natural Science Foundation of China U21A20122,52105037,51975523
6 · The paper itself

Abstract

In recent years, significant progress has been made in employing reinforcement learning for controlling legged robots. However, a major challenge arises with quadruped robots due to their continuous states and vast action space, making optimal control using simple reinforcement learning controllers particularly challenging. This paper introduces a hierarchical reinforcement learning framework based on the Deep Deterministic Policy Gradient (DDPG) algorithm to achieve optimal motion control for quadruped robots. The framework consists of a high-level planner responsible for generating ideal motion parameters, a low-level controller using model predictive control (MPC), and a trajectory generator. The agents within the high-level planner are trained to provide the ideal motion parameters for the low-level controller. The low-level controller uses MPC and PD controllers to generate the foot-end force and calculates the joint motor torque through inverse kinematics. The simulation results show that the motion performance of the trained hierarchical framework is superior to that obtained using only the DDPG method.

Indexed as

Deep Deterministic Policy Gradienthierarchical reinforcement learningmodel predictive controlquadruped robots

Identifiers

PMID37754133
PMCPMC10526411

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.