Learning to Ascend Stairs and Ramps: Deep Reinforcement Learning for a Physics-Based Human Musculoskeletal Model

Aurelien J. C. Adriaenssens, Vishal Raveendranathan, Raffaella Carloni*

*Corresponding author voor dit werk

Onderzoeksoutput: ArticleAcademicpeer review

4 Citaten (Scopus)
102 Downloads (Pure)

Samenvatting

This paper proposes to use deep reinforcement learning to teach a physics-based human
musculoskeletal model to ascend stairs and ramps. The deep reinforcement learning architecture
employs the proximal policy optimization algorithm combined with imitation learning and is trained
with experimental data of a public dataset. The human model is developed in the open-source
simulation software OpenSim, together with two objects (i.e., the stairs and ramp) and the elastic
foundation contact dynamics. The model can learn to ascend stairs and ramps with muscle forces
comparable to healthy subjects and with a forward dynamics comparable to the experimental training
data, achieving an average correlation of 0.82 during stair ascent and of 0.58 during ramp ascent
across both the knee and ankle joints.
Keywords: deep reinforcement learning; computer simulation
Originele taal-2English
Artikelnummer8479
Aantal pagina's16
TijdschriftMDPI: Sensor
Volume22
Nummer van het tijdschrift21
DOI's
StatusPublished - 3-nov.-2022

Vingerafdruk

Duik in de onderzoeksthema's van 'Learning to Ascend Stairs and Ramps: Deep Reinforcement Learning for a Physics-Based Human Musculoskeletal Model'. Samen vormen ze een unieke vingerafdruk.

Citeer dit