Please use this identifier to cite or link to this item:
Title: Extracting data from human manipulation of objects towards improving autonomous robotic grasping
Authors: Faria, Diego R. 
Martins, Ricardo Filipe Alves 
Lobo, Jorge 
Dias, Jorge 
Issue Date: 3-Mar-2012
Serial title, monograph or event: Robotics and Autonomous Systems
Volume: 60
Issue: 3
Abstract: Humans excel in manipulation tasks, a basic skill for our survival and a key feature in our manmade world of artefacts and devices. In this work, we study how humans manipulate simple daily objects, and construct a probabilistic representation model for the tasks and objects useful for autonomous grasping and manipulation by robotic hands. Human demonstrations of predefined object manipulation tasks are recorded from both the human hand and object points of view. The multimodal data acquisition system records human gaze, hand and fingers 6D pose, finger flexure, tactile forces distributed on the inside of the hand, colour images and stereo depth map, and also object 6D pose and object tactile forces using instrumented objects. From the acquired data, relevant features are detected concerning motion patterns, tactile forces and hand-object states. This will enable modelling a class of tasks from sets of repeated demonstrations of the same task, so that a generalised probabilistic representation is derived to be used for task planning in artificial systems. An object centred probabilistic volumetric model is proposed to fuse the multimodal data and map contact regions, gaze, and tactile forces during stable grasps. This model is refined by segmenting the volume into components approximated by superquadrics, and overlaying the contact points used taking into account the task context. Results show that the features extracted are sufficient to distinguish key patterns that characterise each stage of the manipulation tasks, ranging from simple object displacement, where the same grasp is employed during manipulation (homogeneous manipulation) to more complex interactions such as object reorientation, fine positioning, and sequential in-hand rotation (dexterous manipulation). The framework presented retains the relevant data from human demonstrations, concerning both the manipulation and object characteristics, to be used by future grasp planning in artificial systems performing autonomous grasping.
ISSN: 09218890
DOI: 10.1016/j.robot.2011.07.020
Rights: embargoedAccess
Appears in Collections:FCTUC Eng.Electrotécnica - Artigos em Revistas Internacionais

Files in This Item:
File Description SizeFormat
full-text.pdffull-text848.19 kBAdobe PDFView/Open
Show full item record


checked on Sep 1, 2023


checked on Sep 2, 2023

Page view(s)

checked on Sep 18, 2023


checked on Sep 18, 2023

Google ScholarTM




Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.