News
- The Rethink Robotics Baxter joins Archie the PR2 in the lab
- We are leading WPI's effort on the DARPA Robotics Challenge
- The ARC lab is recruiting both graduate and undergraduate students. Contact dberenson [at] cs.wpi.edu if you're interested!
- Join the ARC mailing list to hear about the latest news. Send an email to dberenson [at] cs.wpi.edu to subscribe.
Research Interests
Our research focuses on creating general-purpose motion planning and manipulation algorithms and applying these algorithms to problems in the domestic, medical, and manufacturing domains. We are interested in all aspects of algorithm development; including creating efficient algorithms, proving their theoretical properties, validating them on real-world robots and problems, integrating them with sensing and higher-level reasoning, and distributing them to open-source communities. We draw on ideas in search, optimization, control theory, and topology to develop these algorithms and to prove their properties. We also strive to develop practical algorithms which can generalize to many types of tasks and application areas.
Press
|
For technical information relevant to working in the lab, please see arc.wpi.edu/wiki.
|
We seek to create a user-guided manipulation framework for High Degree-of-Freedom robots operating in environments with limited communication to apply to the DARPA Robotics Challenge. Our approach consists of three elements: (1) a user-guided perception interface which assists the user to provide task level commands to the robot, (2) planning algorithms that autonomously generate robot motion while obeying relevant constraints, and (3) a trajectory execution and monitoring system. We are prototyping our work on the PR2 but will also apply it to the Hubo humanoid robot. We are part of a multi-university Track A DARPA Robotics Challenge Team lead by Drexel University. See a description of the challenge here. This project is joint work with the Interaction Lab (Prof. Sonia Chernova) and the HIVE lab (Prof. Rob Lindeman) at WPI.
|
|
The goal of combining learning and planning is to create algorithms whose performance improves with experience while maintaining generality. Learning algorithms are good at quickly producing solutions to problems that have been encountered before, but they have difficulty generalizing to new situations. Planning algorithms are good at generalizing to new situations but at significant (and sometimes prohibitive) computational cost. Our work seeks to combine the best of both approaches to create a method whose performance improves as it gains more experience while retaining the ability to generalize to new situations. As a first step in this direction, we recently developed a path planning framework that is able to use previous experience by storing and quickly retrieving previously-computed paths and adapting them to the task at hand while also running a planning algorithm in parallel. This framework allows a robot to train itself as it performs tasks without sacrificing generality. This research opens up new directions for autonomous manipulation in many different application areas, including mobile manipulation in the home and surgical robotics, where similar tasks such as opening a refrigerator or tying a suture are performed repeatedly. Many important questions still remain to be answered; including how to divide complex tasks into sub-tasks, how to decide which sub-tasks should be learned and/or planned, and how to use learning to focus planning on the most relevant parts of a high-dimensional search space. |
![]() ![]() |
Dmitry Berenson, Pieter Abbeel, and Ken Goldberg
IEEE International Conference on Robotics and Automation (ICRA), May, 2012.
Details | PDF | Video
A major frontier for autonomous manipulation lies in interacting with deformable objects, such as cloth and cooking ingredients (in the context of a domestic robot) and thread and tissue (in the context of surgery). This is an extremely under-explored area in autonomous manipulation, mainly because deformable objects are difficult to model and simulate. There are a wide range of problems to explore in this area; including how to learn the model of the object during the manipulation process, how to incorporate probabilistic models of deformation, and how to generalize to two and three-dimensional objects like cloth and tissue.
|
Finding paths in high-dimensional spaces becomes difficult when we wish to optimize the cost of a path in addition to obeying feasibility constraints. While it is possible to find low-cost configurations using sampling, approaches that rely solely on sampling have difficulty navigating cost-space chasms--narrow low-cost regions surrounded by increasing cost. Such chasms are particularly common in planning for manipulators because many useful cost functions induce narrow or lower-dimensional low-cost areas. We developed the GradienT-RRT algorithm, which combines a sampling-based planner with a local gradient method to bias the search toward lower-cost regions. We found that GradienT-RRT is able to plan paths with lower cost than a previously-presented approach while maintaining better or comparable computation time. This algorithm can be applied to cost functions defined in workspace, task space, and C-space. A primary application is planning with uncertainty, where the cost of a configuration encodes that configuration's probabity of collision. Another application is path imitation, where the cost function can be used to bias the planner toward a demonstrated path while still allowing it the freedom to explore.
|
Dmitry Berenson, Thierry Simeon, Siddhartha Srinivasa
IEEE International Conference on Robotics and Automation (ICRA), May, 2011.
Details | PDF | Video
|
Our everyday lives are full of tasks that constrain our movement. Carrying a coffee mug, lifting a heavy object, or sliding a milk jug out of a refrigerator are examples of tasks that involve constraints imposed on our bodies as well as on the manipulated objects. Creating algorithms for general-purpose robots to perform these kinds of tasks also involves computing motions that are subject to multiple simultaneous task constraints. |
|
Task Space Regions
Some of the most common constraints in manipulation planning are constraints on the pose of a robot's end-effector. They arise in tasks such as reaching to grasp an object, carrying a cup of coffee, or opening a door. These constraints can act on the entire path, such as not spilling a cup of coffee, and/or on the goal of a path, such as reaching to grasp an object. In general a set of constraints for a manipulator's end-effector can consist of an arbitrary number of poses spread in an arbitrary way throughout the task space. However, such a broad representation lacks three fundamental properties that are necessary for sampling-based planning:
- The set of poses must be easy to specify.
- Sampling from the set of poses must be efficient.
- The distance to the set must be fast to compute.
TSRs describe end-effector pose constraints as volumes in SE(3), the space of rigid spatial transformations. These volumes are particularly useful for manipulation tasks such as reaching to grasp an object, manipulating an object with pose constraints, such as a glass of water, or placing an object onto a surface, such as table. TSRs are intuitive to specify, they can be efficiently sampled, and the distance to a TSR can be evaluated very quickly, making them ideal for sampling-based planners such as CBiRRT.
Task Space Region Chains for Whole-Body Manipulation
While TSRs can represent many useful constraints, a single TSR, or even a finite set of TSRs, is sometimes insufficient to capture the pose constraints of a given task. To describe more complex constraints such as closed chain kinematics and manipulating articulated objects, we use TSR Chains, which are defined by linking a series of TSRs. A TSR Chain can be thought of as a virtual manipulation whose reachability is the set of allowable poses. Though the sampling for TSR Chains follows clearly from that of TSRs, the distance metric for TSR Chains is radically different. TSR Chains allow high degree-of-freedom systems such as humanoid robots to perform constrained whole-body manipulation tasks while exploiting the redundancy of these systems.
Planning with Pose Uncertainty
A common assumption when planning for robotic manipulation tasks is that the robot has perfect knowledge of the geometry and pose of objects in the environment. For a robot operating in a home environment it may be reasonable to have geometric models of the objects the robot manipulates frequently and/or the robot's work area. However, these objects and the robot frequently move around the environment, introducing uncertainty into the pose of the objects relative to the robot. Laser-scanners, cameras, and sonar sensors can all be used to help resolve the poses of objects in the environment, but these sensors are never perfect and usually localize the objects to be within some hypothetical probability distribution of pose estimates. If this set of probable poses is large, planning with the best hypothesis alone can be unreliable because the robot may fail to complete the task and unsafe because the robot could collide with a poorly-localized object.
Since we would like to compute a plan that is guaranteed to meet task specifications for all hypotheses of object pose, we must modify the TSRs of a given task to account for pose uncertainty and introduce virtual obstacles into the simulation to avoid potential collisions. We start by duplicating the TSRs for each pose hypothesis and computing the intersection of all duplicates. We can then sample from the 6-dimensional polytope of intersection to obtain poses that are guaranteed to obey task constraints despite pose uncertainty. A key advantage of this approach is that if the pose uncertainty is too great to accomplish a certain task, we can quickly reject that task without invoking a planner. This approach can also eliminate grasping strategies which are not robust to uncertainty.
Motion Planning Theory
We were the first to present a proof for the probabilistic completeness of RRT-based algorithms when planning with constraints on end-effector pose. If the manifold of valid configurations corresponding to the pose constraint has non-zero measure in the C-space, it is straightforward to show that algorithms like CBiRRT are probabilistically complete. This is because random sampling in the C-space will eventually place samples inside of the manifold.
However, pose constraints can also induce lower-dimensional constraint manifolds in the configuration space, making rejection sampling techniques infeasible. Sampling-based algorithms such as CBiRRT can overcome this problem by using the sample-project method: sampling coupled with a projection operator to move configuration space samples onto the constraint manifold. Before our work, it was not known whether the sample-project method produces adequate coverage of the constraint manifold to guarantee probabilistic completeness. Our proof guarantees probabilistic completeness for a class of RRT-based algorithms given an appropriate projection operator. This proof is valid for constraint manifolds of any fixed dimensionality.
Base Placement for Mobile Manipulators
Path planning for a mobile manipulator involves multiple levels of planning which are often divided into sub-problems to manage complexity. For a pick-and place operation the break-down might be: 1) move the robot to a configuration near the object, 2) grasp the object, 3) move the robot (holding the object) to some configuration which places the object into its goal configuration. Breaking the problem into the above sub-problems reduces the complexity of the overall task by allowing sub-plans to be generated in series. However, ignoring the coupling between sub-problems can turn feasible problems into infeasible ones and introduce unnecessary difficulty for the path planning algorithm. We show how to couple sub-problems through choosing optimal grasps and base placements for transition configurations, i.e. configurations where the robot first grasps or releases the object. We find optimal configurations (in terms of grasp quality, manipulability, and clutter) by searching a constrained space of base placements and grasps using a co-evolutionary algorithm. This algorithm significantly out-performs random sampling and is able to generate high-quality configurations in extremely cluttered environments.
Dmitry Berenson
Ph.D. dissertation, Robotics Institute, School of Computer Science, Carnegie Mellon University, June, 2011.
Details | PDF
The goal of a grasping algorithm is to find a pose and configuration of a robot's hand which grasps a given object in a desirable way. Development of grasp quality metrics, such as force-closure, has been intensely studied in robotics for many years; however these metrics neglect a key component of grasp selection: an object's environment. Our research in grasping has focused on extracting information about an object's environment to make decisions about how that object should be grasped. Considering the object's environment allows the robot to quickly eliminate hand poses that place the hand in areas where there are obstacles and to focus on areas where the hand is collision-free and where the fingers make good contact with the object. Our grasping algorithms are able to find grasps in environments where state-of-the-art algorithms cannot, while requiring only several seconds of computation. We have also extended these algorithms to consider two-handed grasps with similar results.
Dmitry Berenson and Siddhartha Srinivasa
IEEE-RAS International Conference on Humanoid Robots (Humanoids), December, 2008
Details | PDF | Video
Dmitry Berenson, Rosen Diankov, Koichi Nishiwaki, Satoshi Kagami, and James Kuffner
IEEE-RAS International Conference on Humanoid Robots (Humanoids), December, 2007
Details | PDF | Video
Faculty
Post Docs
PhD Students
Undergraduate Students
- NPIP: A Skew Line Needle Configuration Optimization System for HDR Brachytherapy
Timmy Siauw, Adam Cunha, Dmitry Berenson, Alper Atamturk, I-Chow Hsu, Ken Goldberg, and Jean Pouliot
Medical Physics, Volume 39, Number 7, pp. 4339 - 4346, July, 2012.
Details | PDF - HERB 2.0: A Personal Assistant in the Home
Siddhartha S. Srinivasa, Dmitry Berenson, Maya Cakmakz, Alvaro Collet, Mehmet R. Dogar, Anca D. Dragan, Ross A. Knepper, Tim Niemueller, Kyle Strabala, Mike Vande Weghe, Julius Ziegler
Proceedings of the IEEE, Vol. 100, No. 8, pp. 1-19, July, 2012.
Details | PDF - Task Space Regions: A Framework for Pose-Constrained Manipulation Planning
Dmitry Berenson, Siddhartha Srinivasa, and James Kuffner
International Journal of Robotics Research (IJRR), Volume 30, Number 12, pp. 1435 - 1460, October, 2011.
Details | PDF - HERB: A Home Exploring Robotic Butler
Siddhartha Srinivasa, David Ferguson, Casey Helfrich, Dmitry Berenson, Alvaro Collet Romea, Rosen Diankov, Garratt Gallagher, Geoffrey Hollinger, James Kuffner, and J Michael Vandeweghe
Autonomous Robots, Vol. 28, No. 1, pp. 5-20, January, 2010.
Details | PDF - Toward A User-Guided Manipulation Framework for High-DOF Robots with Limited Communication
Nicholas Alunni, Calder Phillips-Grafflin, Halit Bener Suay, Daniel Lofaro, Dmitry Berenson, Sonia Chernova, Robert W. Lindeman, Paul Oh
IEEE International Conference on Technologies for Practical Robot Applications (TePRA), April, 2013
PDF | Video - Initial Experiments toward Automated Robotic Implantation of Skew-Line Needle Arrangements for HDR Brachytherapy
Animesh Garg, Timmy Siauw, Dmitry Berenson, Adam Cunha, I-Chow Hsu, Jean Pouliot, Dan Stoianovici, Ken Goldberg
IEEE International Conference on Automation Science and Engineering (CASE), August, 2012. Best Application Paper Award
PDF - Estimating Part Tolerance Bounds Based on Adaptive Cloud-Based Grasp Planning with Slip
Ben Kehoe, Dmitry Berenson, and Ken Goldberg
IEEE International Conference on Automation Science and Engineering (CASE), August, 2012.
PDF - A Constraint-Aware Motion Planning Algorithm for Robotic Folding of Clothes
Karthik Lakshmanan, Apoorva Sachdev, Ziang Xie, Dmitry Berenson, Ken Goldberg, and Pieter Abbeel
International Symposium on Experiment Robotics (ISER), June, 2012.
PDF | Video - A Robot Path Planning Framework that Learns from Experience
Dmitry Berenson, Pieter Abbeel, and Ken Goldberg
IEEE International Conference on Robotics and Automation (ICRA), May, 2012.
Details | PDF | Video - Constellation - An Algorithm for Finding Robot Configurations that Satisfy Multiple Constraints
Peter Kaiser, Dmitry Berenson, Nikolaus Vahrenkamp, Tamim Asfour, Rudiger Dillmann, Siddhartha Srinivasa
IEEE International Conference on Robotics and Automation (ICRA), May, 2012.
PDF - Toward Cloud-Based Grasping with Uncertainty in Shape: Estimating Lower Bounds on Achieving Force Closure with Zero-Slip Push Grasps
Ben Kehoe, Dmitry Berenson, and Ken Goldberg
IEEE International Conference on Robotics and Automation (ICRA), May, 2012.
PDF - Addressing Cost-Space Chasms for Manipulation Planning
Dmitry Berenson, Thierry Simeon, Siddhartha Srinivasa
IEEE International Conference on Robotics and Automation (ICRA), May, 2011.
Details | PDF | Video - People Helping Robots Helping People: Crowdsourcing for Grasping Novel Objects
Alexander Sorokin, Dmitry Berenson, Siddhartha Srinivasa, and Martial Hebert
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), October, 2010
Details | PDF | Video - Probabilistically Complete Planning with End-Effector Pose Constraints
Dmitry Berenson and Siddhartha Srinivasa
IEEE International Conference on Robotics and Automation (ICRA), May, 2010
Details | PDF - Pose-Constrained Whole-Body Planning using Task Space Region Chains
Dmitry Berenson, Joel Chestnutt, Siddhartha Srinivasa, James Kuffner, and Satoshi Kagami
IEEE-RAS International Conference on Humanoid Robots (Humanoids), December, 2009
Details | PDF | Video - Addressing Pose Uncertainty in Manipulation Planning Using Task Space Regions
Dmitry Berenson, Siddhartha Srinivasa, and James Kuffner
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), October, 2009
Details | PDF - Humanoid Motion Planning for Dual-Arm Manipulation and Re-Grasping Tasks
Nikolaus Vahrenkamp, Dmitry Berenson, Tamim Asfour, James Kuffner, and Rudiger Dillmann
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), October, 2009
Details | PDF - Manipulation Planning on Constraint Manifolds
Dmitry Berenson, Siddhartha Srinivasa, David Ferguson, and James Kuffner
IEEE International Conference on Robotics and Automation (ICRA), May, 2009
Details | PDF | Video - Manipulation Planning with Workspace Goal Regions
Dmitry Berenson, Siddhartha Srinivasa, David Ferguson, Alvaro Collet Romea, and James Kuffner
IEEE International Conference on Robotics and Automation (ICRA), May, 2009
Details | PDF - Object Recognition and Full Pose Registration from a Single Image for Robotic Manipulation
Alvaro Collet Romea, Dmitry Berenson, Siddhartha Srinivasa, and David Ferguson
IEEE International Conference on Robotics and Automation (ICRA), May, 2009
Details | PDF - Grasp Synthesis in Cluttered Environments for Dexterous Hands
Dmitry Berenson and Siddhartha Srinivasa
IEEE-RAS International Conference on Humanoid Robots (Humanoids), December, 2008
Details | PDF | Video - The Robotic Busboy: Steps Towards Developing a Mobile Robotic Home Assistant
Siddhartha Srinivasa, David Ferguson, J Michael Vandeweghe, Rosen Diankov, Dmitry Berenson, Casey Helfrich, and Hauke Strasdat
International Conference on Intelligent Autonomous Systems (IAS), July, 2008
Details | PDF - An Optimization Approach to Planning for Mobile Manipulation
Dmitry Berenson, Howie Choset, and James Kuffner
IEEE International Conference on Robotics and Automation (ICRA), May, 2008
Details | PDF - Grasp Planning in Complex Scenes
Dmitry Berenson, Rosen Diankov, Koichi Nishiwaki, Satoshi Kagami, and James Kuffner
IEEE-RAS International Conference on Humanoid Robots (Humanoids), December, 2007
Details | PDF | Video - Hardware Evolution of Analog Circuits for In-situ Robotic Fault-Recovery
Dmitry Berenson, Nicholas Esteves, and Hod Lipson
NASA/DoD Conference on Evolvable Hardware, June, 2005
Details | PDF | Video - Grasp Synthesis in Cluttered Environments for Dexterous Hands
Dmitry Berenson and Siddhartha Srinivasa
Robotics Science and Systems (RSS) Workshop on Robot Manipulation: Intelligence in Human Environments, June, 2008
Details | PDF - Constrained Manipulation Planning
Dmitry Berenson
Ph.D. dissertation, Robotics Institute, School of Computer Science, Carnegie Mellon University, June, 2011.
Details | PDF
Refereed Journal Papers
Refereed Conference Papers
Refereed Workshop Papers
Theses

Dmitry Berenson
Assistant ProfessorRobotics Engineering
Program Computer Science Department
Worcester Polytechnic Institute
Office: Atwater Kent Laboratories 121
Lab: Atwater Kent Laboratories 013
Office Phone: 508-831-5587
dberenson [at] cs.wpi.edu
http://users.wpi.edu/~dberenson/
CoMPS is implemented in C++ and compiles in linux only. There are also several examples in python and matlab that show how to interface with openrave to use the plugins in CoMPS.
This package is available on SourceForge.
LightningROS is a ROS package implementing the Lightning Path Planning Framework. This approach uses a path library to store previous experience while allowing generality by also planning from scratch. Please see this paper for more details.
This package uses OMPL planners to implement each component in Lightning and can be called the same way as any other OMPL planner.
This package is available on SourceForge.

