Clairvoyant robot anticipates what you need help before you do

Researchers at Cornell University have developed a new robot that isn’t only capable of assisting you with tasks, it can accurately predict when you might need a hand. The robot is equipped with a  Kinect sensor,— developed by Ashutosh Saxena and his team of computer scientists — It utilizes a dataset of 120 videos to analyze and understand your movements. It can then help you perform certain tasks including making a meal, stacking or arranging objects, or taking your medicine.

The researchers use complex algorithms to detect skeletal movements that are assigned to a  sub-activity, in order to detect your actions, which include reaching, moving, pouring, eating, and drinking. Activities are associated with the objects around you, allowing the robot to assess future actions and possible destinations. It can also learn from mistakes, improving its precision in the process. The robot has already achieved accuracy of 83.1 percent for detection of high-level activities, outperforming the algorithms it was tested against.

This technology could be used to assist surgeons in operating theaters or help elderly patients with their care routines.