Home Technology A new robot from MIT can identify things by touch and sight

A new robot from MIT can identify things by touch and sight

Humans can easily identify any object by feeling it or by looking at it. It is a big challenge for machines to understand anything by seeing it or feeling it. A new robot has been developed by the people from MIT Computer Science with the help of Artificial Intelligence, which can identify an object by looking at it or touching it.

The team ended up taking a KUKA robot arm and added some features like a tactile sensor which is popularly called GelSight which was originally created by Ted Adelson’s group called CSAIL. All the information which is collected was then fed to the Artificial Intelligence and then it was taught to build a relationship between the visual and tactile information.

The team ended up recording a total of 12,000 videos of a total of 200 objects. The video was then broken down into still images and the Artificial Intelligence used their dataset to connect tactile and virtual data.

“By looking at the scene, our model can imagine the feeling of touching a flat surface or a sharp edge”, says Yunzhu Li, CSAIL Ph.D. student and lead author on a new paper about the system. “By blindly touching around, our model can predict the interaction with the environment purely from tactile feelings. Bringing these two senses together could empower the robot and reduce the data we might need for tasks involving manipulating and grasping objects.”

The robot can easily identify a few known objects, but only under a controlled environment. The next thing to do is build a larger set so that the robot can work in a more diverse nature.

“Methods like this have the potential to be very useful for robotics, where you need to answer questions like ‘is this object hard or soft?’, or ‘if I lift this mug by its handle, how good will my grip be?’,” says Andrew Owens, a postdoctoral researcher at the University of California at Berkeley. “This is a very challenging problem, since the signals are so different, and this model has demonstrated great capability.”


Colin Newlyn 
Colin Newlyn is Founder and CEO of Main Street Mobile. He looks after the work done by all the reporters. He manages the entire blog and makes necessary updates on the blog. He is an Aspiring Pirate as well as Skier. To get in touch with Colin for news reports he has published you can email him on [email protected].org or reach him out in social media links given below.


Please enter your comment!
Please enter your name here

Must Read

According to the CEO of Huawei: If Huawei trenches Android Google will lose almost 800 million users

Huawei is one of the best smartphone makers in the world. But right now, they have a tendency to turn down the offer of...

Apple is shifting the production of Mac pro from the US to China

According to a report of CNN business, Apple is going to shift its production portion from the US to China. The final production of the...

The head of Google finance is going to join the Board of Postmates ahead of the anticipation of IPO

The vice president of Finance of Google has joined the Board of Directors of Postmates. They need the updated sign for the startup which...

Hans Zimmer about to compose the sound of BMW’s electric vehicle

Hans Zimmer is a legendary music and sound composer of Hollywood who has already worked on different films like Inception and The Lion King....

The main designer of Apple named Jony Ive is resigning because they lost $10 billion

The chief designer officer named Jonathan Ive is going to resign from the design firm of Apple. The tech market of The US is...