No Mouse Required: Create CAD Models with Hand Gestures

Craft 3D images for 3D printing and simulation with hand gestures.


Mech. Eng. Prof. Karthik Ramani creates an object using his Handy Potter software. Photo by Purdue Research Foundation.

A new 3D Imaging software from Purdue engineers called Handy Potter allows users to craft computer generated 3D images using hand gestures. Handy Potter promises to have applications in engineering design, architecture, art and even video games.

Handy Potter uses depth sensing cameras and software algorithms to recognize a user’s hand gestures. These hand motions can then be used to create geometric shapes in CAD software. From there, the CAD models can be transferred to engineering tools, such as simulation software and 3D Printers.

A team of developers working under Mechanical Engineering Professor Karthik Ramani developed the software. Prof. Ramani is also a co-founder of the company Zero UI, which will be marketing Handy Potter.

Ramani said, “Zero UI is working on commercialization and has talked with a lot of device companies at this time. The software can be used to create models quickly and repurpose it for other things like 3D Printers or Simulation. At the moment we are targeting the maker community, but the tool can be used with simulation and CAD modellers using software API. It’s a matter of setting up the program interfaces.”

He added, “This technology is very simple and easy for users, but behind that simplicity are complicated and intelligent algorithms that represent a state-of-the-art synthesis of machine learning and geometric modeling … The technology could change the way people interact with the computer. This tool allows people to express their ideas rapidly and quickly using hand motions alone. We want to make it a natural action for people to gesture to a computer screen and create things with their hands.”

It seems that ASME loved Handy Potter; it won several awards at the International Design Engineering Technology Conferences and the Computers and Information in Engineering Conference.

“We want to democratize modeling so that people, other than engineers and architects, can create a 3D design in their computer. In fact, our goal down the line is to make the computer invisible so you don’t have to train to be an expert in the software,” explained Prof. Ramani.

As many engineers still use clay and 3D Printers to help visualize their designs, Handy Potter could become a great early design cycle tool for creating those first product visualizations.


Video Courtesy of Photo by Purdue Research Foundation.

Source Purdue.

Written by

Shawn Wasserman

For over 10 years, Shawn Wasserman has informed, inspired and engaged the engineering community through online content. As a senior writer at WTWH media, he produces branded content to help engineers streamline their operations via new tools, technologies and software. While a senior editor at Engineering.com, Shawn wrote stories about CAE, simulation, PLM, CAD, IoT, AI and more. During his time as the blog manager at Ansys, Shawn produced content featuring stories, tips, tricks and interesting use cases for CAE technologies. Shawn holds a master’s degree in Bioengineering from the University of Guelph and an undergraduate degree in Chemical Engineering from the University of Waterloo.