Suraj Pattar

Robotics AI Research Engineer / Ph.D. in AI and Robotics / Data Scientist / 3D Printing Enthusiast

Development of Object Detection and Grasp Position Estimation in a Commercial Robotic Dishwasher System

  • Supervisor: Hironobu Fujiyoshi
  • University: Chubu University, Aichi, Japan

Ph.D. Thesis

Videos

Ph.D. Defense

Product

Abstract

Artificial intelligence (AI) and robotics research have the potential to revolutionize various industries and tasks. However, deploying these technologies in real-world scenarios can be challenging due to issues such as the need for large amounts of annotated data and the difficulty of adapting to different environments and lighting conditions. In this thesis, we present two main contributions towards making it easier to deploy AI and robotics research in real-world scenarios.

Firstly, we propose the use of a shallow network for the detection of the grasp position of an object. Unlike other networks that require a large amount of computation and training time, our shallow network is trained with synthetic images and is able to detect the grasp position efficiently. This is particularly useful for tasks where quick and precise grasp positioning is essential, such as in automated assembly lines or pick-and-place operations.

Secondly, we introduce the use of mobile robots and invisible markers to automatically collect a large amount of annotated data for object detection and grasp position estimation. The invisible markers, which are only visible under UV light, allow us to generate a large amount of real data in a short amount of time and accurately annotate it. This is a significant improvement over synthetic data, which may not generalize well to real-world scenarios, and manual data collection, which is time-consuming and labor-intensive.

In addition to these main contributions, we also discuss the use of key-point estimation for 6D pose estimation and a deep-learning method for dealing with harsh lighting conditions in depth data acquisition. Overall, this thesis presents practical solutions for deploying AI and robotics research in real-world scenarios, enabling the efficient and effective use of these technologies in a variety of applications.

Publications

Journal

  • S. P. Pattar, T. Killus, T. Hirakawa, T. Yamashita, T. Sawanobori, H. Fujiyoshi. “Automatic Data Collection for Object Detection and Grasp-position Estimation with Mobile Robots and Invisible Markers”, Advanced Robotics, 1-16, 2022.

Abstract Download

  • S. P. Pattar, T. Hirakawa, T. Yamashita, T. Sawanobori, H. Fujiyoshi. “Single Suction Grasp Detection for Symmetric Objects Using Shallow Networks Trained with Synthetic Data.”, IEICE Transactions on Informations and Systems, Vol.E105-D, No.9, pp. 1600-1609, Sep. 2022.

Abstract Download

Conferences

  • W. S. Lo, C. Yamamoto, S. P. Pattar, K. Tsukamoto, S. Takahashi, T. Sawanobori, I. Mizuuchi. “Developing a Collaborative Robotic Dishwasher Cell System for Restaurants.” International Conference on Intelligent Autonomous Systems (IAS 2021).

Abstract