Industrial pick & place · XP Robotics
Vision-guided carton picking on a HITBOT 6-axis arm
A 6-axis HITBOT arm picks up a carton whose position it was never taught. No fixtures, no hardcoded coordinates, no ROS — the entire stack is Python.
- An Intel RealSense D415 captures a single aligned depth frame, deprojected into a point cloud, voxel-downsampled, and fitted for the support plane.
- Anything standing a few centimetres above that plane becomes a candidate. DBSCAN clusters the points; each cluster gets an oriented top face and a bounding size.
- The planner checks whether the carton's top surface is large enough for the four-pad suction to seal. If it isn't, the arm doesn't move toward it. Of the rest, it takes the nearest.
- The pose is transformed through hand-eye calibration into base coordinates. The pick is three Cartesian moves — hover, contact, lift — each run as interpolated waypoints with an IK solution at every step, aborting if the solver flips configuration mid-path.
- Descent intentionally overshoots the expected contact by ~13 mm so the suction bellows compress; at 3 mm the pads were only barely touching the lid. Then: vacuum on, dwell, lift, swing the base joint, descend, release, home.
The carton is placed at a PLC-controlled station — the first step toward a real industrial deployment.
- Python
- RealSense D415
- Point-cloud segmentation
- DBSCAN
- Hand–eye calibration
- Cartesian IK
- 4-pad suction
- PLC station