PDDL-Guided Robot Cloth Folding from Simulation to Real World
Manipulating deformable objects such as textiles remains a significant challenge in robotics due to their complex dynamics, unpredictable configurations, and high-dimensional state space. In this paper, we present an integrated planning and execution framework for robotic cloth manipulation that combines symbolic task planning, physics-based simulation, and vision-guided real-world control. High-level plans are generated using Planning Domain Definition Language (PDDL) and translated into low-level primitive actions executed on a Franka Emika Panda robot. To enable perceptual grounding, we employ a vision-based pipeline using an adapted CeDiRNet model for cloth corner detection and grasp point estimation. The system is first validated in IsaacSim using a particle-based deformable cloth model and then transferred to a real-world setup with consistent performance. Our results demonstrate successful Sim2Real transfer of high-level plans, enabling reliable execution of folding tasks in both simulated and physical environments.