2026-04-13T13:40:17Zhttps://recercat.cat/oai/request

oai:recercat.cat:2117/4422872026-01-28T06:59:18Zcom_2072_1033col_2072_452950

urn:hdl:2117/442287 BiFold: bimanual cloth folding with language guidance Barbany Mayor, Oriol Colomé Figueras, Adrià Torras, Carme Àrees temàtiques de la UPC::Informàtica::Robòtica Adaptation models Visualization Translation Shape Clothing Benchmark testing Robustness Topology Robots Standards Cloth folding is a complex task due to the inevitable self-occlusions of clothes, their complicated dynamics, and the disparate materials, geometries, and textures that garments can have. In this work, we learn folding actions conditioned on text commands. Translating high-level, abstract instructions into precise robotic actions requires sophisticated language understanding and manipulation capabilities. To do that, we leverage a pre-trained vision-language model and repurpose it to predict manipulation actions. Our model, BiFold, can take context into account and achieves state-of-the-art performance on an existing language-conditioned folding benchmark. To address the lack of annotated bimanual folding data, we introduce a novel dataset with automatically parsed actions and language-aligned instructions, enabling better learning of text-conditioned manipulation. BiFold attains the best performance on our dataset and demonstrates strong generalization to new instructions, garments, and environments. This work was funded by project SGR 00514 (Departament de Recerca i Universitats de la Generalitat de Catalunya) and CSIC project 202350E080 (ClothIRI). O.B. acknowledges travel support from ELISE (GA no 951847). Peer Reviewed Postprint (author's final draft) 2025 Conference lecture https://ieeexplore.ieee.org/document/11127549 Open Access Institute of Electrical and Electronics Engineers (IEEE)