基于Kinect的虚拟果树交互式修剪研究

为解决果树修剪技术推广难的问题,提出了基于手势交互的虚拟果树修剪方法。在已有三维果树模型的基础上,通过创建帧缓冲区对象,构建虚拟屏幕,实现果树枝条的快速拾取和修剪;建立了虚拟果树修剪控制手势集,利用Kinect获取骨骼信息,采用状态机匹配识别手势类型,将手部关节点坐标转换至鼠标绝对坐标系,建立不同手势与鼠标和键盘事件之间的映射关系,实现手势交互代替鼠标和键盘交互。实验结果表明:该方法手势识别准确率高,交互实时性好,能够满足虚拟果树修剪应用需求,为果树修剪技术的学习提供了新的途径。

Interactive Pruning Operation on Virtual Fruit Tree Based on Kinect

A virtual fruit tree pruning method based on hand gesture interaction is proposed to address the challenge of fruit tree pruning technology extension .Based on the existing 3 D fruit tree model , a rapid virtual fruit tree stem picking and pruning method realized by creating a virtual screen using frame buffer object .The control hand gestures of virtual fruit tree pruning were defined .The state machine matching was used to recognize types of hand gestures based on skele -ton information got by the kinect sensor .The hand joint was transformed from the skeleton coordinate system to the mouse absolute coordinate system .Finally , a mapping relation among hand gestures , mouse events and keyboard events was found to replace the mouse and keyboard interaction with hand gesture interaction .The skeleton smoothing and object snap was used to solve the problem of mouse cursor jitter .The gesture recognition rate was 97%.Experimental results show that the proposed method has the merits of high recognition rate , good real-time performance , and is suitable for the applications of virtual fruit tree pruning .It can provide a new approach for the study of fruit tree pruning technology .