Mouse events not working with vnc to Linux box

Mouse events not working with vnc to Linux box

I have a Linux box running x11vnc. I can connect to it with pocket cloud pro, but the mouse doesn't seem to actually do anything. I can switch windows with keyboard shortcuts, and function keys seem to work, but arrow keys dont work. For instance, I can get the File menu of an application selected with alt-f, but I can not actually move down that menu with down arrow. 

Is this some strange incompatibility with Linux vnc? I don't see many configuration options for pocket cloud, so I'm not even sure there is a solution other than to hope it gets fixed in the next version. 

Has anyone else experienced this?