My weekend project - a robot that plays Pokemon Go!
I basically strapped a stylus onto a Novint Falcon, threw together a basic iOS app + OSX C++ robotics control program, and used OpenCV to compute a homography between the phone screen and a camera. The end result is you can have a robot interact with the phone and perform clicks / drags on the phone screen. I also cobbled together a little GPS spoofer using Xcode's location emulator and Python.
Currently, I click on where I want the robot to go and the robot follows along my path. Eventually I'd like to implement some computer vision techniques to automatically detect Pokemon, click on them, and successfully capture them all autonomously.
Game
Социальные закладки