I am working on a program that would make firefox accessible to locked-in patients.

What I need to be able to do is from python, find all the links and buttons on the active web page. I need to be able to find their physical locations on the screen, and I need to be able to tell the browser to follow ("click on") them later.

Does anybody know how I would go about doing this? I do not know how to write an extension...