ProcessLink() ignores anything else using a gawd-awful nasty hack.
Updated the robot sink apis. Fixed the global url holder in the destructor of the parser. Changed the robot observer to set a flag when completed parsing of a url so that it doesn't create lottsa little parsers.