Issue 21373: robotparser: Automatically call modified function in read() (original) (raw)

For the moment, RobotFileParser (on both Python 2.x and 3.x) has a method modified, but it is never called in the class itself, hence the last_checked attribute is always at 0 if the user doesn't call modified() explicitly.

I would suggest to add a call to modified() at the end of the read() method. It makes more sense to have a last_checked value (returns in mtime()) updated by the class itself. Especially when the doc says: "Returns the time the robots.txt file was last fetched.". Currently this sentence isn't true, since the value has to be updated by the user.