diff --git a/README.md b/README.md index 5c39c05..c4138f7 100644 --- a/README.md +++ b/README.md @@ -297,13 +297,19 @@ See the build file, `Makefile` or `make.bat` on Windows, for the commands and pa ## Release History +* 0.10.0: + * Fixed bugs in the URL path pattern matching ('?' is now handled correctly as the character '?' instead of matching any one character) + * Added tests 541230 and 541230 from Google project https://github.com/google/robotstxt-spec-test + * Contribution from https://github.com/kox-solid * 0.9.0: * Updated the parser to behave like the Google robots parser. It now handles the product token in the user-agent line up to the last correct character instead of discarding it. See [issue #209](https://github.com/andreburgaud/robotspy/issues/209) for more details. + * Contribution from https://github.com/kox-solid * 0.8.0: * Addressed an issue raised when a robots.txt file is not UTF-8 encoded * Added a user agent to fetch the robots.txt, as some websites, such as pages hosted on Cloudflare, may return a 403 error * Updated the documentation to link to RFC 9309, Robots Exclusion Protocol (REP) * Added a GitHub action job to execute the tests against Python versions 3.8 to 3.12 + * Contribution from https://github.com/tumma72 * 0.7.0: * Fixed bug with the argument path when using the CLI * Print 'url' when the argument is a URL, 'path' otherwise