Skip to content

Commit

Permalink
updated release history with version 0.10.0
Browse files Browse the repository at this point in the history
  • Loading branch information
andreburgaud committed Aug 27, 2024
1 parent 25b4ea1 commit f5f0cea
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -297,13 +297,19 @@ See the build file, `Makefile` or `make.bat` on Windows, for the commands and pa

## Release History

* 0.10.0:
* Fixed bugs in the URL path pattern matching ('?' is now handled correctly as the character '?' instead of matching any one character)
* Added tests 541230 and 541230 from Google project https://github.com/google/robotstxt-spec-test
* Contribution from https://github.com/kox-solid
* 0.9.0:
* Updated the parser to behave like the Google robots parser. It now handles the product token in the user-agent line up to the last correct character instead of discarding it. See [issue #209](https://github.com/andreburgaud/robotspy/issues/209) for more details.
* Contribution from https://github.com/kox-solid
* 0.8.0:
* Addressed an issue raised when a robots.txt file is not UTF-8 encoded
* Added a user agent to fetch the robots.txt, as some websites, such as pages hosted on Cloudflare, may return a 403 error
* Updated the documentation to link to RFC 9309, Robots Exclusion Protocol (REP)
* Added a GitHub action job to execute the tests against Python versions 3.8 to 3.12
* Contribution from https://github.com/tumma72
* 0.7.0:
* Fixed bug with the argument path when using the CLI
* Print 'url' when the argument is a URL, 'path' otherwise
Expand Down

0 comments on commit f5f0cea

Please sign in to comment.