New open source robots.txt projects

Last year we released the robots.txt parser and matcher that we use in our production systems to the open source world. Since then, we’ve seen people build new tools with it, contribute to the open source library (effectively improving our production systems- thanks!), and release new language versions like golang and rust, which make it easier for developers to build new tools.

Toronto, Ontario, Canada

Stay @ home Guru

Opening Hours

Mon - Fri: 10am - 4pm

416-900-7530

Get in touch

csmith@go2guru.ca

Feel free to ask

Copyright 2020 © Go2Guru Webs | All Rights Reserved

Terms   |   Privacy Policy   |   Refunds