During my security research and daily tasks, I’m fetching a huge amount of information from many websites around the Interweb. You’re probably here because you found this URL in your access logs and you have questions or you are just curious.
All the automated scripts that I’m running are always using the following User-Agent:
XmeBot/1.0 (https://blog.rootshell.be/bot/)
The User-Agent request-header field contains information about the user agent originating the request. This is for statistical purposes, the tracing of protocol violations, and automated recognition of user agents for the sake of tailoring responses to avoid particular user agent limitations. User agents SHOULD include this field with requests. The field can contain multiple product tokens (section 3.8) and comments identifying the agent and any subproducts which form a significant part of the user agent. By convention, the product tokens are listed in order of their significance for identifying the application. For more information, please check the RFC2616.
Of course, my goal was not to hurt you or your web server. If you find my HTTP requests too intrusive or if you have any question/comment, feel free to drop me an email: <bot[at]rootshell[.]be>.