timestamp | ip | host | browser | uri |
---|
20181212-16:42:10 | 46.229.168.142 | crawl14.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
20190222-14:01:52 | 46.229.168.142 | crawl14.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20190930-09:34:48 | 46.229.168.142 | crawl14.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20191210-16:57:44 | 46.229.168.142 | crawl14.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
20191222-18:54:05 | 46.229.168.142 | crawl14.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20200728-06:04:25 | 46.229.168.142 | crawl14.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |