timestamp | ip | host | browser | uri |
---|
20190210-06:17:32 | 46.229.168.136 | crawl8.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20190308-18:44:22 | 46.229.168.136 | crawl8.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20191017-06:28:52 | 46.229.168.136 | crawl8.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20191027-02:21:54 | 46.229.168.136 | crawl8.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20200302-03:13:22 | 46.229.168.136 | crawl8.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20200320-03:43:06 | 46.229.168.136 | crawl8.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
20200511-08:29:00 | 46.229.168.136 | crawl8.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
20200511-18:02:45 | 46.229.168.136 | crawl8.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |