| timestamp | ip | host | browser | uri |
|---|
| 20190301-23:55:24 | 46.229.168.149 | crawl21.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20190309-03:29:17 | 46.229.168.149 | crawl21.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20190608-13:47:21 | 46.229.168.149 | crawl21.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20191114-11:45:52 | 46.229.168.149 | crawl21.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20200404-16:40:36 | 46.229.168.149 | crawl21.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20200702-17:35:37 | 46.229.168.149 | crawl21.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |