| timestamp | ip | host | browser | uri |
|---|
| 20190408-13:09:45 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20190608-13:47:21 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20190621-11:44:13 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20190803-15:52:28 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20190929-07:15:07 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20191017-06:28:56 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20200311-05:47:29 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20200312-07:59:12 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20200320-03:43:09 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20200806-18:20:24 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20200809-18:40:23 | 46.229.168.129 | crawl1.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |