| timestamp | ip | host | browser | uri |
|---|
| 20190301-23:55:23 | 46.229.168.151 | crawl23.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20190413-08:36:46 | 46.229.168.151 | crawl23.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20190813-14:24:15 | 46.229.168.151 | crawl23.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20190909-09:40:15 | 46.229.168.151 | crawl23.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20191211-11:09:03 | 46.229.168.151 | crawl23.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20191223-01:01:58 | 46.229.168.151 | crawl23.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20200731-04:44:17 | 46.229.168.151 | crawl23.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |