| timestamp | ip | host | browser | uri |
|---|
| 20190531-03:04:13 | 46.229.168.148 | crawl20.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20190630-09:18:09 | 46.229.168.148 | crawl20.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20191017-18:09:49 | 46.229.168.148 | crawl20.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20191104-04:59:26 | 46.229.168.148 | crawl20.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20191109-17:52:09 | 46.229.168.148 | crawl20.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |
| 20191112-19:06:41 | 46.229.168.148 | crawl20.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20200301-15:32:54 | 46.229.168.148 | crawl20.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /sitemap.xml |
| 20200602-10:05:25 | 46.229.168.148 | crawl20.bl.semrush.com | Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) | /robots.txt |