Skip to content
Start here

Top

Get top domain categories by robots.txt files parsed
client.Radar.RobotsTXT.Top.DomainCategories(ctx, query) (*RobotsTXTTopDomainCategoriesResponse, error)
GET/radar/robots_txt/top/domain_categories

TopUser Agents

Get top user agents on robots.txt files
client.Radar.RobotsTXT.Top.UserAgents.Directive(ctx, query) (*RobotsTXTTopUserAgentDirectiveResponse, error)
GET/radar/robots_txt/top/user_agents/directive