Robots TXT
Robots TXTTop
Get top domain categories by robots.txt files parsed
client.Radar.RobotsTXT.Top.DomainCategories(ctx, query) (*RobotsTXTTopDomainCategoriesResponse, error)
GET/radar/robots_txt/top/domain_categories
Robots TXTTopUser Agents
Get top user agents on robots.txt files
client.Radar.RobotsTXT.Top.UserAgents.Directive(ctx, query) (*RobotsTXTTopUserAgentDirectiveResponse, error)
GET/radar/robots_txt/top/user_agents/directive