Every time your web client (usually a browser) opens one of our websites or connects to one of our services, it sends a HTTP request. Every HTTP request includes a series of headers that provide information about your web client.
Kindly refer to An overview of HTTP and HTTP headers on MDN Web Docs for details.
IP address:18.97.14.84
FQDN(s):18-97-14-84.crawl.commoncrawl.org
HTTP-Headers:
accepttext/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8accept-encodingbr,gzipaccept-languageen-US,en;q=0.5user-agentCCBot/2.0 (https://commoncrawl.org/faq/)via2.0 Caddy