Not Working

accept-encoding, cache-control and accept Request Headers do not have expected values

accept-encoding

gzip

host

r235.srp.dev.deepcrawl.com

referer

https://requestheaders.crawler-seo.dev.deepcrawl.com/

user-agent

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)

via

2.0 788c5a18883f334d0b09e6cda9d22c86.cloudfront.net (CloudFront)

x-amz-cf-id

mwPVpsdvWBaQgCJ6_cBZb4VZW-PmVItiP53RCR81UN5KvDD0rKhHpA==

x-amzn-trace-id

Root=1-6a336387-2043e24040c57b02620e42c6

x-forwarded-for

216.73.216.186, 64.252.74.4

x-forwarded-port

443

x-forwarded-proto

https

x-apigateway-event

%7B%22resource%22%3A%22%2Frequestheaders%22%2C%22path%22%3A%22%2Frequestheaders%2F%22%2C%22httpMethod%22%3A%22GET%22%2C%22headers%22%3A%7B%22Accept-Encoding%22%3A%22gzip%22%2C%22Host%22%3A%22r235.srp.dev.deepcrawl.com%22%2C%22referer%22%3A%22https%3A%2F%2Frequestheaders.crawler-seo.dev.deepcrawl.com%2F%22%2C%22User-Agent%22%3A%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%2C%22Via%22%3A%222.0%20788c5a18883f334d0b09e6cda9d22c86.cloudfront.net%20(CloudFront)%22%2C%22X-Amz-Cf-Id%22%3A%22mwPVpsdvWBaQgCJ6_cBZb4VZW-PmVItiP53RCR81UN5KvDD0rKhHpA%3D%3D%22%2C%22X-Amzn-Trace-Id%22%3A%22Root%3D1-6a336387-2043e24040c57b02620e42c6%22%2C%22X-Forwarded-For%22%3A%22216.73.216.186%2C%2064.252.74.4%22%2C%22X-Forwarded-Port%22%3A%22443%22%2C%22X-Forwarded-Proto%22%3A%22https%22%7D%2C%22multiValueHeaders%22%3A%7B%22Accept-Encoding%22%3A%5B%22gzip%22%5D%2C%22Host%22%3A%5B%22r235.srp.dev.deepcrawl.com%22%5D%2C%22referer%22%3A%5B%22https%3A%2F%2Frequestheaders.crawler-seo.dev.deepcrawl.com%2F%22%5D%2C%22User-Agent%22%3A%5B%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%5D%2C%22Via%22%3A%5B%222.0%20788c5a18883f334d0b09e6cda9d22c86.cloudfront.net%20(CloudFront)%22%5D%2C%22X-Amz-Cf-Id%22%3A%5B%22mwPVpsdvWBaQgCJ6_cBZb4VZW-PmVItiP53RCR81UN5KvDD0rKhHpA%3D%3D%22%5D%2C%22X-Amzn-Trace-Id%22%3A%5B%22Root%3D1-6a336387-2043e24040c57b02620e42c6%22%5D%2C%22X-Forwarded-For%22%3A%5B%22216.73.216.186%2C%2064.252.74.4%22%5D%2C%22X-Forwarded-Port%22%3A%5B%22443%22%5D%2C%22X-Forwarded-Proto%22%3A%5B%22https%22%5D%7D%2C%22queryStringParameters%22%3Anull%2C%22multiValueQueryStringParameters%22%3Anull%2C%22pathParameters%22%3Anull%2C%22stageVariables%22%3Anull%2C%22requestContext%22%3A%7B%22resourceId%22%3A%225l4809%22%2C%22resourcePath%22%3A%22%2Frequestheaders%22%2C%22httpMethod%22%3A%22GET%22%2C%22extendedRequestId%22%3A%22fIx9NHpzIAMEb4A%3D%22%2C%22requestTime%22%3A%2218%2FJun%2F2026%3A03%3A18%3A31%20%2B0000%22%2C%22path%22%3A%22%2Frequestheaders%2F%22%2C%22accountId%22%3A%22059037012730%22%2C%22protocol%22%3A%22HTTP%2F1.1%22%2C%22stage%22%3A%22dev%22%2C%22domainPrefix%22%3A%22r235%22%2C%22requestTimeEpoch%22%3A1781752711330%2C%22requestId%22%3A%22b6fc100e-d7cc-409a-adff-a9e3ca443c99%22%2C%22identity%22%3A%7B%22cognitoIdentityPoolId%22%3Anull%2C%22accountId%22%3Anull%2C%22cognitoIdentityId%22%3Anull%2C%22caller%22%3Anull%2C%22sourceIp%22%3A%22216.73.216.186%22%2C%22principalOrgId%22%3Anull%2C%22accessKey%22%3Anull%2C%22cognitoAuthenticationType%22%3Anull%2C%22cognitoAuthenticationProvider%22%3Anull%2C%22userArn%22%3Anull%2C%22userAgent%22%3A%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%2C%22user%22%3Anull%7D%2C%22domainName%22%3A%22r235.srp.dev.deepcrawl.com%22%2C%22deploymentId%22%3A%22boz0p7%22%2C%22apiId%22%3A%22lh6hnsc7gb%22%7D%2C%22isBase64Encoded%22%3Afalse%7D

x-apigateway-context

%7B%22callbackWaitsForEmptyEventLoop%22%3Atrue%2C%22functionVersion%22%3A%22%24LATEST%22%2C%22functionName%22%3A%22srp-seotestwebsite-235-requestHeadersfn23528AF930D-GJLyIB1fvSE6%22%2C%22memoryLimitInMB%22%3A%22128%22%2C%22logGroupName%22%3A%22%2Faws%2Flambda%2Fsrp-seotestwebsite-235-requestHeadersfn23528AF930D-GJLyIB1fvSE6%22%2C%22logStreamName%22%3A%222026%2F06%2F18%2F%5B%24LATEST%5D44cbd3e6d6dd4b209c1bbc6b20e151a6%22%2C%22invokedFunctionArn%22%3A%22arn%3Aaws%3Alambda%3Aus-east-1%3A059037012730%3Afunction%3Asrp-seotestwebsite-235-requestHeadersfn23528AF930D-GJLyIB1fvSE6%22%2C%22awsRequestId%22%3A%22d54b5007-a919-4620-a9a3-edddf6024f2a%22%7D

connection

close