Not Working

accept-encoding, cache-control and accept Request Headers do not have expected values

accept-encoding

gzip

host

r224.srp.dev.deepcrawl.com

referer

https://requestheaders.crawler-seo.dev.deepcrawl.com/

user-agent

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)

via

2.0 784ffc262e0c17e3566b62b0f85f34d0.cloudfront.net (CloudFront)

x-amz-cf-id

fajj8PHiu8vp5zPyzTs4csAEYluYDO20dGkHd4VjbYAeWMnVYU2qVg==

x-amzn-trace-id

Root=1-688eb2bb-7ac3ebbe4a6211914f37e1d0

x-forwarded-for

216.73.216.175, 64.252.74.119

x-forwarded-port

443

x-forwarded-proto

https

x-apigateway-event

%7B%22resource%22%3A%22%2Frequestheaders%22%2C%22path%22%3A%22%2Frequestheaders%2F%22%2C%22httpMethod%22%3A%22GET%22%2C%22headers%22%3A%7B%22Accept-Encoding%22%3A%22gzip%22%2C%22Host%22%3A%22r224.srp.dev.deepcrawl.com%22%2C%22referer%22%3A%22https%3A%2F%2Frequestheaders.crawler-seo.dev.deepcrawl.com%2F%22%2C%22User-Agent%22%3A%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%2C%22Via%22%3A%222.0%20784ffc262e0c17e3566b62b0f85f34d0.cloudfront.net%20(CloudFront)%22%2C%22X-Amz-Cf-Id%22%3A%22fajj8PHiu8vp5zPyzTs4csAEYluYDO20dGkHd4VjbYAeWMnVYU2qVg%3D%3D%22%2C%22X-Amzn-Trace-Id%22%3A%22Root%3D1-688eb2bb-7ac3ebbe4a6211914f37e1d0%22%2C%22X-Forwarded-For%22%3A%22216.73.216.175%2C%2064.252.74.119%22%2C%22X-Forwarded-Port%22%3A%22443%22%2C%22X-Forwarded-Proto%22%3A%22https%22%7D%2C%22multiValueHeaders%22%3A%7B%22Accept-Encoding%22%3A%5B%22gzip%22%5D%2C%22Host%22%3A%5B%22r224.srp.dev.deepcrawl.com%22%5D%2C%22referer%22%3A%5B%22https%3A%2F%2Frequestheaders.crawler-seo.dev.deepcrawl.com%2F%22%5D%2C%22User-Agent%22%3A%5B%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%5D%2C%22Via%22%3A%5B%222.0%20784ffc262e0c17e3566b62b0f85f34d0.cloudfront.net%20(CloudFront)%22%5D%2C%22X-Amz-Cf-Id%22%3A%5B%22fajj8PHiu8vp5zPyzTs4csAEYluYDO20dGkHd4VjbYAeWMnVYU2qVg%3D%3D%22%5D%2C%22X-Amzn-Trace-Id%22%3A%5B%22Root%3D1-688eb2bb-7ac3ebbe4a6211914f37e1d0%22%5D%2C%22X-Forwarded-For%22%3A%5B%22216.73.216.175%2C%2064.252.74.119%22%5D%2C%22X-Forwarded-Port%22%3A%5B%22443%22%5D%2C%22X-Forwarded-Proto%22%3A%5B%22https%22%5D%7D%2C%22queryStringParameters%22%3Anull%2C%22multiValueQueryStringParameters%22%3Anull%2C%22pathParameters%22%3Anull%2C%22stageVariables%22%3Anull%2C%22requestContext%22%3A%7B%22resourceId%22%3A%22znt3ul%22%2C%22resourcePath%22%3A%22%2Frequestheaders%22%2C%22httpMethod%22%3A%22GET%22%2C%22extendedRequestId%22%3A%22OtDdYGp1oAMEI0A%3D%22%2C%22requestTime%22%3A%2203%2FAug%2F2025%3A00%3A52%3A11%20%2B0000%22%2C%22path%22%3A%22%2Frequestheaders%2F%22%2C%22accountId%22%3A%22059037012730%22%2C%22protocol%22%3A%22HTTP%2F1.1%22%2C%22stage%22%3A%22dev%22%2C%22domainPrefix%22%3A%22r224%22%2C%22requestTimeEpoch%22%3A1754182331661%2C%22requestId%22%3A%22b0ad67b0-5c2e-4db8-8d2b-bb8e02d710b5%22%2C%22identity%22%3A%7B%22cognitoIdentityPoolId%22%3Anull%2C%22accountId%22%3Anull%2C%22cognitoIdentityId%22%3Anull%2C%22caller%22%3Anull%2C%22sourceIp%22%3A%22216.73.216.175%22%2C%22principalOrgId%22%3Anull%2C%22accessKey%22%3Anull%2C%22cognitoAuthenticationType%22%3Anull%2C%22cognitoAuthenticationProvider%22%3Anull%2C%22userArn%22%3Anull%2C%22userAgent%22%3A%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%2C%22user%22%3Anull%7D%2C%22domainName%22%3A%22r224.srp.dev.deepcrawl.com%22%2C%22deploymentId%22%3A%229hoaqc%22%2C%22apiId%22%3A%221mii9fpam0%22%7D%2C%22isBase64Encoded%22%3Afalse%7D

x-apigateway-context

%7B%22callbackWaitsForEmptyEventLoop%22%3Atrue%2C%22functionVersion%22%3A%22%24LATEST%22%2C%22functionName%22%3A%22srp-seotestwebsite-224-requestHeadersfn224A55AE036-Ng0sVoGDnuXv%22%2C%22memoryLimitInMB%22%3A%22128%22%2C%22logGroupName%22%3A%22%2Faws%2Flambda%2Fsrp-seotestwebsite-224-requestHeadersfn224A55AE036-Ng0sVoGDnuXv%22%2C%22logStreamName%22%3A%222025%2F08%2F03%2F%5B%24LATEST%5Dd100d34b53c74fb698b3dccbbb9ef471%22%2C%22invokedFunctionArn%22%3A%22arn%3Aaws%3Alambda%3Aus-east-1%3A059037012730%3Afunction%3Asrp-seotestwebsite-224-requestHeadersfn224A55AE036-Ng0sVoGDnuXv%22%2C%22awsRequestId%22%3A%2242d1b375-ab3c-41bf-8f12-c48656931a74%22%7D

connection

close