Not Working

accept-encoding, cache-control and accept Request Headers do not have expected values

accept-encoding

gzip

host

r221.srp.dev.deepcrawl.com

referer

https://requestheaders.crawler-seo.dev.deepcrawl.com/

user-agent

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)

via

2.0 ff8e36e5267cb39e0ce8c3df049957a6.cloudfront.net (CloudFront)

x-amz-cf-id

ca096so_n1VsVKQ3UvkA-_Rw1bPcUmnpO8mGwHztye9a1-W6ToXUiA==

x-amzn-trace-id

Root=1-681d7d8d-4b234fec60c41d2423833212

x-forwarded-for

18.117.166.111, 64.252.76.23

x-forwarded-port

443

x-forwarded-proto

https

x-apigateway-event

%7B%22resource%22%3A%22%2Frequestheaders%22%2C%22path%22%3A%22%2Frequestheaders%2F%22%2C%22httpMethod%22%3A%22GET%22%2C%22headers%22%3A%7B%22Accept-Encoding%22%3A%22gzip%22%2C%22Host%22%3A%22r221.srp.dev.deepcrawl.com%22%2C%22referer%22%3A%22https%3A%2F%2Frequestheaders.crawler-seo.dev.deepcrawl.com%2F%22%2C%22User-Agent%22%3A%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%2C%22Via%22%3A%222.0%20ff8e36e5267cb39e0ce8c3df049957a6.cloudfront.net%20(CloudFront)%22%2C%22X-Amz-Cf-Id%22%3A%22ca096so_n1VsVKQ3UvkA-_Rw1bPcUmnpO8mGwHztye9a1-W6ToXUiA%3D%3D%22%2C%22X-Amzn-Trace-Id%22%3A%22Root%3D1-681d7d8d-4b234fec60c41d2423833212%22%2C%22X-Forwarded-For%22%3A%2218.117.166.111%2C%2064.252.76.23%22%2C%22X-Forwarded-Port%22%3A%22443%22%2C%22X-Forwarded-Proto%22%3A%22https%22%7D%2C%22multiValueHeaders%22%3A%7B%22Accept-Encoding%22%3A%5B%22gzip%22%5D%2C%22Host%22%3A%5B%22r221.srp.dev.deepcrawl.com%22%5D%2C%22referer%22%3A%5B%22https%3A%2F%2Frequestheaders.crawler-seo.dev.deepcrawl.com%2F%22%5D%2C%22User-Agent%22%3A%5B%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%5D%2C%22Via%22%3A%5B%222.0%20ff8e36e5267cb39e0ce8c3df049957a6.cloudfront.net%20(CloudFront)%22%5D%2C%22X-Amz-Cf-Id%22%3A%5B%22ca096so_n1VsVKQ3UvkA-_Rw1bPcUmnpO8mGwHztye9a1-W6ToXUiA%3D%3D%22%5D%2C%22X-Amzn-Trace-Id%22%3A%5B%22Root%3D1-681d7d8d-4b234fec60c41d2423833212%22%5D%2C%22X-Forwarded-For%22%3A%5B%2218.117.166.111%2C%2064.252.76.23%22%5D%2C%22X-Forwarded-Port%22%3A%5B%22443%22%5D%2C%22X-Forwarded-Proto%22%3A%5B%22https%22%5D%7D%2C%22queryStringParameters%22%3Anull%2C%22multiValueQueryStringParameters%22%3Anull%2C%22pathParameters%22%3Anull%2C%22stageVariables%22%3Anull%2C%22requestContext%22%3A%7B%22resourceId%22%3A%22topvqm%22%2C%22resourcePath%22%3A%22%2Frequestheaders%22%2C%22httpMethod%22%3A%22GET%22%2C%22extendedRequestId%22%3A%22KSCOOEWjIAMEK0g%3D%22%2C%22requestTime%22%3A%2209%2FMay%2F2025%3A03%3A59%3A09%20%2B0000%22%2C%22path%22%3A%22%2Frequestheaders%2F%22%2C%22accountId%22%3A%22059037012730%22%2C%22protocol%22%3A%22HTTP%2F1.1%22%2C%22stage%22%3A%22dev%22%2C%22domainPrefix%22%3A%22r221%22%2C%22requestTimeEpoch%22%3A1746763149837%2C%22requestId%22%3A%225e9eba16-fb40-4d5a-a63d-1c5a9c2b6778%22%2C%22identity%22%3A%7B%22cognitoIdentityPoolId%22%3Anull%2C%22accountId%22%3Anull%2C%22cognitoIdentityId%22%3Anull%2C%22caller%22%3Anull%2C%22sourceIp%22%3A%2218.117.166.111%22%2C%22principalOrgId%22%3Anull%2C%22accessKey%22%3Anull%2C%22cognitoAuthenticationType%22%3Anull%2C%22cognitoAuthenticationProvider%22%3Anull%2C%22userArn%22%3Anull%2C%22userAgent%22%3A%22Mozilla%2F5.0%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot%2F1.0%3B%20%2Bclaudebot%40anthropic.com)%22%2C%22user%22%3Anull%7D%2C%22domainName%22%3A%22r221.srp.dev.deepcrawl.com%22%2C%22deploymentId%22%3A%22cl6h2l%22%2C%22apiId%22%3A%22mmxpshpn0j%22%7D%2C%22isBase64Encoded%22%3Afalse%7D

x-apigateway-context

%7B%22callbackWaitsForEmptyEventLoop%22%3Atrue%2C%22functionVersion%22%3A%22%24LATEST%22%2C%22functionName%22%3A%22srp-seotestwebsite-221-requestHeadersfn221F98B058C-MBKLNEtp5NHm%22%2C%22memoryLimitInMB%22%3A%22128%22%2C%22logGroupName%22%3A%22%2Faws%2Flambda%2Fsrp-seotestwebsite-221-requestHeadersfn221F98B058C-MBKLNEtp5NHm%22%2C%22logStreamName%22%3A%222025%2F05%2F09%2F%5B%24LATEST%5Dac56fb4c69404f7bb56e500b8fe9a05b%22%2C%22invokedFunctionArn%22%3A%22arn%3Aaws%3Alambda%3Aus-east-1%3A059037012730%3Afunction%3Asrp-seotestwebsite-221-requestHeadersfn221F98B058C-MBKLNEtp5NHm%22%2C%22awsRequestId%22%3A%2236af9cd1-1fc8-417b-84d8-29562e88c560%22%7D

connection

close