HTTP 451 Hosts

The Censys aggregate query returns descriptive statistics on the total number of HTTP 451 responses alongside all other HTTP response codes. That query is useful for determining how many responses in general are being returned. However, my interest is also in the specific content that is actually returned to the user's browser (if any content is returned at all). To that end, I needed to query for more specific information from each host returning a HTTP 451 code.

To accomplish this, one of the scripts writes a text file with a list of IP addresses for the next script to query bulk information from. These IP addresses represent the hosts that meet 2 criteria:

1. Returning an HTTP response code of 451
2. Have something in the response body

On its own, this list doesn't really do much. It is primarily just the input data that the bulk query uses to retrieve the full HTTP response header and body from each host. The results of that bulk query are then parsed to provide just the HTTP responses. However, in the interests of open access scholarship I am providing these lists that are used as an interim data retrieval step for potential use in future research projects.

---