Spider: Detroit Historic District Commission
See original GitHub issueURL: https://detroitmi.gov/Calendar-and-Events
Spider Name: det_historic_district
Agency Name: Detroit Historic District Commission
See the contribution guide for information on how to get started
This scraper is part of the general Detroit website which does a good job standardizing meeting information so most of the work is done for you in DetCityMixin
.
To pull most of the information for a general detroitmi.gov scraper, you need to go to the events page, filter for the agency in the Government select field, and then get the ID that shows up next to term_node_tid_depth_1=
on the results page URL.
Then, to pull any related documents, go the the documents page, look for relevant document categories in the Government autocomplete field, filter for them, and then pull the ID from the parameter in the results page URL that follows field_department_target_id_1
. On initial filter, it will pull in a label too (ex. for the City Planning Commission it shows City+Planning+Commission+Minutes+(3761)
) but you only need the number in parentheses.
Once you’ve included that information, you can override methods like _parse_title
if the defaults aren’t right, and you’ll still need to implement _parse_classification
. See det_city_planning
or det_zoning_appeals
for some examples
Issue Analytics
- State:
- Created 5 years ago
- Comments:6 (3 by maintainers)
Top GitHub Comments
The only documents that get associated to meetings with the current Detroit setup are ones with dates corresponding to meetings in the title, so I think we should be good for now, but thanks for taking a closer look at that @cascio
Currently working on this one, should have a PR up soon!