Crawl ArcGIS servers and report all available services
If you have cargo installed, you can run cargo install arcgis-crawler and then run it from $HOME/.cargo/bin. More details on this are available in cargo-install documentation.
You can run the command against the /services path of ArcGIS server with JSON endpoints enabled
arcgis-crawler https://gisapps.cityofchicago.org/arcgis/rest/services/
https://gisapps.cityofchicago.org/arcgis/rest/services/
├─ 311
│ ├─ 311_layers
│ │ └─ MapServer
│ │ ├─ ALLEYNAM
│ │ ├─ ASPHALT_DISTRICTS
│ │ ├─ COMAREA
│ │ ├─ CONGRDIS
│ │ ├─ CPS_SAFE_PASSAGE_BUFFER
│ │ ├─ CircuitSegments
│ │ ├─ Circuit_Line
...