Pipeline candidates
Refresh operations
A launch pipeline plan from source records.
This view converts the current CKAN datastore samples and selected ArcGIS layer pulls into proposed refresh candidates. Cadences are Stoa launch recommendations for City review, not claims about the City's current publishing schedule.
Base launch candidates
Daily cadence candidates
Rows/features represented
Refresh plan export
The generated CSV keeps source URLs, endpoint URLs, field counts, source record counts, proposed cadence, and the City-review note attached to each candidate.
Download refresh plan CSVLaunch stance
- Keep CKAN and ArcGIS as systems of record.
- Start with ten source-backed public-data pipelines in the base scope.
- Record timestamps, source URLs, and endpoint responses for every run.
- Confirm cadence and owner expectations with City staff before production scheduling.
Base included pipeline candidate
Illegal Dumping Locations
Daily candidate from CKAN datastore_search, with 205,139 source rows/features and 25 fields in the current pull.
https://data.sanjoseca.gov/api/3/action/datastore_search?resource_id=7f32d866-c22a-40c0-b4bb-bfa557cd0384&limit=5000Base included pipeline candidate
San Jose Fire Incidents
Daily candidate from CKAN datastore_search, with 95,838 source rows/features and 15 fields in the current pull.
https://data.sanjoseca.gov/api/3/action/datastore_search?resource_id=e465b97c-c209-412a-ba4d-cde03d655f44&limit=5000Base included pipeline candidate
311 Service Request Data
Daily candidate from CKAN datastore_search, with 88,756 source rows/features and 10 fields in the current pull.
https://data.sanjoseca.gov/api/3/action/datastore_search?resource_id=6399d341-880c-49eb-8cb6-5fb294bf48dc&limit=5000Base included pipeline candidate
Police-Calls-for-Service-Quarterly
Daily candidate from CKAN datastore_search, with 70,731 source rows/features and 15 fields in the current pull.
https://data.sanjoseca.gov/api/3/action/datastore_search?resource_id=0c2871c4-18fd-4b34-88e9-8d0a2164d479&limit=5000Base included pipeline candidate
Last 60-180 days Planning Permits
Daily candidate from CKAN datastore_search, with 465 source rows/features and 17 fields in the current pull.
https://data.sanjoseca.gov/api/3/action/datastore_search?resource_id=a6df12fb-ca4b-49e8-8cde-d444b112877b&limit=5000Base included pipeline candidate
Affordable Rental Housing
Weekly candidate from CKAN datastore_search, with 244 source rows/features and 37 fields in the current pull.
https://data.sanjoseca.gov/api/3/action/datastore_search?resource_id=20a977f9-0946-410b-9cb6-35535d242c05&limit=5000Refresh pipeline plan
Rows below are generated from real CKAN datastore and ArcGIS source pulls. The cadence field is a proposed launch operating setting that should be confirmed with each City source owner.
| Priority | Pipeline | Cadence | Rows/features | Source system |
|---|---|---|---|---|
| 1 | Illegal Dumping Locations | Daily candidate | 205,139 | CKAN datastore_search |
| 2 | San Jose Fire Incidents | Daily candidate | 95,838 | CKAN datastore_search |
| 3 | 311 Service Request Data | Daily candidate | 88,756 | CKAN datastore_search |
| 4 | Police-Calls-for-Service-Quarterly | Daily candidate | 70,731 | CKAN datastore_search |
| 5 | Last 60-180 days Planning Permits | Daily candidate | 465 | CKAN datastore_search |
| 6 | Affordable Rental Housing | Weekly candidate | 244 | CKAN datastore_search |
| 7 | Illegal Dumping | Daily candidate | 240,519 | ArcGIS REST query |
| 8 | Crash Locations Last Five Years | Weekly candidate | 24,334 | ArcGIS REST query |
| 9 | Road Closures | Daily candidate | 7,837 | ArcGIS REST query |
| 10 | Average Daily Traffic | Weekly candidate | 2,399 | ArcGIS REST query |
| 11 | City Owned Traffic Signals | Weekly candidate | 1,286 | ArcGIS REST query |
| 12 | Affordable Rental Housing | Weekly candidate | 251 | ArcGIS REST query |
| 13 | Police Stations | Daily candidate | 0 | ArcGIS REST query |
| 14 | Bike Racks | Weekly candidate | 1,066 | CKAN datastore_search |
| 15 | Street Trees | Weekly candidate | 345,489 | ArcGIS REST query |
| 16 | Pavement Projects Current | Weekly candidate | 1,098 | ArcGIS REST query |
| 17 | Heritage Trees | Weekly candidate | 110 | ArcGIS REST query |
| 18 | Downtown Parking Lots | Weekly candidate | 88 | ArcGIS REST query |