San Francisco Open Data - DataSF

Search hundreds of datasets from the City and County of San Francisco

Integrate the San Francisco Open Data - DataSF API with the Filter API

Setup the San Francisco Open Data - DataSF API trigger to run a workflow which integrates with the Filter API. Pipedream's integration platform allows you to integrate San Francisco Open Data - DataSF and Filter remarkably fast. Free for developers.

Continue execution if a condition Is met with the Filter API

Continue workflow execution only if a condition is met

 
Try it
End execution if a condition is met with the Filter API

End workflow execution if a condition is met

 
Try it

Overview of San Francisco Open Data - DataSF

The San Francisco Open Data - DataSF API unlocks a wealth of government data spanning multiple domains such as transportation, housing, and public health. It provides developers with access to rich datasets, which can be integrated into applications to derive insights, inform decision-making, and power data-driven solutions. Pipedream's serverless platform amplifies this potential by enabling users to create automated workflows that leverage this data in concert with other apps and services.

Connect San Francisco Open Data - DataSF

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    san_francisco_open_data_datasf: {
      type: "app",
      app: "san_francisco_open_data_datasf",
    }
  },
  async run({steps, $}) {
    // Below, we fetch a range of COVID-19 case data from DataSF. You can
    // run this to see how the results are displayed on Pipedream, or modify it 
    // in any way to fetch data from another dataset or modify the Socrata 
    // query. See the docs below for Socrata docs and examples.
    
    // COVID-19 Cases Summarized by Date, Transmission and Case Disposition
    // https://dev.socrata.com/foundry/data.sfgov.org/tvq9-ec9w
    
    return await axios($, {
      url: `https://data.sfgov.org/resource/tvq9-ec9w.json`,
      headers: {
        "X-App-Token": `${this.san_francisco_open_data_datasf.$auth.app_token}`,
      },
      params: {
        "$where": `date between '2020-05-18T00:00:00' and '2020-05-20T00:00:00'`,
      },
    })
  },
})

Overview of Filter

The Filter API in Pipedream allows for real-time data processing within workflows. It's designed to evaluate data against predefined conditions, enabling workflows to branch or perform specific actions based on those conditions. This API is instrumental in creating efficient, targeted automations that respond dynamically to diverse datasets. Using the Filter API, you can refine streams of data, ensuring that subsequent steps in your Pipedream workflow only execute when the data meets your specified criteria. This cuts down on unnecessary processing and facilitates the creation of more intelligent, context-aware systems.

Connect Filter

1
2
3
4
5
6
7
8
9
10
export default defineComponent({
  async run({ steps, $ }) {
    let condition = false
    if (condition == false) {
      $.flow.exit("Ending workflow early because the condition is false")
    } else {
        $.export("$summary", "Continuing workflow, since condition for ending was not met.")
    }
  },
})