SourceFinch Verified · Building Permits

San Francisco Development Pipeline

Recent records from San Francisco Development Pipeline on data.sf.gov: up to 1,000 rows with stable identifiers for change monitoring. Contact columns are excluded.

Monitor this sourceAPI, CLI, SDK and MCP

What changedNo changes in 7 days

At a glance

Jurisdiction
data.sf.gov
Publisher updates
Updated by the publisher; typically daily or weekly
Recommended schedule
Daily for your monitor; SourceFinch verifies the recipe daily
Records per run
1,000 in the latest run
Record key
id
Acquired from
Open data portal: https://data.sf.gov/resource/6jgi-cpb4.json?$select=nameaddr,case_no,blklot,current_status,current_status_date,new_pipeline_units,existing_units,proposed_units,demo_units,net_pipeline_units,completed_new_units&$limit=1000&$where=current_status_date IS NOT NULL&$order=current_status_date DESC
Recipe
v1.0.0, approved November 17, 2026
Version notes
First Verified version generated 2026-11-17 from batch backlog.
Verified since
November 17, 2026
Last green run
November 17, 2026
Changes, last 7 days
0 · see what changed

What the data contains

Open data published on data.sf.gov as “San Francisco Development Pipeline”. Each daily run reads up to 1,000 rows through the portal's SODA API, naming only non-contact columns. A monitor reports new and changed rows inside the cohort. Leaving the cohort does not establish deletion. SourceFinch is independent of the publisher.

Fields and types

Every record has these fields. The key field id identifies a record across runs, so changes are reported field by field.

FieldTypeDescription
idkeystringPublisher field `nameaddr`. The record key.
case_nostring, nullablePublisher field `case_no`.
blklotstring, nullablePublisher field `blklot`.
current_statusstring, nullablePublisher field `current_status`.
current_status_datedatetime, nullablePublisher field `current_status_date`.
new_pipeline_unitsstring, nullablePublisher field `new_pipeline_units`.
existing_unitsstring, nullablePublisher field `existing_units`.
proposed_unitsstring, nullablePublisher field `proposed_units`.
demo_unitsstring, nullablePublisher field `demo_units`.
net_pipeline_unitsstring, nullablePublisher field `net_pipeline_units`.
completed_new_unitsstring, nullablePublisher field `completed_new_units`.

Sample output

The first 5 of 1,000 records from SourceFinch's own run on November 17, 2026, exactly as delivered.

FieldRecord 1Record 2Record 3Record 4Record 5
id2049-2055 9TH AVENUE3347 21ST ST332 GAMBIER ST360 Day St1374 46TH AVE
case_no2026-004981PRJ2026-006632PRJ2026-003814PRJ2025-011907PRJ2026-005788PRJ
blklot2129002A3617094596504366310161800010L
current_statusPL FiledPL FiledPL FiledPL ApprovedPL Filed
current_status_date2026-07-28T00:00:00.0002026-07-27T00:00:00.0002026-07-27T00:00:00.0002026-07-27T00:00:00.0002026-07-27T00:00:00.000
new_pipeline_units11111
existing_units21112
proposed_units32223
demo_units00000
net_pipeline_units11111
completed_new_units00000
Sample as JSON
[
  {
    "id": "2049-2055 9TH AVENUE",
    "blklot": "2129002A",
    "case_no": "2026-004981PRJ",
    "demo_units": "0",
    "current_status": "PL Filed",
    "existing_units": "2",
    "proposed_units": "3",
    "net_pipeline_units": "1",
    "new_pipeline_units": "1",
    "completed_new_units": "0",
    "current_status_date": "2026-07-28T00:00:00.000"
  },
  {
    "id": "3347 21ST ST",
    "blklot": "3617094",
    "case_no": "2026-006632PRJ",
    "demo_units": "0",
    "current_status": "PL Filed",
    "existing_units": "1",
    "proposed_units": "2",
    "net_pipeline_units": "1",
    "new_pipeline_units": "1",
    "completed_new_units": "0",
    "current_status_date": "2026-07-27T00:00:00.000"
  },
  {
    "id": "332 GAMBIER ST",
    "blklot": "5965043",
    "case_no": "2026-003814PRJ",
    "demo_units": "0",
    "current_status": "PL Filed",
    "existing_units": "1",
    "proposed_units": "2",
    "net_pipeline_units": "1",
    "new_pipeline_units": "1",
    "completed_new_units": "0",
    "current_status_date": "2026-07-27T00:00:00.000"
  },
  {
    "id": "360 Day St",
    "blklot": "6631016",
    "case_no": "2025-011907PRJ",
    "demo_units": "0",
    "current_status": "PL Approved",
    "existing_units": "1",
    "proposed_units": "2",
    "net_pipeline_units": "1",
    "new_pipeline_units": "1",
    "completed_new_units": "0",
    "current_status_date": "2026-07-27T00:00:00.000"
  },
  {
    "id": "1374 46TH AVE",
    "blklot": "1800010L",
    "case_no": "2026-005788PRJ",
    "demo_units": "0",
    "current_status": "PL Filed",
    "existing_units": "2",
    "proposed_units": "3",
    "net_pipeline_units": "1",
    "new_pipeline_units": "1",
    "completed_new_units": "0",
    "current_status_date": "2026-07-27T00:00:00.000"
  }
]

Evidence behind every value

  • Each run keeps the publisher's exact response, hashed with SHA-256. This sample came from a response with hash 3f9030182c6f0560f29ec8688fb1082c6c3612b6bd90ee5178d2a495642cfec3.
  • Every value records where it came from in that response: a JSON Pointer into the retained capture.
  • Each run gets a signed manifest (Ed25519) timestamped by an RFC 3161 authority: this run's manifest hash is dbee27496f0d0c2b4c7bb3f47f450f23e9137fbc0a8963d4a1bc5dd3c75ed730, timestamped November 17, 2026.
  • The compliance state at capture is recorded with the evidence: robots.txt hash and verdict, AI-preference signals, crawler identity and the usage rights below.
  • Download any run as an evidence bundle (WACZ) and check it offline, without trusting SourceFinch: sourcefinch verify-bundle run.wacz.

Terms posture and usage rights

Terms
Automated access permitted · publisher's terms
robots.txt
Allows this path · SHA-256 8cee1c5db0cf8d5b…
AI-preference signals
None observed at review
Public record
Yes. Municipal/state open data portal dataset 6jgi-cpb4 on data.sf.gov.
Reviewed
November 17, 2026; next review May 17, 2027
Licence basis
Publisher's terms of use
Commercial use
Allowed
Redistribution
Allowed
Attribution
Required (text below)

Published on the data.sf.gov open data portal for public use. Anonymous SODA API access needs no key. Portal robots.txt typically allows /resource/ with a crawl delay. Contact-name columns are not requested by this recipe.

Sf open data (data.sf.gov). SourceFinch is independent of the publisher.

Usage rights travel with every record SourceFinch delivers (API, exports, webhooks and evidence bundles). They are our documented understanding of the publisher's stated terms, not legal advice.

Reliability

Runs, last 30 days
1
Green
100%
Failed
0
Median run time
2.0 s
Latest run
success, November 17, 2026

Measured on completed runs of this recipe version across SourceFinch, anonymized, within a rolling 30-day window. First successful observation: November 17, 2026. A new recipe has only the history collected since that date; this is not a 30-day uptime guarantee.

Use it

Every surface creates the same monitor from this Verified recipe. Monitors keep record history, report field-level changes and deliver by webhook, export or email. You confirm you have the right to collect the source (rights: true).

Console

Open this recipe in the console: it preserves the reviewed URL, fields and record key. Review the latest captured sample, confirm source rights, and choose a schedule before creating your monitor.

Portable recipe

Copy into the console's Import or share a recipe panel to customize fields, types and schedules. This configuration contains no captured records or workspace IDs.

{
  "schema": "sourcefinch/source@1",
  "name": "San Francisco Development Pipeline",
  "url": "https://data.sf.gov/resource/6jgi-cpb4.json?$select=nameaddr,case_no,blklot,current_status,current_status_date,new_pipeline_units,existing_units,proposed_units,demo_units,net_pipeline_units,completed_new_units&$limit=1000&$where=current_status_date IS NOT NULL&$order=current_status_date DESC",
  "recipe": {
    "mode": "http",
    "format": "json",
    "items": "[*]",
    "fields": {
      "id": "nameaddr",
      "blklot": "blklot",
      "case_no": "case_no",
      "demo_units": "demo_units",
      "current_status": "current_status",
      "existing_units": "existing_units",
      "proposed_units": "proposed_units",
      "net_pipeline_units": "net_pipeline_units",
      "new_pipeline_units": "new_pipeline_units",
      "completed_new_units": "completed_new_units",
      "current_status_date": "current_status_date"
    },
    "required": [
      "id"
    ],
    "types": {
      "current_status_date": "datetime"
    }
  },
  "schedule": "daily",
  "key_field": "id"
}

source.json

The request body used by the API, CLI and SDK examples.

{
  "name": "San Francisco Development Pipeline",
  "url": "https://data.sf.gov/resource/6jgi-cpb4.json?$select=nameaddr,case_no,blklot,current_status,current_status_date,new_pipeline_units,existing_units,proposed_units,demo_units,net_pipeline_units,completed_new_units&$limit=1000&$where=current_status_date IS NOT NULL&$order=current_status_date DESC",
  "recipe": {
    "mode": "http",
    "format": "json",
    "items": "[*]",
    "fields": {
      "id": "nameaddr",
      "blklot": "blklot",
      "case_no": "case_no",
      "demo_units": "demo_units",
      "current_status": "current_status",
      "existing_units": "existing_units",
      "proposed_units": "proposed_units",
      "net_pipeline_units": "net_pipeline_units",
      "new_pipeline_units": "new_pipeline_units",
      "completed_new_units": "completed_new_units",
      "current_status_date": "current_status_date"
    },
    "required": [
      "id"
    ],
    "types": {
      "current_status_date": "datetime"
    }
  },
  "key_field": "id",
  "schedule": "daily",
  "rights": true,
  "catalog": {
    "slug": "sf-san-francisco-development-pipeline",
    "version_id": "ffc28411-1fbb-4996-9108-5ad22628f5ad"
  }
}

REST API

Create an API key under Console → API keys. Reference: /docs/api.

# the Verified entry (fields, recipe, sample, terms) as JSON
curl https://sourcefinch.com/v1/catalog/sf-san-francisco-development-pipeline -H "Authorization: Bearer $SOURCEFINCH_API_KEY"

# create the monitor from source.json (below)
curl -X POST https://sourcefinch.com/v1/sources \
  -H "Authorization: Bearer $SOURCEFINCH_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d @source.json

# then run it now (later runs follow the schedule)
curl -X POST https://sourcefinch.com/v1/sources/$SOURCE_ID/runs \
  -H "Authorization: Bearer $SOURCEFINCH_API_KEY" \
  -H "Idempotency-Key: $(uuidgen)"

CLI

The sourcefinch CLI is not on npm yet; see /docs/cli.

sourcefinch login
sourcefinch catalog get sf-san-francisco-development-pipeline --source-json > source.json
sourcefinch sources create --file source.json
sourcefinch runs create $SOURCE_ID --wait
sourcefinch records $SOURCE_ID

TypeScript SDK

The SDK is not on npm yet; see /docs/sdk.

import { SourceFinch } from "@sourcefinch/sdk";

const sf = new SourceFinch({ apiKey: process.env.SOURCEFINCH_API_KEY });
const entry = await sf.catalog.get("sf-san-francisco-development-pipeline");
const source = await sf.sources.create({
  catalog: { slug: entry.slug, version_id: entry.recipe.version_id },
  name: entry.name.slice(0, 100),
  url: entry.acquisition_path.endpoint,
  recipe: entry.recipe.definition,
  key_field: entry.recipe.key_field,
  schedule: entry.recipe.schedule,
  rights: true, // you confirm you have the right to collect this source
});
const run = await sf.runs.wait((await sf.runs.create(source.id)).id);
console.log(run.status);

MCP

Remote MCP server with OAuth; see /docs/mcp.

claude mcp add --transport http sourcefinch https://sourcefinch.com/mcp

# then ask your agent:
"Use SourceFinch to monitor San Francisco Development Pipeline: get_catalog_source sf-san-francisco-development-pipeline,
then create_source with its create_source_args (dry run first), then run_source."

Pricing

Each check is one run, whatever the number of records, and failed runs are free. On its default daily schedule this source uses about 30 runs a month, which fits the Free plan's 300 runs. It uses HTTP acquisition, so no browser runs are needed. See plans.

More from Sf open data and in building permits.

SourceFinch is independent and is not affiliated with or endorsed by Sf open data. This page describes san francisco development pipeline as SourceFinch acquires it.