Agency predictive model documentation

Todd Feathers filed this request with the Human Services Agency of San Francisco, CA.

It is a clone of this request.

Submitted Dec. 9, 2021
Status
Completed

Communications

From: Todd Feathers

Subject: California Public Records Act Request: Agency predictive model documentation

Email

To Whom It May Concern:

Pursuant to the California Public Records Act, I hereby request the following records:

1) Contracts, memorandums of understanding, and statements of work between the department and any outside party regarding the SafeMeasures tool from Evident Change and any other predictive analytics tools currently used by the department (i.e., algorithmic report screeners, abuse or placement risk assessments, human trafficking risk assessments etc.).

2) Documentation of all child welfare decision-making algorithms and predictive models the department currently uses (including those used as aids to human decision making). This documentation should include, where available: executive summaries of the algorithm/model's purpose, lists of the data sources, breakdowns of how the model weights various input data, descriptions of the statistical or machine learning techniques employed, the results of validation and accuracy testing, disparate impact studies, and algorithmic impact reports.

3) A data dictionary/library for each predictive model or algorithm identified in response to items 1 and 2 of this requests.

4) Copies of any departmental or independent audits of the identified models or algorithms.

If you have any questions regarding this request, please don't hesitate to contact me for further clarification.

I ask that all fees be waived as I am a journalist and intend to use the requested records to publish articles in the public interest. In the event you choose to impose fees, I request a detailed breakdown of the fees, including the hourly wage of each employee involved and an explanation justifying the employee hours required to fulfill the request.

Should you choose to reject this request or redact portions of responsive documents, I ask that you provide a detailed breakdown of the statutory exemptions and associated case law underlying your decision to withhold each/any portions from public review.

In the event that there are fees, I would be grateful if you would inform me of the total charges in advance of fulfilling my request. I would prefer the request filled electronically, by e-mail attachment if available or CD-ROM if not.

Thank you in advance for your anticipated cooperation in this matter. I look forward to receiving your response to this request within 10 calendar days, as the statute requires.

Sincerely,

Todd Feathers

From: Human Services Agency

Subject: RE: California Public Records Act Request: Agency predictive model documentation

Email

Good Afternoon,

Pursuant to San Francisco Administrative Code Section 67.25(b) and the California Government Code Section 6253 (c), we are invoking an extension of up to 14 additional days to respond to this request due to the need to consult with another interested department.

We will respond to your request, no later than Monday, January 3, 2022.

Thank you,

Patrice Brown, S230
Investigations- HSA Sunshine & Privacy

O: (415) 503-4808
C: (415) 412-9970

Office Address:
1650 Mission Street- 5th Floor San Francisco, CA 94103
All Sunshine and Public Records Requests should be emailed to: HSASunshine@sfgov.org
www.SFHSA.org<http://www.sfhsa.org/>

[BFS]

[Facebook] <http://www.facebook.com/SFHumanServices> [Instagram] <http://www.instagram.com/SFHumanServices> [Twitter] <http://www.twitter.com/SFHumanServices> [LinkedIn] <https://www.linkedin.com/company/city-and-county-of-san-francisco---human-services-agency>

From: Human Services Agency

Subject: RE: California Public Records Act Request: Agency predictive model documentation

Email

Good Afternoon,

This is in response to your December 9, 2021 public records request.

In your request's Item 1, you ask for "Contracts, memorandums of understanding, and statements of work between the department and any outside party regarding the SafeMeasures tool from Evident Change and any other predictive analytics tools currently used by the department (i.e., algorithmic report screeners, abuse or placement risk assessments, human trafficking risk assessments etc.)." In response to your request's Item 1, we are providing contracts between the Human Services Agency and Evident Change (including under the organization's previous name) for the SafeMeasures tool. These contracts include statements of work. In addition, we are providing memoranda to the Human Services Commission regarding these contracts for the SafeMeasures tool.

In your request's Item 2, you ask for "Documentation of all child welfare decision-making algorithms and predictive models the department currently uses . . ." The Human Services Agency has identified no records of decision-making algorithms or predictive models the department currently uses.

In your request's Item 3, you ask for "A data dictionary/library for each predictive model or algorithm identified in response to items 1 and 2 of this requests." The Human Services Agency has identified no records of decision-making algorithms or predictive models.

In your request's Item 4, you ask for "Copies of any departmental or independent audits of the identified models or algorithms." The Human Services Agency has identified no records of decision-making algorithms or predictive models.

** Please note** Due to the file size, the responsive documents will be sent in 3 parts. This is Part 1.

Thank you,

Patrice Brown, S230
Investigations- HSA Sunshine & Privacy

O: (415) 503-4808
C: (415) 412-9970

Office Address:
1650 Mission Street- 5th Floor San Francisco, CA 94103
All Sunshine and Public Records Requests should be emailed to: HSASunshine@sfgov.org
www.SFHSA.org<http://www.sfhsa.org/>

[BFS]

[Facebook] <http://www.facebook.com/SFHumanServices> [Instagram] <http://www.instagram.com/SFHumanServices> [Twitter] <http://www.twitter.com/SFHumanServices> [LinkedIn] <https://www.linkedin.com/company/city-and-county-of-san-francisco---human-services-agency>

Warning An exclamation point.

There are too many files to display on this communication. See all files

From: Human Services Agency

Subject: RE: California Public Records Act Request: Agency predictive model documentation

Email

This is Part 2

Patrice Brown, S230
Investigations- HSA Sunshine & Privacy

O: (415) 503-4808
C: (415) 412-9970

Office Address:
1650 Mission Street- 5th Floor San Francisco, CA 94103
All Sunshine and Public Records Requests should be emailed to: HSASunshine@sfgov.org
www.SFHSA.org<http://www.sfhsa.org/>

[BFS]

[Facebook] <http://www.facebook.com/SFHumanServices> [Instagram] <http://www.instagram.com/SFHumanServices> [Twitter] <http://www.twitter.com/SFHumanServices> [LinkedIn] <https://www.linkedin.com/company/city-and-county-of-san-francisco---human-services-agency>

Warning An exclamation point.

There are too many files to display on this communication. See all files

From: Human Services Agency

Subject: RE: California Public Records Act Request: Agency predictive model documentation

Email

This is Part 3

Patrice Brown, S230
Investigations- HSA Sunshine & Privacy

O: (415) 503-4808
C: (415) 412-9970

Office Address:
1650 Mission Street- 5th Floor San Francisco, CA 94103
All Sunshine and Public Records Requests should be emailed to: HSASunshine@sfgov.org
www.SFHSA.org<http://www.sfhsa.org/>

[BFS]

[Facebook] <http://www.facebook.com/SFHumanServices> [Instagram] <http://www.instagram.com/SFHumanServices> [Twitter] <http://www.twitter.com/SFHumanServices> [LinkedIn] <https://www.linkedin.com/company/city-and-county-of-san-francisco---human-services-agency>

Warning An exclamation point.

There are too many files to display on this communication. See all files

Files