Los Angeles Police Department PredPol Documents

Algorithmic Transparency filed this request with the Los Angeles Police Department of Los Angeles, CA.
Tracking # 2017-REE-00640-F
Due Nov. 25, 2016
Est. Completion None
Status
Awaiting Response

Communications

From: Michael Morisy

To Whom It May Concern:

Pursuant to the California Public Records Act (California Government Code §§ 6250), I hereby request the following records:

This request is concerning the the software and algorithm used in the PredPol Predictive Policing Software. For reference and help retrieving responsive documents, this program was publicly discussed in the following news articles and press releases:

http://www.forbes.com/sites/ellenhuet/2015/02/11/predpol-predictive-policing/#21245fe6407f
http://newsroom.ucla.edu/releases/predictive-policing-substantially-reduces-crime-in-los-angeles-during-months-long-test

I am requesting the following records related to the above program:

* Any software and algorithms developed for the implementation of the program. I'm particularly interested in any algorithms that have a public policy outcome, such as providing guidance on a policy or an assessment of an individual. More generally, I would like any software that was developed by or with, given to, used by, purchased or licensed to this agency for implementation of the above referenced program. This would include original source code, any compiled binaries (also known as executables), spreadsheets, program scripts, and other digital materials used to calculate any data in the above program. It would also include the input training data for machine learning algorithms. Collectively, these responsive materials will be referred to as "the software" in the following paragraphs.

* All instructional materials, presentations and presentation materials (including recorded video and audio, PowerPoint files, prepared remarks, and slides formats), and other guidance on the use of "the software." This includes any notes taking during meetings that discussed the use of the software, any explanations (whether internally or externally generated) of how the software works, and any other document that has been used to help explain the use of "the software" to any party, including internal documentation, public relations materials, and executive summaries. This also includes any description of input and output data fields that will aid in understanding the type of information that is submitted to the software, and that is produced by the software.

* A copy of any privacy impact assessments, use policies, standard operating procedures, data retention policies, legal opinions, warranties, non-disclosure agreements, contracts, liability waivers, insurance agreements, Requests for Proposals, Responses to Requests for Proposal, Memorandums of Understanding, Letters of Interest, usage policies, or informal agreements that reference "the software" or otherwise guide it use or the relationship between this agency and the provider or developer of the software.

* A copy of any funding opportunity announcements, grant applications and grantor status/progress reports, reports to legislative bodies, annual reports that mention the use of the Software, as well as audit records, including but not limited to security audits of the software, misuse reports, and reports to oversight bodies.
* A copy of any validation studies conducted with respect to the program or with respect to any software or algorithms used in connection with the program, and a copy of any records pertaining to inquiries for the need of validation studies, or discussion of potential or actual validation studies. By “validation study,” I mean any study designed to assess how accurate the program is in predicting what it is supposed to predict, or to assess whether the program may err in the direction of either under- or overestimating likelihoods or predicted outcomes, or may produce any results that are biased or unexpected in any way.

* For the aspects of the software that require an input, for example, to compute a value, we request a copy of the five most recent sets of data that were used for input, as well as the five most recent outputs of the software, in whatever their native format is. If these inputs or outputs include exempt information, we ask that you exempt only that information which is specifically exempted from law, and provide the other material.

The requested documents will be made available to the general public, and this request is not being made for commercial purposes.

In the event that there are fees, I would be grateful if you would inform me of the total charges in advance of fulfilling my request. I would prefer the request filled electronically, by e-mail attachment if available or CD-ROM if not.

Thank you in advance for your anticipated cooperation in this matter. I look forward to receiving your response to this request within 10 calendar days, as the statute requires.

Sincerely,

Michael Morisy

From: DISCOVERY DISCOVERY

Your request has been received by the Discovery Section and will be assigned to a staff member for a response. If you have any questions, please call (213) 978-2100 for assistance.

Thank you.

Los Angeles Police Department
Legal Affairs Division
Discovery Section

>>> <requests@muckrock.com> 11/15/16 10:02 >>>

November 15, 2016
Los Angeles Police Department
LAPD, R&I Division
ATTN: Watch Commander
100 West 1st Street, Room P1-137
Los Angeles, CA 90012

To Whom It May Concern:

Pursuant to the California Public Records Act (California Government Code §§ 6250), I hereby request the following records:

This request is concerning the the software and algorithm used in the PredPol Predictive Policing Software. For reference and help retrieving responsive documents, this program was publicly discussed in the following news articles and press releases:

https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.forbes.com%2Fsites%2Fellenhuet%2F2015%2F02%2F11%2Fpredpol-predictive-policing%2F%2321245fe6407f&data=01%7C01%7Cdiscovery%40lapd.lacity.org%7Cc10039102ac044cbc09b08d40d819c3f%7C642fd61c34dd4fd0af8d443576485883%7C0&sdata=2F18XTwxJPLx%2Bnnv3kMuIIUsbOEiOeHK6Xq41AUIpUE%3D&reserved=0
https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fnewsroom.ucla.edu%2Freleases%2Fpredictive-policing-substantially-reduces-crime-in-los-angeles-during-months-long-test&data=01%7C01%7Cdiscovery%40lapd.lacity.org%7Cc10039102ac044cbc09b08d40d819c3f%7C642fd61c34dd4fd0af8d443576485883%7C0&sdata=8TnrAhuzuK4uVW8UVMf8%2BpTAs6a%2BJusxMrZQp1bfK9w%3D&reserved=0

I am requesting the following records related to the above program:

* Any software and algorithms developed for the implementation of the program. I'm particularly interested in any algorithms that have a public policy outcome, such as providing guidance on a policy or an assessment of an individual. More generally, I would like any software that was developed by or with, given to, used by, purchased or licensed to this agency for implementation of the above referenced program. This would include original source code, any compiled binaries (also known as executables), spreadsheets, program scripts, and other digital materials used to calculate any data in the above program. It would also include the input training data for machine learning algorithms. Collectively, these responsive materials will be referred to as "the software" in the following paragraphs.

* All instructional materials, presentations and presentation materials (including recorded video and audio, PowerPoint files, prepared remarks, and slides formats), and other guidance on the use of "the software." This includes any notes taking during meetings that discussed the use of the software, any explanations (whether internally or externally generated) of how the software works, and any other document that has been used to help explain the use of "the software" to any party, including internal documentation, public relations materials, and executive summaries. This also includes any description of input and output data fields that will aid in understanding the type of information that is submitted to the software, and that is produced by the software.

* A copy of any privacy impact assessments, use policies, standard operating procedures, data retention policies, legal opinions, warranties, non-disclosure agreements, contracts, liability waivers, insurance agreements, Requests for Proposals, Responses to Requests for Proposal, Memorandums of Understanding, Letters of Interest, usage policies, or informal agreements that reference "the software" or otherwise guide it use or the relationship between this agency and the provider or developer of the software.

* A copy of any funding opportunity announcements, grant applications and grantor status/progress reports, reports to legislative bodies, annual reports that mention the use of the Software, as well as audit records, including but not limited to security audits of the software, misuse reports, and reports to oversight bodies.
* A copy of any validation studies conducted with respect to the program or with respect to any software or algorithms used in connection with the program, and a copy of any records pertaining to inquiries for the need of validation studies, or discussion of potential or actual validation studies. By “validation study,” I mean any study designed to assess how accurate the program is in predicting what it is supposed to predict, or to assess whether the program may err in the direction of either under- or overestimating likelihoods or predicted outcomes, or may produce any results that are biased or unexpected in any way.

* For the aspects of the software that require an input, for example, to compute a value, we request a copy of the five most recent sets of data that were used for input, as well as the five most recent outputs of the software, in whatever their native format is. If these inputs or outputs include exempt information, we ask that you exempt only that information which is specifically exempted from law, and provide the other material.

The requested documents will be made available to the general public, and this request is not being made for commercial purposes.

In the event that there are fees, I would be grateful if you would inform me of the total charges in advance of fulfilling my request. I would prefer the request filled electronically, by e-mail attachment if available or CD-ROM if not.

Thank you in advance for your anticipated cooperation in this matter. I look forward to receiving your response to this request within 10 calendar days, as the statute requires.

Sincerely,

Michael Morisy

------
Filed via MuckRock.com
E-mail (Preferred): requests@muckrock.com

For mailed responses, please address (see note):
MuckRock
DEPT MR 30098
411A Highland Ave
Somerville, MA 02144-2516

PLEASE NOTE: This request is not filed by a MuckRock staff member, but is being sent through MuckRock by the above in order to better track, share, and manage public records requests. Also note that improperly addressed (i.e., with the requester's name rather than "MuckRock News" and the department number) requests might be returned as undeliverable.
------

From: Mary Taylor

Mr. Morisy:

This email is in response to your public records request. Please see the attachment.

Thank you.

Mary Taylor

Management Analyst II

Los Angeles Police Department

LAD - Discovery Section

Office: (213) 978-2112

Fax: (213) 978-2080

From: Michael Morisy

Dear LAPD, R&I Division:

This is in connection with our 11.15.16 Open Records law request. Thank you for your reply and the work you've done so far. We know that our request is pretty broad and perhaps we can helpfully narrow it. What we're really most interested in are any:
- contracts, proposals, RFPs, and letters of intent (not price information);
- training data;
- validity studies;
- correspondence, including emails and other correspondence (a) between the agency and vendor concerning development and implementation of the software and related processes, (b) within the agency concerning the efficacy, reliability, and accuracy of the software and related processes, and c) any other concerns related to the use of the software and related processes; and
- sample output.

All of the above relates to the PredPol Predictive Policing Software described in the second paragraph of our request and is to assist us in understanding the government policies concerning, and implementation of, this kind of policing. We will look forward to hearing from you.

Happy Holidays,
Ellen Goodman (working with Michael Morisy)

Files

pages

Close