Eckerd Rapid Safety Feedback aggregate data

Todd Feathers filed this request with the Department of Jobs and Family Services of Ohio.
Status
Completed

Communications

From: Todd Feathers

To Whom It May Concern:

Pursuant to the Ohio Open Records Law, I hereby request the following records:

1) The predictive model report or comparable document explaining how the department's Eckerd Rapid Safety Feedback system (used from 2016 to 2017) calculated predicted risk scores. If not already included in the predictive model report or comparable document, I also ask for documentation of how the different variables the model considered were weighted, i.e. which variables had the most influence on predicted risk scores.

2) Predictive risk score data from the department's Eckerd Rapid Safety Feedback system showing the number of children assigned to each level of risk, broken down in aggregate by the following child characteristics, for 2016 and 2017.

- Race
- Gender
- Disability
- Race AND Gender
- Race AND Disability
- Gender AND Disability

Aggregate data responsive to this request might might take the form of: "In 2018 X number of White female children were assigned a High Risk score, Y number of White female children were assigned a Medium Risk score, and Z number of White female children were assigned a Low Risk score." Or, If the system assigns risk scores on a sliding scale, for example 0-100, please provide the average risk score broken down by the above-listed categories.

3) Annual aggregate data since 2015 on the number of substantiated child abuse/neglect cases, broken down by the following child characteristics:

- Race
- Gender
- Disability
- Race AND Gender
- Race AND Disability
- Gender AND Disability

Please note that I am requesting aggregate data, which is not personally identifiable and cannot be combined with other data sources to identify individuals.

Should you have any questions about this request, please don't hesitate to contact me for further clarification.

I ask that all fees be waived as I am a journalist and intend to use the requested records to publish articles in the public interest about the workings of government. In the event you choose to impose fees, I request a detailed breakdown of the fees, including the hourly wage of each employ involved and an explanation justifying the employee hours required to fulfill the request.

Should you choose to reject this request or redact portions of it, I ask that you provide a detailed breakdown of the statutory exemptions and associated case law underlying your decision to withhold each/any portions from public review.

I would prefer the request filled electronically, by e-mail attachment if available or CD-ROM if not.

Thank you in advance for your anticipated cooperation in this matter. I look forward to receiving your response to this request within 10 business days.

Sincerely,

Todd Feathers

From: Department of Jobs and Family Services

Good morning Mr. Feathers,

Please see the responses below in red.

This email fulfills your public records request. Please let us know if you have any additional questions.

Tom Betti
Office of Communications
Ohio Department of Job and Family Services
30 E. Broad St., 32nd Floor
Columbus, OH 43215
(614) 728-9645 (o)
(614) 817-2945 (c)
thomas.betti@jfs.ohio.gov<mailto:thomas.betti@jfs.ohio.gov>

[cid:image001.png@01D7A0A8.83963C50]
[cid:image002.png@01D7A0A8.83963C50]<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.facebook.com%2FOhioJFS&data=01%7C01%7Chayley.call%40jfs.ohio.gov%7C3a1babae7a5a427bc72008d401abb31a%7C50f8fcc494d84f0784eb36ed57c7c8a2%7C0&sdata=Gs1AH4uEBRAQOY2PJNhsBZ6q3IV0wEqg64%2F4yL17yZE%3D&reserved=0>[cid:image003.png@01D7A0A8.83963C50]<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2FOhioJFS&data=01%7C01%7Chayley.call%40jfs.ohio.gov%7C3a1babae7a5a427bc72008d401abb31a%7C50f8fcc494d84f0784eb36ed57c7c8a2%7C0&sdata=ZhxIOzbdx%2BL1qj1ylDTjJ0SjL%2Fj%2BmKeIzNss2uY5%2Bew%3D&reserved=0>[cid:image004.png@01D7A0A8.83963C50]<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.youtube.com%2Fuser%2FOhioJFS&data=01%7C01%7Chayley.call%40jfs.ohio.gov%7C3a1babae7a5a427bc72008d401abb31a%7C50f8fcc494d84f0784eb36ed57c7c8a2%7C0&sdata=YNvMgHRYr5i4oR94jr9KSGVxytVC0Kyo1zAqaew84GA%3D&reserved=0>[cid:image005.jpg@01D7A0A8.83963C50]<https://www.linkedin.com/company/ohiomeansjobs-omj>

From: requests@muckrock.com<mailto:requests@muckrock.com> <requests@muckrock.com<mailto:requests@muckrock.com>>
Sent: Thursday, July 15, 2021 1:47 PM
To: Terez, Angela <Angela.Terez@jfs.ohio.gov<mailto:Angela.Terez@jfs.ohio.gov>>
Subject: Ohio Open Records Law Request: Eckerd Rapid Safety Feedback aggregate data

Department of Jobs and Family Services
Ohio Open Records Law Office
32nd Floor
30 East Broad Street
Columbus, OH 43215-3414

July 15, 2021

To Whom It May Concern:

Pursuant to the Ohio Open Records Law, I hereby request the following records:

1) The predictive model report or comparable document explaining how the department's Eckerd Rapid Safety Feedback system (used from 2016 to 2017) calculated predicted risk scores. If not already included in the predictive model report or comparable document, I also ask for documentation of how the different variables the model considered were weighted, i.e. which variables had the most influence on predicted risk scores.

Eckerd's initial contract with Ohio was fully executed on 12/21/2016. Initial planning meetings for the project were held in January of 2017.

The first extract of Ohio's child welfare data was sent to the vendor on 3/6/2017.

The first ERSF/ASAP case was assigned in Ohio on 12/27/2017.

On 10/31/2018, the vendor was informed that Ohio would not be continuing with implementation of predictive analytics.

During the ten month period of time that predictive analytics was used race, ethnicity, gender, and child's disability were not variables used to flag cases. The accompanying spreadsheets show the variables used and their occurrence rates, as well as a dictionary to explain the variable terms used.

2) Predictive risk score data from the department's Eckerd Rapid Safety Feedback system showing the number of children assigned to each level of risk, broken down in aggregate by the following child characteristics, for 2016 and 2017.

- Race
- Gender
- Disability
- Race AND Gender
- Race AND Disability
- Gender AND Disability

Aggregate data responsive to this request might might take the form of: "In 2018 X number of White female children were assigned a High Risk score, Y number of White female children were assigned a Medium Risk score, and Z number of White female children were assigned a Low Risk score." Or, If the system assigns risk scores on a sliding scale, for example 0-100, please provide the average risk score broken down by the above-listed categories.

ODJFS does not have counts of children by the assigned level of risk.

3) Annual aggregate data since 2015 on the number of substantiated child abuse/neglect cases, broken down by the following child characteristics:

- Race
- Gender
- Disability
- Race AND Gender
- Race AND Disability
- Gender AND Disability

ODJFS does not have annual aggregate date on the number of substantiated child abuse/neglect cases broken down by the requested characteristics.

Please note that I am requesting aggregate data, which is not personally identifiable and cannot be combined with other data sources to identify individuals.

Should you have any questions about this request, please don't hesitate to contact me for further clarification.

I ask that all fees be waived as I am a journalist and intend to use the requested records to publish articles in the public interest about the workings of government. In the event you choose to impose fees, I request a detailed breakdown of the fees, including the hourly wage of each employ involved and an explanation justifying the employee hours required to fulfill the request.

Should you choose to reject this request or redact portions of it, I ask that you provide a detailed breakdown of the statutory exemptions and associated case law underlying your decision to withhold each/any portions from public review.

I would prefer the request filled electronically, by e-mail attachment if available or CD-ROM if not.

Thank you in advance for your anticipated cooperation in this matter. I look forward to receiving your response to this request within 10 business days.

Sincerely,

Todd Feathers

View request history, upload responsive documents, and report problems here:
https://www.muckrock.com/

Filed via MuckRock.com
E-mail (Preferred): requests@muckrock.com<mailto:requests@muckrock.com>

For mailed responses, please address (see note):
MuckRock News
DEPT MR 115942
411A Highland Ave
Somerville, MA 02144-2516

PLEASE NOTE: This request is not filed by a MuckRock staff member, but is being sent through MuckRock by the above in order to better track, share, and manage public records requests. Also note that improperly addressed (i.e., with the requester's name rather than "MuckRock News" and the department number) requests might be returned as undeliverable.

CAUTION: This is an external email and may not be safe. If the email looks suspicious, please do not click links or open attachments and forward the email to csc@ohio.gov <mailto:csc@ohio.gov> or click the Phish Alert Button if available.

This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain private, confidential, and/or privileged information. Any unauthorized review, use, disclosure, or distribution is prohibited. If you are not the intended recipient, employee, or agent responsible for delivering this message, please contact the sender by reply e-mail and destroy all copies of the original e-mail message.

From: Todd Feathers

Hello,

Thank you very much for your response, and my apology for the delay writing back—I was traveling.

In your message you mentioned accompanying spreadsheets that "show the variables used and their occurrence rates, as well as a dictionary to explain the variable terms used."

It doesn't look like those spreadsheets came through on my end. Would you mind resending them?

Really appreciate the help!
Todd

From: Department of Jobs and Family Services

1) The predictive model report or comparable document explaining how the department's Eckerd Rapid Safety Feedback system (used from 2016 to 2017) calculated predicted risk scores. If not already included in the predictive model report or comparable document, I also ask for documentation of how the different variables the model considered were weighted, i.e. which variables had the most influence on predicted risk scores.

Eckerd’s initial contract with Ohio was fully executed on 12/21/2016. Initial planning meetings for the project were held in January of 2017.

The first extract of Ohio’s child welfare data was sent to the vendor on 3/6/2017.

The first ERSF/ASAP case was assigned in Ohio on 12/27/2017.

On 10/31/2018, the vendor was informed that Ohio would not be continuing with implementation of predictive analytics.

During the ten month period of time that predictive analytics was used race, ethnicity, gender, and child’s disability were not variables used to flag cases. The accompanying spreadsheets show the variables used and their occurrence rates, as well as a dictionary to explain the variable terms used.

2) Predictive risk score data from the department's Eckerd Rapid Safety Feedback system showing the number of children assigned to each level of risk, broken down in aggregate by the following child characteristics, for 2016 and 2017.

- Race
- Gender
- Disability
- Race AND Gender
- Race AND Disability
- Gender AND Disability

Aggregate data responsive to this request might might take the form of: "In 2018 X number of White female children were assigned a High Risk score, Y number of White female children were assigned a Medium Risk score, and Z number of White female children were assigned a Low Risk score." Or, If the system assigns risk scores on a sliding scale, for example 0-100, please provide the average risk score broken down by the above-listed categories.

ODJFS does not have counts of children by the assigned level of risk.

3) Annual aggregate data since 2015 on the number of substantiated child abuse/neglect cases, broken down by the following child characteristics:

- Race
- Gender
- Disability
- Race AND Gender
- Race AND Disability
- Gender AND Disability

ODJFS does not have annual aggregate date on the number of substantiated child abuse/neglect cases broken down by the requested characteristics.

Tom Betti
Office of Communications
Ohio Department of Job and Family Services
30 E. Broad St., 32nd Floor
Columbus, OH 43215
(614) 728-9645 (o)
(614) 817-2945 (c)
thomas.betti@jfs.ohio.gov<mailto:thomas.betti@jfs.ohio.gov>

[cid:image001.png@01D7C97C.4B385670]
[cid:image002.png@01D7C97C.4B385670]<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.facebook.com%2FOhioJFS&data=01%7C01%7Chayley.call%40jfs.ohio.gov%7C3a1babae7a5a427bc72008d401abb31a%7C50f8fcc494d84f0784eb36ed57c7c8a2%7C0&sdata=Gs1AH4uEBRAQOY2PJNhsBZ6q3IV0wEqg64%2F4yL17yZE%3D&reserved=0>[cid:image003.png@01D7C97C.4B385670]<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2FOhioJFS&data=01%7C01%7Chayley.call%40jfs.ohio.gov%7C3a1babae7a5a427bc72008d401abb31a%7C50f8fcc494d84f0784eb36ed57c7c8a2%7C0&sdata=ZhxIOzbdx%2BL1qj1ylDTjJ0SjL%2Fj%2BmKeIzNss2uY5%2Bew%3D&reserved=0>[cid:image004.png@01D7C97C.4B385670]<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.youtube.com%2Fuser%2FOhioJFS&data=01%7C01%7Chayley.call%40jfs.ohio.gov%7C3a1babae7a5a427bc72008d401abb31a%7C50f8fcc494d84f0784eb36ed57c7c8a2%7C0&sdata=YNvMgHRYr5i4oR94jr9KSGVxytVC0Kyo1zAqaew84GA%3D&reserved=0>[cid:image005.jpg@01D7C97C.4B385670]<https://www.linkedin.com/company/ohiomeansjobs-omj>

Files