Trying to figure out what KPI's I can use to measure how a organization benefits from human intervention versus automating a process

Hello Rosalind,
 
I would ask 3 questions in this case:

1. What are humans doing differently in the process
2. How what they are doing is aligned with company’s strategy
3. What automated process cannot possible do

Try to draw a Venn diagram to see where there might be a benefit. This is a starting point to search for KPIs. And fore sure, to design your strategy map and KPIs, give BSC Designer a try.