Articles
Graduation keynote for YMCA Training Inc
I was asked to deliver a keynote address at the graduation of YMCA Training Inc’s 132nd cycle. The YMCA Training, Inc. program is an intensive 20-week, full-time computerized office skills training and employment program. Designed to replicate the expectations of a professional office environment, the training prepares participants with both the technical and job readiness skills to succeed. Here is what I said to the graduates.
Read More2 Things That Need To Be In Place Before You Can Build An Evaluation System
This post first appeared on the Greater Boston Evaluation Network site in 2018 A full evaluation program requires data systems and analytic capacity. Many organizations or programs feel like they’re not prepared to start building their internal evaluation capacity until they have developed logic models and databases. But there are only two elements that need…
Read MoreWhat can go wrong? Racial equity, dataviz, & deficit thinking
In 2019, Pieta published a blog post on data visualization that was consistent with targeted universalism. Jonathan Schwabish and Alice Feng at Urban Institute picked up on that post and cited it in their own “Do No Harm” guide. Eli found that work and was interested in applying it to his own design practice, developing…
Read MoreMeasuring quality, quantity, and results
One of the risks when developing an evaluation plan, is developing measures without being really clear about what kind of measure they are or how we’re going to use them to understand our program. In this post, I’m going to talk about process measures (AKA outputs) and outcome measures — how they are different from each other and how they are both useful in understanding a program.
When evaluating your programs, you may want to consider two kinds of measures: process measures and outcome measures. Process measures help you assess what you’re doing and how well you’re doing it, and they are evaluated while the program is in progress. Outcome measures evaluate the effect the program has/had on its target population (its impact), and they can be assessed during or after the program is complete.
Read MoreEvaluation FAQs
Managing your evaluation plans internally can be complicated. Trying to design the evaluation plan that best represents your work without disrupting the work is crucial and challenging. There are a few questions that clients have asked me over and over. Here, I address some of those frequently asked questions. Why is my funder asking for…
Read MoreMeasuring SES series: Income, need, and living wages
A couple of weeks ago, I wrote a post on socio-economic status (SES). SES is usually understood to be a combination of three things: income, education, and occupation. There are multiple reasons why we might ask such as establishing need, making sure that we are reaching the population that needs our services, or making sure…
Read MoreMeasuring socio-economic status
A couple of weeks ago, I wrote a blog post on gathering race and ethnicity data on a survey or form. One of my readers commented that socio-economic status (SES) was also important and related. A very good point. SES intersects with other social constructs such as race, ethnicity, gender, sexual orientation, gender identity, and…
Read MoreRace and ethnicity: Collecting demographic data in a survey
There are multiple reasons why you might want to collect race/ethnic data on a survey and each of those reasons will have different implications for what you ask and how. In this post, I will clarify the different purposes that might be served by asking about race/ethnicity and provide some suggestions for creating a question…
Read MoreKPIs are for driving performance: Four questions to ask about your program’s KPI
To evaluate performance, most organizations select one or two KPI(s) — Key Performance Indicator(s) —to focus on. A KPI is the outcome measure that your organization is most focused on. But once you’ve selected your KPI(s), what’s next?
Read MoreSelecting a Key Performance Indicator
Author’s note: this post borrows from the Results-Based Accountability Framework as well as Trying Hard is Not Good Enough by Mark Friedman.
Read More