Simplify Listaflow to Improve Engagement
Topic
Indicate which topic your proposal falls under:
Overview
Simplify the survey and shift the burden of validating commitments to the CC Program Admins as a part of the annual commitment renewal process.
Solution
Make the survey optional.
Reduce notifications down to once per cycle. Make them “unsubscribable”. Avoid @here.
Pare down the survey to just 3 questions.
The questions:
How are you feeling? (smiley ranking scale)
What/who are you proud of? Is there work you would like to celebrate?
Is there anything you are stuck on, seeking help on, or seeking input on?
Shift the burden of validating commitments to the CC Program Admins
They will do this as a part of the annual reaffirming of commitment per the most recent update to OEP-54
Impact
By splitting the engagement, and collaboration problem from the validation of people fulfilling their commitments, we can help improve CC engagement. The simplified survey should make it easier to share information about work and seek help.
As a part of the CC Program, Axim already has to reaffirm organizational and user commitments. Evaluating the level of commitment of a user as a part of this work is a natural extension.
Timeline
The Listaflow survey could be updated immediately.
CC Evaluation can happen as a part of the next reaffirming of commitment happening in January 2025
Comments
I’m curious about how making the survey optional might affect engagement. Do you think we’ll still get the same quality of feedback?
I think the folks who are filling it out will continue to fill it out, and I think for those who aren’t doing it we’ll reduce noise and perhaps over time entice them to fill it out occasionally. I don’t think it would significantly hurt engagement.
Reducing notifications sounds great, but what’s the plan for making sure people don’t miss important updates? How often are you thinking of sending them out?
I think for those people that want to fill out the survey, they should be able to opt-in to one notification. If it’s easy it would also be useful to let each user choose their own notification cadence.
I like the idea of the three questions! What led you to choose those specifically? Do you think they capture everything we need to know?
This came through some team brain-storming but I think the goal was to help with community cohesion without asking too many question so a general sentiment check, a place to praise/share, and a place to ask for help seemed like a good minimal set of questions.
How do you envision measuring the success of these changes? Any specific metrics or ways to gather feedback in mind? Right now we show how many CCs completed the form but I really don’t think this metric is of interest to people.
My hope would be that this would increase engagement on the survey and so I don’t think that’s an unreasonable easy to measure metric but we could do a qualitative survey 6-months in to see what people are thinking about it. We should also make sure to do some big announcements when we make the changes as it will help people go back to the survey if they haven’t already.
Would you suggest combining the “Core Contributor Check-in” and “Contributors Meetup Async Update” (less notifications that way!)?
Maybe, aren’t they temporaly separate since the async update aggregates data from the check-in? I think it would be useful to link to the previous async update post in the current reminder to make sure people are going to both.
Would you still report on the form information on the forum?
I thought this was the async contributors meetup update, is there a third thing that I’m missing? I think an aggregate report of the check-ins is still useful since we want people to ask for help in the survey and we want to make sure people know where to look to give help.
@Feanil Patel Thanks for the proposal!
I’m curious about how making the survey optional might affect engagement. Do you think we’ll still get the same quality of feedback?
I think the folks who are filling it out will continue to fill it out, and I think for those who aren’t doing it we’ll reduce noise and perhaps over time entice them to fill it out occasionally. I don’t think it would significantly hurt engagement.
Do we have information about this? How many do not fill out the survey? How many always fill it out? Maybe we need to do a poll to have this information and be able to make a better decision about this matter.
Pare down the survey to just 3 questions.
I like your questions . Will all of them be mandatory to submit the form? or will they be optional?
Do we have information about this? How many do not fill out the survey? How many always fill it out? Maybe we need to do a poll to have this information and be able to make a better decision about this matter.
The survey report has this info already: https://docs.google.com/document/d/1qbbxe4rzA2-z11Sa7zxcsdX19op6r5xPPg2aPoD_xd4/edit?tab=t.0 and I think we can re-evaluate in the future to see if these changes help or not.
I like your questions . Will all of them be mandatory to submit the form? or will they be optional?
I would expect all 3 questions to be optional.
Maybe, aren’t they temporaly separate since the async update aggregates data from the check-in? I think it would be useful to link to the previous async update post in the current reminder to make sure people are going to both.
@Feanil Patel Maybe we need to rope in @Natalia Chocontá A to find out how the Contributors Meetup Async Update is put together? I put together the Core Contributor Check in based on the Listaflow results at the end of every sprint.
@Feanil Patel As I still do the Listaflow report it will save me time sifting thorugh the information if we change the questions now. How about:
How did you feel overall during the last sprint? OR Which best describes your experience during the last sprint?
In terms of the ranking I know you mentioned using “smiley” faces, but we have the below readily available and this is what we do for OpenCraft:
We could simplify it to 1 - 5 and perhaps just have a 3-word scale:
Great
Okay
Challenging
What’s something you’re proud of from this sprint?
Is there any work, achievement, or person you'd like to celebrate?Are you facing any challenges?
Do you need help or input on anything specific?
Let me know what you think…
cc. @Fox Piacenti (Unlicensed)
I think that a 5-point scale is good, 3 is not granular enough but 10 seems like too much.
Yes, I think you could take the question directly, “What/who are you proud of? Is there work you would like to celebrate?” Very open ended but should hopefully give us some insight into what good stuff is going on.
I think again, take the question as is”Is there anything you are stuck on, seeking help on, or seeking input on?” Facing challenges doesn’t indicate that you can ask for help here so you might not get as much out of a person.
@Feanil Patel Thanks for this proposal! I have a few questions…
I’m curious about how making the survey optional might affect engagement. Do you think we’ll still get the same quality of feedback?
Reducing notifications sounds great, but what’s the plan for making sure people don’t miss important updates? How often are you thinking of sending them out?
I like the idea of the three questions! What led you to choose those specifically? Do you think they capture everything we need to know?
How do you envision measuring the success of these changes? Any specific metrics or ways to gather feedback in mind? Right now we show how many CCs completed the form but I really don’t think this metric is of interest to people.
Would you suggest combining the “Core Contributor Check-in” and “Contributors Meetup Async Update” (less notifications that way!)?
Would you still report on the form information on the forum?