So, you need to collect data.
You may have seen this coming or you may have been voluntold to do this. In either case, it’s worth confirming what actually needs to be collected. In other words, separate the nice-to-have or interest-related data you want from the crucial data you need in order to make decisions.
As you begin this journey, know that you are not on your own. I’m not just talking about myself or this blog but rather about all the resources you have available for guidance.
I regularly fall back on this “CREATE” acrostic I made for method selection. And at least the first few points are a fitting place to start for crafting assessment questions, too.
The first point, consider your purpose, is a reminder to consider the mission, goals, and outcomes of your area in order to connect them with the data you plan to collect.
As a psychometric good practice, you should first identify what you are measuring before you determine the best way to measure it. So look to your area’s foundational documents or purpose to orient yourself before getting started.
Reviewing past efforts is an important step in crafting questions, too. Of the past data collected or instruments/methods used, were the results used? If not, the instrument must not have been collecting needed data. Perhaps it was intended to, so you could look there for inspiration in crafting your own questions.
However, an existing instrument won’t necessarily be appropriate for your needs nor will it absolutely be the best method to capture your data. If you’re collecting data for the first time, don’t despair! Remember the purpose of your assessment and begin thinking about what you need to measure.