Results of the Delphi survey rounds 1 and 2 (n=20)
| Items of the Delphi survey | Round 1 | Round 2 | ||||||
|---|---|---|---|---|---|---|---|---|
| Median* | Agreement | Convergence | Stability | Median* | Agreement | Convergence | Stability | |
| I. Items that can be administered by impromptu assessment | ||||||||
| - When prior observation of the child’s behaviors had been made | ||||||||
| 1. Score the child’s performance according to the number of executions† | 4.0 | 1.00 | 0.50 | 0.28 | 4.0ǁ | 0.25 | 0.13 | 0.12 |
| 2. Score the child’s performance according to their proficiency, regardless of the | 3.5 | 1.25 | 0.63 | 0.30 | 4.0 | 1.00 | 0.50 | 0.20 |
| - When prior observation of the child’s behaviors had not been made | ||||||||
| 3. Administer impromptu assessment and score the child’s performance according to the number of executions | 3.0 | 1.25 | 0.63 | 0.30 | 3.0 | 1.00 | 0.50 | 0.14 |
| 4. Administer impromptu assessment and score the child’s performance according to the number of trials prior to the first successful execution | 3.5 | 2.00 | 1.00 | 0.29 | 4.0 | 1.00 | 0.50 | 0.23 |
| 5. Administer impromptu assessment and score the child’s performance according to their proficiency regardless of the number of executions | 4.0 | 1.25 | 0.63 | 0.30 | 4.0ǁ | 1.00 | 0.50 | 0.13 |
| 6. Score the child’s performance according to different performance previously observed | 2.0 | 0.00 | 0.00 | 0.27 | 2.0 | 0.00 | 0.00 | 0.14 |
| 7. Score the child’s performance as 0 points | 2.0 | 1.25 | 0.63 | 0.55 | 2.0 | 1.00 | 0.50 | 0.29 |
| 8. Leave the items blank‡ | 2.0 | 2.00 | 1.00 | 0.57 | 4.0 | 1.00 | 0.50 | 0.14 |
| II. Items that cannot be administered by impromptu assessment | ||||||||
| - When prior observation of the child’s behaviors had been made | ||||||||
| 9. Appropriate length of time observing the child (days) | 7.0 | 7.00 | 3.50 | 0.64 | 7.0 | 7.00 | 3.50 | 0.35 |
| 10. Score the child’s performance according to the number of executions | 3.0 | 1.00 | 0.50 | 0.27 | 3.0 | 1.00 | 0.50 | 0.14 |
| 11. Score the child’s performance according to their proficiency, regardless of | 3.5 | 1.00 | 0.50 | 0.29 | 4.0 | 0.25 | 0.13 | 0.12 |
| - When prior observation of the child’s behaviors had not been made | ||||||||
| 12. Score by the assessment of a third party who frequently observes the child with the same standard | 3.5 | 1.00 | 0.50 | 0.26 | 4.0 | 1.00 | 0.50 | 0.14 |
| 13. Score the child’s performance according to different performance previously observed | 2.0 | 1.00 | 0.50 | 0.37 | 2.0 | 1.00 | 0.50 | 0.20 |
| 14. Score the child’s performance as 0 points | 2.0 | 2.00 | 1.00 | 0.52 | 2.0 | 0.25 | 0.13 | 0.28 |
| 15. Leave the items blank‡ | 2.0 | 2.00 | 1.00 | 0.52 | 3.0 | 1.00 | 0.50 | 0.17 |
| III. Items that present numbers in the performance criteria | ||||||||
| 16. Score the child’s performance when performed above the numeric standard as successful | 4.0 | 1.25 | 0.63 | 0.24 | 4.0 | 0.00 | 0.00 | 0.11 |
| 17. Score the child’s performance when performed near, but below, the numeric standard as successful | 3.0 | 1.00 | 0.50 | 0.32 | 3.0 | 0.25 | 0.13 | 0.16 |
| 18. Score the child’s performance according to their proficiency, regardless of meeting the numeric standard | 3.0 | 2.00 | 1.00 | 0.32 | 3.0 | 0.00 | 0.00 | 0.21 |
| IV. Items that cannot be administered due to absence of the task tools or absence of opportunities for safety concerns, or other reasons | ||||||||
| 19. Score the child’s performance using similar, but different, tools, based on subjective judgement | 3.0 | 2.00 | 1.00 | 0.32 | 3.0 | 1.00 | 0.50 | 0.21 |
| 20. Score the child’s performance according to different performance previously observed | 3.0 | 1.00 | 0.50 | 0.30 | 3.0 | 0.25 | 0.13 | 0.16 |
| 21. Score the child’s performance as 0 points | 2.0 | 1.25 | 0.63 | 0.55 | 2.0 | 1.00 | 0.50 | 0.33 |
| 22. Leave the items blank‡ | 2.0 | 1.50 | 0.75 | 0.57 | 3.5 | 1.00 | 0.50 | 0.20 |
| V. Items that are difficult to understand or are confusing | ||||||||
| 23. Assess in consultation with a physician§ | 4.0 | 1.25 | 0.63 | 0.22 | 3.5 | 1.00 | 0.50 | 0.20 |
| 24. Score the child’s performance when performed exactly the same as the item, regardless of understanding of its intention | 2.0 | 1.00 | 0.50 | 0.39 | 2.0 | 1.00 | 0.50 | 0.20 |
| 25. Score the child’s performance when performed similarly to the item, regardless of understanding of its intention | 3.0 | 2.00 | 1.00 | 0.37 | 3.0 | 1.00 | 0.50 | 0.24 |
| 26. Score the child’s performance as 0 points | 2.0 | 1.00 | 0.50 | 0.55 | 2.0 | 1.00 | 0.50 | 0.29 |
| 27. Leave the items blank‡ | 2.0 | 2.00 | 1.00 | 0.52 | - | - | - | - |
| VI. Others | ||||||||
| - Person who administered the test | ||||||||
| 28. Primary caregiver | 4.5 | 1.00 | 0.50 | 0.17 | 5.0 | 1.00 | 0.50 | 0.13 |
| 29. Others | 3.0 | 1.00 | 0.50 | 0.25 | 3.0 | 1.00 | 0.50 | 0.20 |
| - Place where the test was held | ||||||||
| 30. At home, prior to the appointment | 4.0 | 1.00 | 0.50 | 0.14 | 4.0 | 0.00 | 0.00 | 0.10 |
| 31. At other place, prior to the appointment | 3.0 | 1.00 | 0.50 | 0.29 | 3.0 | 1.00 | 0.50 | 0.16 |
| 32. At the clinic in the waiting room | 3.0 | 1.25 | 0.63 | 0.26 | 3.0 | 1.00 | 0.50 | 0.19 |
| - Time for test administration (min) | ||||||||
| 33. Appropriate length of time for test administration | 20.0 | 7.50 | 3.75 | 0.52 | 20.0 | 0.00 | 0.00 | 0.18 |