Friday, June 12, 2009

Intercoder Reliability Woes

We spent a week coding 21 hours of video and the intercoder reliability on my part of the project was atrocious. The highest kappa among coders was .23, and several were negative, which means that they agreed less than could have been expected by chance. I don't know how that's even possible. Just guess and you could do better. I'm going to email the other person calculating reliability over the weekend and suggest a little more intercoder training next week. Perhaps asking people to look at each video twice. Grrrr. Not sure what to do if this part flops. I was kind of counting on it to work.

I officially finished the paperwork yesterday on a grant. Felt good to get it off my plate. My goal for the year was 3 grants, and I did it before the end of June. I've submitted 469K worth of grants this year. That's so tantalizingly close to half a million that I may submit one more before the end of the year.

Made good progress on a paper that's just about ready to send off. I asked my advisor if she could look over it, and I haven't heard from her. Her feedback is worth waiting for, so I'll probably wait until the end of the month or so. I really want this to go on this first try.

No comments: