<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Do you already have a good set of evaluators and judges, and you're mainly looking for advice on metrics? Or are you also looking to get more people / orgs involved in the evaluation process?</div>
</div></blockquote><div><br></div><div>No, we don't have set of evaluators/judges. It's pretty early stages and the point of the July workshop is discuss and hear proposals for how to evaluate for the prize. We are certainly open to have more people and organizations involved.</div>
<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>I guess I'd encourage a larger / diverse judging panel so that you're tapping different perspectives, and also to increase the contest's prestige and objectivity.</div>
</div></blockquote><div><br></div><div>I agree. My goal is that anybody who is interested can be involved in the evaluation process in some way. If this is a very large group of people I'll consider that a good problem.</div>
<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>I also think you might consider multiple prizes, since there are different categories of apps, and having more winners means the benefits of this process get spread more widely.</div>
</div></blockquote><div><br></div><div>Yes, this has come up. Multiple awards is certainly a possibility, others have suggested limiting the scope to just phone applications since this seems like the use case people are most interested in, others have suggested that solutions which have compatible implementations on multiple platforms should get bonus points.</div>
<div><br></div><div>Overall I'd stress that there is still a lot of flexibility to shape this based on what the community thinks is most important to evaluate.</div><div><br></div></div></div></div>