Open-Instruct Human Evaluation

🕵 Human Evaluation

{% if current_user.is_authenticated %} You are logged in as {{ current_user.username }}. [Log out] {% else %} You need to log in to submit evaluation. [Log in] {% endif %}

Instance {{ index }}

Loading instance.

Here are responses from two AI models.

Loading model outputs ...

Now please evaluate the two outputs based on your knowledge, preference, and any external tools (e.g., Google Search or Translate).

Q1: Is output A an acceptable response? An acceptable response should ① answer the user requests ② have no significant errors ③ have no meaningless text (e.g., repetition).

Yes

Q2: Is output B an acceptable response? An acceptable response should ① answer the user requests ② have no significant errors ③ have no meaningless text (e.g., repetition).

Yes

Q3: Please choose the response that you prefer (based on helpfulness).

A is clearly better A is slightly better Tie B is slightly better B is clearly better