Found via `codespell -S .mypy_cache,yarn.lock,*.json,*.ipynb -L
rouge,nam,vie`
This commit is contained in:
Kian-Meng Ang
2023-02-05 20:18:03 +01:00
committed by GitHub
parent 364a4f5aa3
commit 1e321a6fca
32 changed files with 50 additions and 50 deletions
+1 -1
View File
@@ -182,7 +182,7 @@ message GenerationExample {
class RankingExample:
thread: Thread # The conversation thread before the message to be ranked
messages: list[Message] # The messages to be ranked, in oder of decreasing preference
messages: list[Message] # The messages to be ranked, in order of decreasing preference
```
+5 -5
View File
@@ -14,16 +14,16 @@ help.
There are two large-scale projects in the area of instruction-following /
multitask learning: Promptsource and Natural Instructions - these projects
crowdsourced templates and turned existing NLP datasets into
instruction-following seq2seq form in natural langauge. They include both
instruction-following seq2seq form in natural language. They include both
long-output training examples like generating a sentence that is a likely
consequence of sentence in the prompt, and short-output, like rating prediction
from review. (Pre-)training on such datasets should help model understand and
follow instructions and teach it many abilities neccessary to perform a large
set of tasks correctly. However, these data are not dialog-like - they do not
look like a normal conversation.
follow instructions and teach it many abilities necessary to perform a large set
of tasks correctly. However, these data are not dialog-like - they do not look
like a normal conversation.
There are also supervised dialog datasets such as Blended Skill Talk or SODA. In
constrast to instruction-following datasets, dialog data is not as focused on
contrast to instruction-following datasets, dialog data is not as focused on
"academic tasks" or correctness, but encourage the model to respond naturally
like a person would.