how to prompt
#5
by g58892881 - opened
hello and thank you for these models!
what is the prompt format to get the (non-chat) models to translate english->german?
i've tried few-shot prompting, failed.
e.g. prompt:
English: The Sultan appoints judges, and can grant pardons and commute sentences.
German: Der Sultan ernennt Richter und kann Begnadigungen und Pendelstrafen gewähren.
English: Antisemitism in modern Ukraine Antisemitism and Special Relativity
German: Antisemitismus in der modernen Ukraine Antisemitismus und besondere Relativität
English: Morales continued his feud with Buddy Rose, defeating him by disqualification.
German: Morales setzte seine Fehde mit Buddy Rose fort und besiegte ihn durch Disqualifikation.
English: American Maury Tripp attended the Jamboree from Saratoga, California.
German: Der Amerikaner Maury Tripp besuchte das Jamboree aus Saratoga, Kalifornien.
English: He bowled a series of bouncers at Viv Richards at Brisbane and claimed 3/77 and 5/92 in the Third Test at Melbourne.
German: Er boomte eine Reihe von Bouncern bei Viv Richards in Brisbane und behauptete 3 / 77 und 5 / 92 im dritten Test in Melbourne.
English: The Frenchwoman's win irritated some of her male rivals.
German:
output:
...
English: The Frenchwoman's win irritated some of her male rivals.
German:
English: In 1860 he was elected to represent the City of Sydney in the New South Wales Legislative Assembly as an independent candidate.
German: Im Jahr 1860 wurde er zum Vertreter des
To be honest I haven't done too much prompt engineering for the base models. Similar few-shot prompts seem to function fine with the chat models after adjusting the generation parameters to for example temperature=0.2, top_p=1.0, which pushes the model to output most-likely tokens. I've found lower temperatures (0.1 - 0.5) to work best for translation. Maybe this change also helps with the base models?
On our 13b demo after changing the params as above, your example works fine:
😃: English: The Sultan appoints judges, and can grant pardons and commute sentences.
German: Der Sultan ernennt Richter und kann Begnadigungen und Pendelstrafen gewähren.
English: Antisemitism in modern Ukraine Antisemitism and Special Relativity
German: Antisemitismus in der modernen Ukraine Antisemitismus und besondere Relativität
English: Morales continued his feud with Buddy Rose, defeating him by disqualification.
German: Morales setzte seine Fehde mit Buddy Rose fort und besiegte ihn durch Disqualifikation.
English: American Maury Tripp attended the Jamboree from Saratoga, California.
German: Der Amerikaner Maury Tripp besuchte das Jamboree aus Saratoga, Kalifornien.
English: He bowled a series of bouncers at Viv Richards at Brisbane and claimed 3/77 and 5/92 in the Third Test at Melbourne.
German: Er boomte eine Reihe von Bouncern bei Viv Richards in Brisbane und behauptete 3 / 77 und 5 / 92 im dritten Test in Melbourne.
English: The Frenchwoman's win irritated some of her male rivals.
German:
🤖: Der Sieg der Französin hat einige ihrer männlichen Rivalen verärgert.
works. thank you!
g58892881 changed discussion status to closed