[Feature] SignWriting Textual Description

[AmitMY]

Problem

Understanding how to perform SignWriting exactly can be a little difficult to non-linguists.

Description

In addition to illustration (#114), we can include textual description of SignWriting.
In a zero-shot setting, we can describe where every symbol is placed, and it's name, and ask ChatGPT to describe it

Given the signs:

𝠃𝤘𝤣񁲡𝣳𝣩񈩧𝤉𝣻 
𝠃𝤘𝤧񃊫𝣻𝤕񃊢𝣴𝣼񆇡𝤎𝤂񋛕𝤆𝣦 񏌁𝣢𝤂

I would like to send them to ChatGPT as an image + as a rough textual description (hand 5 fingers, alternating arrows, and positions), and get "wave an open hand back and forth" or something similar

[AmitMY]

Repository to get this done https://github.com/sign-language-processing/signwriting-description

[AmitMY]

Implemented in 794c64c - does not perform well

[ashar02]

Hi, I saw the commit 794c64c it is uing the api /api/signwriting-description. But in cloud function no route is there for signwriting-description? Is there something that you will commit later on?

[AmitMY]

We are using this implementation - https://github.com/sign-language-processing/signwriting-description
Just deployed using python on a GCP instance, and routed in the project definition:

translate/firebase.json

Lines 95 to 96 in 91f1806

	"source": "/api/signwriting-description",
	"function": "signwriting_description"

[ashar02]

On sign.mt are you using GPT or naive for signwriting description?