Skip to content

DistilBERT / GPT-2 for on-device inference thanks to TensorFlow Lite with Android demo apps

License

Notifications You must be signed in to change notification settings

huggingface/tflite-android-transformers

Repository files navigation

TensorFlow Lite Transformers w/ Android demos

Convert Transformers models imported from the 🤗 Transformers library and use them on Android. You can also check out our swift-coreml-transformers repo if you're looking for Transformers on iOS.

Demo of the DistilBERT model (97% of BERT’s performance on GLUE) fine-tuned for Question answering on the SQuAD dataset. It provides 48 passages from the dataset for users to choose from.

demo gif

On-device text generation using GPT-2 or DistilGPT2 (same distillation process than DistilBERT, 2x faster and 33% smaller than GPT-2)

demo gif


Models generation

Example scripts used to convert the models are available in the models_generation directory. Please note that they require the nightly version of TensorFlow and might thus be unstable.

License

Apache License 2.0

About

DistilBERT / GPT-2 for on-device inference thanks to TensorFlow Lite with Android demo apps

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published