Skip to content

Releases: keras-team/keras-hub

v0.7.0

05 Jan 22:29
@mattdangerw mattdangerw
v0.7.0
ce93ca8
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
v0.7.0

This release integrates KerasNLP and Kaggle Models. KerasNLP models will now work in Kaggle offline notebooks and all assets will quickly attach to a notebook rather than needing a slow download.

Summary

KerasNLP pre-trained models are now all made available through Kaggle Models. You can see all models currently available in both KerasCV and KerasNLP here. Individual model pages will include example usage and a file browser to examine all available assets for a model preset.

This change will not affect the existing usage of from_preset(). Statement like keras_nlp.models.BertClassifier.from_preset("bert_base_en") will continue to work and download checkpoints from the Kaggle Models hub.

A note on model saving—for saving support across Keras 2 and Keras 3, we recommend using the new Keras saved model format. You can use model.save('path/to/location.keras') for a full model and model.save_weights('path/to/location.weights.h5') for checkpoints. See the Keras saving guide for more details.

What's Changed

New Contributors

Full Changelog: v0.6.4...v0.7.0

Contributors

Philmod, mattdangerw, and 11 other contributors
Loading
0 Join discussion

v0.6.4

07 Dec 22:58
@mattdangerw mattdangerw
v0.6.4
fb8e861
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
v0.6.4

Summary

This point release simplifies our support for Keras 3 and Keras 2.

  • If Keras 2 is installed, KerasNLP will use Keras 2 and TensorFlow.
  • If Keras 3 is installed, KerasNLP will use Keras 3 and run on any backend.

If you have any issue installing KerasNLP, please open an issue.

What's Changed

Full Changelog: v0.6.3...v0.6.4

Contributors

mattdangerw
Loading

v0.6.3

07 Nov 23:34
@mattdangerw mattdangerw
v0.6.3
3915eec
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
v0.6.3

Summary

This release adds support for running KerasNLP against Keras 3. You can try this today by installing tf-nightly and tensorflow-text-nightly.

pip install keras-nlp
pip uninstall -y tensorflow-text tensorflow keras
pip install tensorflow-text-nightly tf-nightly

Otherwise, this release should be a no-op for all users. No new features, no change in default behavior.

Upcoming changes

After the release of Keras 3, we will drop support for running KerasNLP against the Keras Core package (no more import keras_core as keras), in favor of Keras 3. Keras 3 is the long-term replacement for Keras Core.

What's Changed

Full Changelog: v0.6.2...v0.6.3

Contributors

mattdangerw
Loading

v0.6.2

21 Sep 19:42
@mattdangerw mattdangerw
v0.6.2
2b02bff

Choose a tag to compare

View all tags
v0.6.2

Summary

  • Support mixed precision on keras-core on all of jax, torch and tensorflow.
  • Add keras_nlp.layers.RotaryEmbedding for rotary embeddings.
  • Add keras_nlp.layers.ReversibleEmbedding to better support tied or untied weights for logit projections.
  • Many bug fixes and improvements.

What's Changed

New Contributors

Full Changelog: v0.6.1...v0.6.2

Contributors

jackd, mattdangerw, and 5 other contributors
Loading

v0.6.1

31 Jul 23:54
@mattdangerw mattdangerw
v0.6.1
d9e1899

Choose a tag to compare

View all tags
v0.6.1

With the 0.6.1. release, all remaining models, metrics and samplers have been ported to keras-core. The full KerasNLP API is now available on TensorFlow, PyTorch and Jax (instructions).

Summary

  • FNet and DeBERTa are now multi-backend.
    • All keras_nlp.models.FNetXX and keras_nlp.models.DebertaV3XX symbols work on all backends.
  • keras_nlp.samplers.BeamSampler and keras_nlp.samplers.ContrastiveSampler work on all backends.
  • All keras_nlp.metrics classes work on all backends.
    • For Jax and PyTroch, pass python strings to metrics (as tensor strings are strictly tensorflow).
  • Restored the mask_positions named argument to MaskedLMHead.

What's Changed

New Contributors

Full Changelog: v0.6.0...v0.6.1

Contributors

jbischof, mattdangerw, and 3 other contributors
Loading

v0.6.0

11 Jul 04:20
@mattdangerw mattdangerw
v0.6.0
de9a325
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
v0.6.0

KerasNLP is adding experimental support for Jax and PyTorch backends on top of the Keras Core library. Read the anouncement, and browse the full library documentation, including how to specify the backend when running your code.

Support for both Jax and PyTorch is still experimental, expect some rough edges and please give us feedback!

Summary

  • This release should be equivalent to 0.5.2 with the addition of multi-backend support.
  • The following API symbols are currently restricted to the tensorflow backend:
    • keras_nlp.models.DebertaV3*
    • keras_nlp.models.FNet*
    • keras_nlp.metrics
    • keras_nlp.samplers.BeamSampler
    • keras_nlp.samplers.ContrastiveSampler
  • Note that there are two ways you can run on top of Tensorflow.
    • If you run your scripts/colab without any changes, KerasNLP will use tf.keras for all layer and modeling implementations. This should be a no-op from previous releases of the library.
    • If you run your scripts/colab with KERAS_BACKEND={jax, torch, tensorflow}, you will be trying the new Keras Core library, using the specified backend. This is a great way to test out the future of the library!
    • Full details on runtime specification is available along with the Keras Core documentation.

What's Changed

New Contributors

Full Changelog: v0.5.2...v0.6.0

Contributors

SamuelMarks, mattdangerw, and 5 other contributors
Loading
0 Join discussion

v0.5.2

11 May 22:30
@chenmoneygithub chenmoneygithub
v0.5.2
cdce198

Choose a tag to compare

View all tags
v0.5.2

What's Changed

Full Changelog: v0.5.1...v0.5.2

Contributors

mattdangerw
Loading

v0.5.1

05 May 21:56
@chenmoneygithub chenmoneygithub
v0.5.1
4fad44a

Choose a tag to compare

View all tags
v0.5.1

What's Changed

Full Changelog: v0.5.0...v0.5.1

Contributors

chenmoneygithub
Loading

v0.5.0

05 May 20:36
@chenmoneygithub chenmoneygithub
v0.5.0
e69e1ee

Choose a tag to compare

View all tags
v0.5.0

In this 0.5 release, we are bringing generative AI to KerasNLP!

Summary

  • Added text generation task model keras_nlp.models.GPT2CausalLM and keras_nlp.models.OPTCausalLM along with corresponding preprocessors. Both task models exposed a public generate() method for text generation.
  • Refactored text generation utils into sampler APIs in keras_nlp.samplers for better UX and scalability.
  • Added MaskedLM task models keras_nlp.models.XXXMaskedLM, e.g., keras_nlp.models.BertMaskedLM.

What's Changed

Read more

Contributors

fchollet, jbischof, and 23 other contributors
Loading

v0.4.1

24 Feb 21:23
@mattdangerw mattdangerw
v0.4.1
eb320e3
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
v0.4.1

The 0.4.1 release is a minor release with new model architectures and compilation defaults for task models. If you encounter any problems or have questions, please open an issue!

Summary

  • Added compilation defaults for all task models (e.g. keras_nlp.models.BertClassifier). No existing functionality is changed, but users of task models can now skip calling .compile() and use default learning rates and optimization strategies provided by the library.
  • Added keras_nlp.models.AlbertBackbone, keras_nlp.models.AlbertClassifier, preprocessor, and tokenizer layers for pre-trained ALBERT models.
  • Added keras_nlp.models.FNetBackbone, keras_nlp.models.FNetClassifier, preprocessor, and tokenizer layers for pre-trained FNet models.
  • Added keras_nlp.models.DebertaV3Backbone, keras_nlp.models.DebertaV3Classifier, preprocessor, and tokenizer layers for pre-trained DeBERTaV3 models.

What's Changed

New Contributors

Read more

Contributors

jbischof, mattdangerw, and 14 other contributors
Loading
2 Join discussion