Transformers Agent: Natural Language API on Top of Transformers

HuggingFace just released their Transformers Agent library. You can now provide a text description of a task—e.g. “Draw me a picture of the sea then transform the picture to add an island”—and a LLM will turn that into calls to Hugging Face models which will then be installed and used to carry out the instructions. The Colab notebook is worth playing with—you paste in an OpenAI API key and a Hugging Face token and it can then run through all sorts of examples, which tap into tools that include image generation, image modification, summarization, audio generation and more.

Transformers Agent

We’re on a journey to advance and democratize artificial intelligence through open source and open science.