PyLessons August 01, 2023 Introduction to Transformers Introduction to Transformers Architecture covering main components, advantages, disadvantages, limitations, etc. In this part, we'll cover the PositionalEmbedding layer
PyLessons August 07, 2023 Attention layers in Transformer In this tutorial, we'll walk through the attention mechanism and the core components of the transformer to build encoder-decoder architecture
PyLessons August 16, 2023 Building a Transformer model with Encoder and Decoder layers In this tutorial, we continue implementing the complete Transformer model in TensorFlow. To achieve this, we implement Encoder and Decoder step-by-step
PyLessons August 22, 2023 Prepare data to train NLP Transformer Preparing Data for Effective Transformer Training: From Raw Text Selection and Download to Crafting Custom Tokenizers and Establishing Efficient Data Pipelines
PyLessons September 04, 2023 Training TensorFlow Transformer model for Spanish to English translation task In this tutorial, I'll walk through a practical example of Transformer Training for Language Translation tasks from Spanish to the English language
PyLessons September 18, 2023 Testing a Custom Transformer Model for Language Translation with TensorFlow In this tutorial, we'll be testing our trained Transformer model from scratch for Spanish to English translation. We'll use the onnx model that was exported after training.