ashishpatel26

Professional software vendor delivering innovative solutions on the Softono platform. Specialized in both open-source and proprietary software development.

Visit Website

Total Products

Software by ashishpatel26

Open Source

Andrew-NG-Notes

# Andrew NG Notes Collection **This is the first course of the deep learning specialization at [Coursera](https://www.coursera.org/specializations/deep-learning) which is moderated by [DeepLearning.ai](http://deeplearning.ai/). The course is taught by Andrew Ng.** **<Span style="color:red;">Andrew NG Machine Learning Notebooks :</span>** [**Reading**](https://github.com/ashishpatel26/Andrew-NG-Notes/tree/master/Machine%20Learning%20notebooks%20By%20Andrew%20NG) **<Span style="color:red;">Deep learning Specialization Notes in One pdf :</span>** [**Reading**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20learning%20by%20AndrewNG%20Tutorial%20%20Notes.pdf) | **Sr No** | **Article Reading** | | --------- | :----------------------------------------------------------- | | **1.** | **[Neural Network Deep Learning](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-1-neural-network-deep-learning.md)** | | **2.** | **[Improving Deep learning Network](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-2-improving-deep-learning-network.md)** | | **3.** | **[Structure of ML Projects](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-3-structuring-ml-projects.md)** | | **4.** | **[Convolutions Neural Network](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-4-convolutional-neural-network.md)** | | **5.** | **[Sequence Models](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-5-sequence-models.md)** | | Sr. No | MOOC LECTURE LINK | | ------ | ------------------------------------------------------------ | | 1. | [**Machine learning by Andrew-NG**](https://www.youtube.com/playlist?list=PLLssT5z_DsK-h9vYZkQkYNWcItqhlRJLN) | | | **DEEP LEARNING SERIES** | | 1. | [**Neural Network and Deep Learning**](https://www.youtube.com/playlist?list=PLkDaE6sCZn6Ec-XTbcX1uRg2_u4xOEky0) | | 2. | [**Improving deep neural networks: hyperparameter tuning, regularization and optimization**](https://www.youtube.com/playlist?list=PLkDaE6sCZn6Hn0vK8co82zjQtt3T2Nkqc) | | 3. | [**Structuring Machine Learning Projects**](https://www.youtube.com/playlist?list=PLkDaE6sCZn6E7jZ9sN_xHwSHOdjUxUW_b) | | 4. | [**Convolution Neural Network**](https://www.youtube.com/playlist?list=PLkDaE6sCZn6Gl29AoE31iwdVwSG-KnDzF) | | 5. | [**Sequence Models**](https://www.youtube.com/playlist?list=PLkDaE6sCZn6F6wUI9tvS_Gw1vaFAx6rd6) | | 6. | [**CS230: Deep Learning \| Autumn 2018**](https://www.youtube.com/playlist?list=PLoROMvodv4rOABXSygHTsbvUz4G_YQhOb ) | ## [**1.Neural Network Deep Learning**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-1-neural-network-deep-learning.md) ## ![](https://systweak1.vo.llnwd.net/content/wp/systweakblogsnew/uploads_new/2018/03/hidden-layers-in-network.gif) * **This Notes Give you brief introduction about :** * [**What is neural network? How it's work?**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-1-neural-network-deep-learning.md#what-is-a-neural-network-nn) * [**Supervised Learning using Neural Network**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-1-neural-network-deep-learning.md#neural-networks-basics) * [**Shallow Neural Network Design**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-1-neural-network-deep-learning.md#shallow-neural-networks) * [**Deep Neural Network**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-1-neural-network-deep-learning.md#deep-neural-networks) * **Notebooks** : * Week1 - [**Introduction to deep learning**](https://github.com/ashishpatel26/Andrew-NG-Notes/tree/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Convolutional%20Neural%20Networks/Week1) * Week2 - [**Neural Networks Basics**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Neural%20Networks%20and%20Deep%20Learning/Logistic%20Regression%20with%20a%20Neural%20Network%20mindset.ipynb) * Week3 - [**Shallow neural networks**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Neural%20Networks%20and%20Deep%20Learning/Logistic%20Regression%20with%20a%20Neural%20Network%20mindset.ipynb) * Week4 - [**Deep Neural Networks**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Neural%20Networks%20and%20Deep%20Learning/Building%20your%20Deep%20Neural%20Network%20-%20Step%20by%20Step.ipynb) ## [**2 Improving Deep learning Network**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-2-improving-deep-learning-network.md) ## ![](https://i.pinimg.com/originals/63/62/8f/63628f546ad55fd31091e23c623cb9f5.gif) * **This Notes Give you introduction about :** * [**Practical aspects of Deep Learning**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-2-improving-deep-learning-network.md#practical-aspects-of-deep-learning) * [**Optimization algorithms**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-2-improving-deep-learning-network.md#optimization-algorithms) * [**Hyperparameter tuning, Batch Normalization and Programming Frameworks**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-2-improving-deep-learning-network.md#hyperparameter-tuning-batch-normalization-and-programming-frameworks) * **Notebooks**: * Week1 - [**Practical aspects of Deep Learning**](https://github.com/ashishpatel26/Andrew-NG-Notes/tree/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Improving%20Deep%20Neural%20Networks%20Hyperparameter%20tuning%2C%20Regularization%20and%20Optimization) - Setting up your Machine Learning Application - Regularizing your neural network - Setting up your optimization problem * Week2 - [**Optimization algorithms**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Improving%20Deep%20Neural%20Networks%20Hyperparameter%20tuning%2C%20Regularization%20and%20Optimization/Optimization%20methods.ipynb) * Week3 - [**Hyperparameter tuning, Batch Normalization and Programming Frameworks**](https://github.com/ashishpatel26/Andrew-NG-Notes/tree/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Improving%20Deep%20Neural%20Networks%20Hyperparameter%20tuning%2C%20Regularization%20and%20Optimization) ## [**3.Structure ML Projects**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-3-structuring-ml-projects.md) ![](https://i.pinimg.com/originals/9b/fa/97/9bfa978a4cf40fe2cdf8c710deb9b6f9.png) * **In This Notes, you can learn about How to Structure Machine Learning Project:** * [**Why ML Structure?**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-3-structuring-ml-projects.md#ml-strategy-1) * [**Error Analysis**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-3-structuring-ml-projects.md#ml-strategy-2) * **Notebooks:** * Week1 - [**Introduction to ML Strategy**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Structuring%20Machine%20Learning%20Projects/Week%201%20Quiz%20-%20Bird%20recognition%20in%20the%20city%20of%20Peacetopia%20(case%20study).md) - Setting up your goal - Comparing to human-level performance * Week2 - [**ML Strategy (2)**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Structuring%20Machine%20Learning%20Projects/Week%202%20Quiz%20-%20Autonomous%20driving%20(case%20study).md) - Error Analysis - Mismatched training and dev/test set - Learning from multiple tasks - End-to-end deep learning ## [**4.Convolution Neural Network**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-4-convolutional-neural-network.md) * **Matrix Multiplication Between Image and Kernel Known as *Convolution Operation*** ![](https://i.stack.imgur.com/9OZKF.gif) ![](https://cdn-images-1.medium.com/max/600/1*GdxHFaUDbvTXJreKg3S8SQ.gif) ![](https://www.guru99.com/images/tensorflow/082918_1325_ConvNetConv9.gif) * **In This Notes, you can learn about Brief architecture CNN:** * [**Foundations of CNNs**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-4-convolutional-neural-network.md#foundations-of-cnns) * [**Deep convolutional models: case studies**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-4-convolutional-neural-network.md#deep-convolutional-models-case-studies) * [**Object detection**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-4-convolutional-neural-network.md#object-detection) * [**Special applications: Face recognition & Neural style transfer**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-4-convolutional-neural-network.md#special-applications-face-recognition--neural-style-transfer) * **Notebooks :** * Week1 - [**Foundations of Convolutional Neural Networks**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Convolutional%20Neural%20Networks/Week1/Convolution%20model%20-%20Step%20by%20Step.ipynb) * Week2 - [**Deep convolutional models: case studies**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Convolutional%20Neural%20Networks/Week2/ResNets/Residual%20Networks.ipynb) - **Papers for read:** - [**ImageNet Classification with Deep Convolutional Neural Networks**](https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf) - [**Very Deep Convolutional Networks For Large-Scale Image Recognition**](https://arxiv.org/pdf/1409.1556.pdf) * Week3 - [**Object detection**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Convolutional%20Neural%20Networks/Week3/Car%20detection%20for%20Autonomous%20Driving/Autonomous%20driving%20application%20-%20Car%20detection.ipynb) - **Papers for read:** - [**You Only Look Once: Unified, Real-Time Object Detection**](https://arxiv.org/pdf/1506.02640.pdf) - [**YOLO**](https://arxiv.org/pdf/1612.08242.pdf) * Week4 - [**Special applications: Face recognition & Neural style transfer**](https://github.com/ashishpatel26/Andrew-NG-Notes/tree/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Convolutional%20Neural%20Networks/Week4) - **Papers for read:** - [**DeepFace**](https://www.cs.toronto.edu/~ranzato/publications/taigman_cvpr14.pdf) ([**Notebook**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Convolutional%20Neural%20Networks/Week4/Face%20Recognition/Face%20Recognition%20for%20the%20Happy%20House.ipynb)) - [**FaceNet**](https://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Schroff_FaceNet_A_Unified_2015_CVPR_paper.pdf) - [**Neural Style Transfer**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Convolutional%20Neural%20Networks/Week4/Neural%20Style%20Transfer/Art%20Generation%20with%20Neural%20Style%20Transfer.ipynb) ## [**5.Sequence Models**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-5-sequence-models.md) ![](https://3.bp.blogspot.com/-3Pbj_dvt0Vo/V-qe-Nl6P5I/AAAAAAAABQc/z0_6WtVWtvARtMk0i9_AtLeyyGyV6AI4wCLcB/s1600/nmt-model-fast.gif) --- * **Vanila RNN** ![](https://cdn-images-1.medium.com/max/880/1*xn5kA92_J5KLaKcP7BMRLA.gif) * **LSTM** ![](https://cdn-images-1.medium.com/max/880/1*goJVQs-p9kgLODFNyhl9zA.gif) * **GRU** ![](https://cdn-images-1.medium.com/max/880/1*FpRS0C3EHQnELVaWRvb8bg.gif) * **In This Section, you can learn about Sequence to Sequence Learning** * [**Recurrent Neural Networks**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-5-sequence-models.md#recurrent-neural-networks) * [**Natural Language Processing & Word Embeddings**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-5-sequence-models.md#natural-language-processing--word-embeddings) * [**Sequence models & Attention mechanism**](https://github.com/ashishpatel26/Andrew-NG-Notes/blob/master/andrewng-p-5-sequence-models.md#sequence-models--attention-mechanism) * **Notebooks:** * Week1 - [**Recurrent Neural Networks**](https://nbviewer.jupyter.org/github/ashishpatel26/Andrew-NG-Notes/blob/master/Deep%20Learning%20Notebooks%20by%20Andrew%20NG/Sequence%20Models/Week1/Building%20a%20Recurrent%20Neural%20Network%20-%20Step%20by%20Step/Building%20a%20Recurrent%20Neural%20Network%20-%20Step%20by%20Step.ipynb) * Week2 - [**Natural Language Processing & Word Embeddings**](https://github.com/ashishpatel26/Deep-Learning-Coursera/tree/master/Sequence%20Models/Week2) * Week3 - [**Sequence models & Attention mechanism**](https://github.com/ashishpatel26/Deep-Learning-Coursera/tree/master/Sequence%20Models/Week3) **Thanks for Reading....Happy Learning...!!!**

Education & Learning

3.7K Github Stars

Open Source

Treasure-of-Transformers

# Awesome ![](https://raw.githubusercontent.com/ashishpatel26/Tre ![fw.jpg](https://github.com/ashishpatel26/Treasure-of- --- ### 🧑‍💻👩‍💻Collection of All NLP --- | Sr No | Algorithm Name | ----- | --------------------------------------------- | 1 | [GPT-Neo](https://github.com/EleutherAI/gpt-neo) | 2 | [Transformer](https://arxiv.org/abs/1706.03762v5) | 3 | [BERT](https://arxiv.org/abs/1810.04805v2) | 4 | [GPT](https://s3-us-west-2.amazonaws.com/open | 5 | [Universal Transformer](https://arxiv.org/abs | 6 | [T-D](https://arxiv.org/abs/1801.10198v1) | 7 | [GPT-2](https://d4mucfpksywv.cloudfront.net/b | 8 | [T5](https://arxiv.org/abs/1910.10683v3) | 9 | [BART](https://arxiv.org/abs/1910.13461v1) | 10 | [XLNet](https://arxiv.org/abs/1906.08237v2) | 11 | [ALBERT](https://arxiv.org/abs/1909.11942v6) | 12 | [Distil-BERT](https://arxiv.org/abs/1910.01108v4) | 13 | [Transformer-XL](https://arxiv.org/abs/1901.02860v3) | 14 | [XLM](https://arxiv.org/abs/1901.07291v1) | 15 | [ViLBERT](https://arxiv.org/abs/1908.02265v1) | 16 | [Sparse Transformer](https://arxiv.org/abs/1904.10509v1) | 17 | [Levenshtein Transformer](https://arxiv.org/a | 18 | [CTRL](https://arxiv.org/abs/1909.05858v2) | 19 | [VideoBERT](https://arxiv.org/abs/1904.01766v2) | 20 | [Compressive Transformer](https://arxiv.org/a | 21 | [CuBERT](https://arxiv.org/abs/2001.00059v3) | 22 | [BP-Transformer](https://arxiv.org/abs/1911.04070v1) | 23 | [Adaptively Sparse Transformer](https://arxiv | 24 | [Sandwich Transformer](https://arxiv.org/abs/1911.03864v2) | 25 | [FSMT](https://arxiv.org/abs/1907.06616) | 26 | [LXMERT](https://arxiv.org/abs/1908.07490) | 27 | [VisualBERT](https://arxiv.org/pdf/1908.03557) | 28 | [GPT-3](https://arxiv.org/abs/2005.14165v4) | 29 | [ELECTRA](https://arxiv.org/abs/2003.10555v1) | 30 | [Electric](https://arxiv.org/abs/2012.08561v1) | 31 | [LongFormer](https://arxiv.org/abs/2004.05150v2) | 32 | [mBART](https://arxiv.org/abs/2001.08210v2) | 33 | [Performer](https://arxiv.org/abs/2009.14794v3) | 34 | [ETC](https://arxiv.org/abs/2004.08483v5) | 35 | [CodeBERT](https://arxiv.org/abs/2002.08155v4) | 36 | [mT5](https://arxiv.org/abs/2010.11934v3) | 37 | [Reformer](https://arxiv.org/abs/2001.04451v2) | 38 | [DeBERTa & DeBERTa-v2](https://arxiv.org/ | 39 | [Linformer](https://arxiv.org/abs/2006.04768v3) | 40 | [RAG](https://arxiv.org/abs/2005.11401v4) | 41 | [ProphetNet](https://arxiv.org/abs/2001.04063v3) | 42 | [BigBird](https://arxiv.org/abs/2007.14062v2) | 43 | [PLATO-2](https://arxiv.org/abs/2006.16779v4) | 44 | [Routing Transformer](https://arxiv.org/abs/2003.05997v5) | 45 | [DeeBERT](https://arxiv.org/abs/2004.12993v1) | 46 | [DynaBERT](https://arxiv.org/abs/2004.04037v2) | 47 | [TernaryBERT](https://arxiv.org/abs/2009.12812v3) | 48 | [MobileBERT](https://arxiv.org/abs/2004.02984v2) | 49 | [Bort](https://arxiv.org/abs/2010.10499v2) | 50 | [DeLighT](https://arxiv.org/abs/2008.00623v2) | 51 | [PAR Transformer](https://arxiv.org/abs/2009.04534v3) | 52 | [ConvBERT](https://arxiv.org/abs/2008.02496v3) | 53 | [IB-BERT](https://arxiv.org/abs/2004.02984v2) | 54 | [MacBERT](https://arxiv.org/abs/2004.13922v2) | 55 | [RealFormer](https://arxiv.org/abs/2012.11747v3) | 56 | [Sinkhorn Transformer](https://arxiv.org/abs/2002.11296v1) | 57 | [SongNet](https://arxiv.org/abs/2004.08022v2) | 58 | [Funnel Transformer](https://arxiv.org/abs/2006.03236v1) | 59 | [SC-GPT](https://arxiv.org/abs/2002.12328v1) | 60 | [SMITH](https://arxiv.org/abs/2004.12297v2) | 61 | [BinaryBERT](https://arxiv.org/abs/2012.15701v2) | 62 | [SqueezeBERT](https://arxiv.org/abs/2006.11316v1) | 63 | [Feedback Transformer](https://arxiv.org/abs/2002.09402v3) | 64 | [CamemBERT](https://arxiv.org/abs/1911.03894) | 65 | [CPM](https://arxiv.org/abs/2012.00413) | 66 | [DialoGPT](https://arxiv.org/abs/1911.00536) | 67 | [DPR](https://arxiv.org/abs/2004.04906) | 68 | [FlauBERT](https://arxiv.org/abs/1912.05372) | 69 | [HerBERT](https://www.aclweb.org/anthology/20 | 70 | [LayoutLM](https://arxiv.org/abs/1912.13318) | 71 | [LED](https://arxiv.org/abs/2004.05150) | 72 | [LUKE](https://arxiv.org/abs/2010.01057) | 73 | [M2M100](https://arxiv.org/abs/2010.11125) | 74 | [MBart and MBart-50](https://arxiv.org/abs/2001.08210) | 75 | [MegatronBERT](https://arxiv.org/abs/1909.08053) | 76 | [MegatronGPT2](https://arxiv.org/abs/1909.08053) | 77 | [MPNet](https://arxiv.org/abs/2004.09297) | 78 | [Pegasus](https://arxiv.org/pdf/1912.08777.pdf) | 79 | [PhoBERT](https://arxiv.org/abs/2003.00744v3) | 80 | [QDQBERT](https://arxiv.org/abs/2004.09602) | 81 | [RemBERT](https://arxiv.org/abs/2010.12821) | 82 | [RetriBERT](https://yjernite.github.io/lfqa.html) | 83 | [Speech2Text](https://arxiv.org/abs/2010.05171) | 84 | [T5v1.1](https://arxiv.org/abs/2002.05202) | 85 | [TAPAS](https://arxiv.org/abs/2004.02349) | 86 | [Wav2Vec2](https://arxiv.org/abs/2006.11477) | 87 | [XLM-ProphetNet](https://arxiv.org/abs/2001.04063) | 88 | [XLM-RoBERTa](https://arxiv.org/abs/1911.02116) | 89 | [XLSR-Wav2Vec2](https://arxiv.org/abs/2006.13979) | 90 | [Switch Transformer](https://arxiv.org/abs/2101.03961v1) | 91 | [TNT](https://arxiv.org/abs/2103.00112v3) | 92 | [Adaptive Span Transformer](https://arxiv.org | 93 | [Primer](https://arxiv.org/abs/2109.08668v1) | 94 | [Charformer](https://arxiv.org/abs/2106.12672v2) | 95 | [MATE](https://arxiv.org/abs/2109.04312v1) | 96 | [Nystromformer](https://arxiv.org/abs/2102.03902v3) | 97 | [Subformer](https://arxiv.org/abs/2101.00234v3) | 98 | [ESACL](https://arxiv.org/abs/2108.11992v1) | 99 | [PermuteFormer](https://arxiv.org/abs/2109.02377v2) | 100 | [NormFormer](https://arxiv.org/abs/2110.09456v2) | 101 | [Fastformer](https://arxiv.org/abs/2108.09084v6) | 102 | [AutoTinyBERT](https://arxiv.org/abs/2107.13686v1) | 103 | [EGT](https://arxiv.org/abs/2108.03348v2) | 104 | [Chinese Pre-trained Unbalanced Transformer | 105 | [GANFormer](https://arxiv.org/abs/2103.01209v3) | 106 | [ClipBERT](https://arxiv.org/abs/2102.06183v1) | 107 | [CodeT5](https://arxiv.org/abs/2109.00859v1) | 108 | [I-BERT](https://paperswithcode.com/method/i-bert) | 109 | [ByT5](https://arxiv.org/abs/2105.13626) | 110 | [CANINE](https://arxiv.org/abs/2103.06874) | 111 | [FNet](https://arxiv.org/abs/2105.03824) | 112 | [LayoutLMV2](https://arxiv.org/abs/2012.14740) | 113 | [LayoutXLM](https://arxiv.org/abs/2104.08836) | 114 | [GPT-J](https://huggingface.co/docs/transform | 115 | [Hubert](https://arxiv.org/abs/2106.07447) | 116 | [Perceiver](https://arxiv.org/abs/2107.14795) | 117 | [RoFormer](https://arxiv.org/pdf/2104.09864v1.pdf) | 118 | [SegFormer](https://arxiv.org/abs/2105.15203) | 119 | [SEW](https://arxiv.org/abs/2109.06870) | 120 | [SEW-D](https://arxiv.org/abs/2109.06870) | 121 | [Speech2Text2](https://arxiv.org/abs/2104.06678) | 122 | [Splinter](https://arxiv.org/abs/2101.00438) | 123 | [TrOCR](https://arxiv.org/abs/2109.10282) | 124 | [UniSpeech](https://arxiv.org/abs/2101.07597) | 125 | [UniSpeech-SAT](https://arxiv.org/abs/2110.05752) | 126 | [MarianMT](https://huggingface.co/docs/transf --- #### Instruction * All blogs have links and some links contains --- #### How to Contribute --- if you want to contribute on this project please 🙏🙏Special Thanks to [**Komal Lamba**](https://git --- Copyright for source code belongs to the original --- **_Thanks for Reading ...!!!_** --- Treasure of Transformers Models Collection asure-of-Transformers/main/images/tot.jpg) Transformers/blob/main/images/fw.jpg?raw=true) Deep learning algorithm list with Code 🧑‍💻👩‍💻![Jupyter Notebook](https://img.shields.io/badge/jupyter-%23FA0F00.svg?style=for-the-badge&logo=jupyter&logoColor=white) | Year | Blog | Video | Official Repo | Code | --------------- | ---- | ------------------------------------------------------------ | ------------------------------------------------------------ | ------------------------------------------------------------ | ------------------------------------------------------------ | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rYanJk) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/6MI0f6YjJIk) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/EleutherAI/gpt-neo) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/EleutherAI/GPTNeo/blob/master/GPTNeo_example_notebook.ipynb) | | 2017 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3DNsrIp) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/iDulhoQ2pro) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/tensorflow/models/tree/master/official/nlp/transformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/bentrevett/pytorch-seq2seq/blob/master/6%20-%20Attention%20is%20All%20You%20Need.ipynb) | | 2018 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pPV8PS) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/7kLi8u2dJz0) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/bert) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/BERT/Custom_Named_Entity_Recognition_with_BERT_only_first_wordpiece.ipynb) | ai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf) | 2018 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3ENPuEn) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/9ebPNEHRwXU) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huggingface/transformers) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/keras-team/keras-io/blob/master/examples/generative/ipynb/text_generation_with_miniature_gpt.ipynb) | /1807.03819v3) | 2018 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lRi6VG) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/tensorflow/tensor2tensor) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/tensorflow/tensor2tensor/blob/master/tensor2tensor/notebooks/hello_t2t.ipynb) | | 2018 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3F17Ba5) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/__ALQCud-iA) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/tensorflow/tensor2tensor) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/tensorflow/tensor2tensor/blob/master/tensor2tensor/notebooks/hello_t2t.ipynb) | etter-language-models/language-models.pdf) | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rXapBi) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/X-B3nAN7YRM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/openai/gpt-2) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/huggingface/blog/blob/master/notebooks/02_how_to_generate.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3yjbrZf) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/jgKj-7v2UYU) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/text-to-text-transfer-transformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/T5/Fine_tune_CodeT5_for_generating_docstrings_from_Ruby_code.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3yead1D) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/Xz4fiQNmGSA) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/facebookresearch/GENRE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/mrm8488/shared_colab_notebooks/blob/master/BART_with_JS_UI.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EGEHM5) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/8J8KkuncAmY) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/zihangdai/xlnet) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1YXojI6USFGV3498Pygllv0z8vTMVIiEt) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lW9L34) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/Lwtj2yUAMgI) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/ALBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/google-research/albert/blob/master/albert_glue_fine_tuning_tutorial.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3GPQKHN) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/cCs8exFrGE8) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)]() | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lW6qkC) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/mqsRZAJav70) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/kimiyoung/transformer-xl) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/lab-ml/nn/blob/master/labml_nn/transformers/xl/experiment.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31M5BDH) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/caZLVcJqsqo) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/facebookresearch/XLM) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Tikquuss/meta_XLM/blob/master/notebooks/demo/tuto.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31M5KqJ) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/dd7nE4nbxN0) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/facebookresearch/vilbert-multi-task/) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/facebookresearch/vilbert-multi-task/blob/9d645085b54fac6a781257133edabefdfb23e547/demo.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3ELosND) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/jaqjcHmCBfY) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/openai/sparse_attention) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/ptillet/torch-blocksparse/blob/master/examples/simple.py) | bs/1905.11006v2) | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rUU4wQ) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/FtUbMG3rlFs) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/pytorch/fairseq) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/33pJRhX) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/q5zw2Wh4Rdo) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/salesforce/ctrl) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1nDh3ayRPJGK5ciPO2D3TFkYZFqclBWHY) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31PHkN2) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/EkuyLsJX4QM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/MDSKUL/MasterProject) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/ammesatyajit/VideoBERT) | bs/1911.05507v1) | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rX1q2L) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/0TMKCQiT1T0) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/deepmind/pg19) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/lucidrains/compressive-transformer-pytorch) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lXcxVH) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/bCPeg0Tp64s) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research/tree/master/cubert) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ai-center-kth/cuBERT-source-code-clustering/blob/main/src/evaluation.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3yuzqFj) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/yzh119/BPT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | .org/abs/1909.00015v2) | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lXLbyG) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/_pYxa50HTBw) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/deep-spin/entmax) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/prajjwal1/adaptive_transformer/blob/8f062a7d5c6573ebdb1aa2b57113db918156b15a/nbs/adaptive_train.ipynb) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31V686t) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/EM8xFAjtZUQ) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/ofirpress/sandwich_transformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/lucidrains/x-transformers) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3oIFarp) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/pytorch/fairseq/tree/main/examples/wmt19) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://huggingface.co/transformers/v3.5.1/model_doc/fsmt.html) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3oJq19i) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/airsplay/lxmert) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/18TyuMfZYlgQ_nXo-tr8LCnzUaoX0KS-h?usp=sharing) | | 2019 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3s0AgIq) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/Lhi1UFsXvpk) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/uclanlp/visualbert) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/uclanlp/visualbert/blob/e49b61906dff12f1b2992226ae84c538fcf438e4/unsupervised_visualbert/data/nlvr2/nlvr/nlvr2/NLVR2BiasAnalysis.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3oIFwhJ) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/SboKeK6FFHQ) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/openai/gpt-3) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/rafajak/gpt3_examples/blob/master/GPT3_search_example.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lUZGDy) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/p9c7SoD4AMc) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/electra) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1DiOwhRjQbtYRgFWG7e3dybcXJsZcu86l) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31SfM9E) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/electra) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3oJ03mh) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/_8KNb5iqblE) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/allenai/longformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patil-suraj/Notebooks/blob/master/longformer_qa_training.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EPC0Ii) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/oO7k5lH8Oe8) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/pytorch/fairseq/tree/master/examples/mbart) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/sdhilip200/Machine-Translation-using-mBART-50-and-Hugging-Face/blob/main/Machine_Translation.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pLxvYW) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/xJrKIPwVwGM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1ICW0DpXfUuVYsnNkt1DHwUyyTduHHvE3?usp=sharing) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rWIy3W) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/TyydOhj28A4) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research/tree/master/etcmodel) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pPuIhc) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/YmAXluUDPPI) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/CodeBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/graykode/commit-autosuggestions/blob/579d7a34f3ebb735d2a9f13afc74eeb66c0d7427/commit_autosuggestions.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3DJ76jh) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)]() | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ejmejm/multilingual-nmt-mt5/blob/main/nmt_full_version.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pPSTMn) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/i4H0kjxrias) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google/trax/tree/master/trax/models/reformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/PyTorch_Reformer.ipynb) | abs/2006.03654v6) | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3GyaT4F) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/_c6A33Fg5Ns) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/DeBERTa) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/musthofasyarifudin/Deberta-Language-Modeling-For-NLP/blob/main/MLM_Deberta_Base.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3DMx5GH) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/-_2AF9Lhweo) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/kuixu/Linear-Multihead-Attention) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1zHenqau3rMo3oS_7EisfGsahSs-1_sok?usp=sharing) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/30f4ig2) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/dzChvuZI6D4) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://huggingface.co/docs/transformers/model_doc/rag?utm_source=catalyzex.com) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ipavlopoulos/modern_nlp/blob/f2a7af7e9de68d505dd1585c04cc51f30433122b/Modern_NLP_S5.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31RisVr) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/9Hoo_qdjSio) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/ProphetNet) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/11uPpxZzoTofnHZsyDPaJr5dFKsgOmTD9#scrollTo=j5CRrgNFc_Jq) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pPTSMz) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/WVPE62Gk3EM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/bigbird) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/vasudevgupta7/bigbird/blob/main/notebooks/evaluate_nq.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3DF7hMA) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/0zlRRC0jPf4) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PaddlePaddle/Knover) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/dialogue/plato-2) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3IGcabW) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/lucidrains/routing-transformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1sw1Hjx3EllhKZh4nhJ3TIZ978HjKVUFQ?usp=sharing) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3GB1Ks8) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/castorini/DeeBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/castorini/DeeBERT/blob/3efc01db07a0bed88e19551992b8378994195d1c/notebooks/Comparing-TF-and-PT-models-SQuAD.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EGKyRz) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/UuGYwjCOGQo) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/DynaBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/DynaBERT) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dECdlu) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://papertalk.org/papertalks/11743) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/TernaryBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/TernaryBERT) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3yirFlJ) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/sayakpaul/BERT-for-Mobile/blob/master/MobileBERT_Keras.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3oMixme) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/alexa/bort) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3DRXQtq) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/-AVqR2qZHb4) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/sacmehta/delight) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3s26Nhk) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/Jmkernes/PAR-Transformer-XL) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/Jmkernes/PAR-Transformer-XL/blob/ee2c2bd5cd672eddbe06d68614298de8283c5b2f/colab.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pKkqPi) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/321uKKx) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/yitu-opensource/ConvBert) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1WIu2Cc1C8E7ayZBzEmpfd5sXOhe7Ehhz?usp=sharing) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dKRvVT) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/lordtt13/transformers-experiments/blob/5ea4537ee0662fb6ca2ba736a50f4894197eec60/Custom%20Tasks/emo-mobilebert.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3GTTdkv) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/ymcui/MacBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/shibing624/nlp-tutorial/blob/c9c00b2160397248381203658194a63044e7d7d5/03_language_model/03_Bert%E5%AE%8C%E5%BD%A2%E5%A1%AB%E7%A9%BA.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EQSoYW) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/3DMWyzG) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/jaketae/realformer) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3yjJOiV) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/lucidrains/sinkhorn-transformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1Eej8U4pP5ldZOz3tHwpoBFgmQqLhQLUq) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3ym2hLH) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/lipiji/SongNet) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31WfMWc) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/QsIcEqGriGg) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/laiguokun/Funnel-Transformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/iIsunnyIi/Funnel-Transformer/blob/main/Funnel_IntentRecognition.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31VCldV) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/NWHqFbgHqng) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/pengbaolin/SC-GPT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dHyOm2) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/VHsYJu9VzyI) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research/tree/master/smith) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dNguYx) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/BinaryBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EPfqiT) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/kPMaEYSywdI) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huggingface/transformers/blob/master/src/transformers/modeling_squeezebert.py) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/urainshah/Use-of-transformers-hugging-face/blob/main/fakenews_squeezebert1.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31VDQJ5) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/-QH8fRhqFHM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/facebookresearch/transformer-sequential) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/rajaswa/feedback-and-memory-in-transformers/blob/main/Feedback_and_Memory_in_Transformers.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3yj1AD0) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://huggingface.co/docs/transformers/model_doc/camembert) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/SimonLembeye/french-sentence-embedding/blob/master/sentence_transformers_camembert.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/30jaW4W) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/dFTG3ohAcso) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](github.com/TsinghuaAI/CPM-1-Generate) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dKCT8T) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/Zo679MYoJns) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/DialoGPT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1PslHE4Rl4RqSa20s7HEp0ZKITBir6ezE) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3oLM0g0) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/DBsxUSUhfRg) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/facebookresearch/DPR) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack/blob/master/tutorials/Tutorial1_Basic_QA_Pipeline.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3GENX40) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/3GElYkU) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/getalp/Flaubert) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Rushikesh10/FlauBERT-Text-Summarization/blob/main/FlauBERT%20Colab%20Notebook.ipynb) | 20.acl-main.111.pdf) | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3GyppJM) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/3dOIR92) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/allegro/klejbenchmark-baselines) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/klinkeklinke/TransformersTransferLearning/blob/32aae9ee170a9c7fe4037a9dc7d3cee150805c38/transfer_learning_nlp.ipynb#scrollTo=c4cf3720) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rWIukZ) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/zazN_yFWlLM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/unilm) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForTokenClassification_on_FUNSD.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pTAGh4) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/_8KNb5iqblE) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/allenai/longformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rYxxiC) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/oho-i5Ws07g) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/studio-ousia/luke) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/LUKE/Supervised_relation_extraction_with_LukeForEntityPairClassification.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/33jc6P3) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/30u83yw) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/pytorch/fairseq) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/harveenchadha/bol/blob/main/demos/gr/hindi/Speech_ASR_plus_Translation_Hindi.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lZelh1) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/oO7k5lH8Oe8) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/pytorch/fairseq/tree/master/examples/mbart) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/sdhilip200/Machine-Translation-using-mBART-50-and-Hugging-Face/blob/main/Machine_Translation.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3IMtdZO) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/wBgpMf_KQVw) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/NVIDIA/Megatron-LM) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/kssteven418/Q-ASR/blob/0ad68cdeddbd5a4c8edba6a0876470ec48186584/tutorials/nlp/Relation_Extraction-BioMegatron.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/33tQMGV) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)]() | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/877152223/BugInjector/blob/4cf14e237b97a724edbb4b1300170c3cc832fc2f/BugInjector-GPT2.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pPD6gO) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/WS1uVMGhlWQ) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/MPNet) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/04mayukh/Neutral-tweet-identification-on-OLID-using-Neutrosophy/blob/45bbd6c57054337e8af6429554f2dda4aef266d1/Models/MPNet.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3mkVsWb) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/naRdmLvlEzE) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/pegasus) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/CoGian/pegasus_demo_huggingface/blob/master/pegasus_demo_huggingface.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31Kahul) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/7d--8leiZgA) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://paperswithcode.com/paper/phobert-pre-trained-language-models-for#code) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ncthuan/text_cls_phobert/blob/master/phobert_clf.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pXReVs) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/mDefFU7rbV0) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huggingface/pytorch-transformers) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ELS-RD/transformer-deploy/blob/814477ce3b3279cff8f8c3947294119f399903b6/demo/quantization_end_to_end.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31KaNIN) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/JK1002497318/RemBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/kldarek/chaii/blob/194f92b808cb1c81b70b889ab8d061344ef34ef9/training_notebooks/REMBERT_pretraining77.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3s0Ta1O) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)]() | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/robhaslinger/EALI5-redux/blob/50ce17c33c333a0d9781f00e29888f2844ad6aae/notebooks/qa_step_by_step.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31ZJWI7) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/a-OwY2SqKQI) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/pytorch/fairseq/tree/master/examples/speech_to_text) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pSWCJm) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/text-to-text-transfer-transformer/) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/lucidrains/x-transformers) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lZtfnE) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/ZnuEOQrT4h0) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/tapas) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Evaluating_TAPAS_on_the_Tabfact_test_set.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3GJBADT) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/aUSXvoWfy3w) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/chuachinhon/wav2vec2_transformers) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/chuachinhon/wav2vec2_transformers/blob/main/notebooks/2.2_wav2vec2_poetry_alt.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EQ6KbP) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://huggingface.co/docs/transformers/model_doc/xlmprophetnet) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Biswajit7890/ADV-DL-NLP-Notebooks/blob/2258022d0c06599317ef3db3d53ef8d4826fd0c2/custom_language_translation_Training_with_XLMProphetNet_.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3IHnHI3) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://www.youtube.com/watch?v=Ot6A3UFY72c&ab_channel=AISuisse) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/facebookresearch/cc_net) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/edoost/pert/blob/29fc78bc36110ea031083a3e7294ce9135026ee1/pos_xlmroberta_multi.ipynb) | | 2020 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/33qEO0D) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/3DSHm4e) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/HLasse/wav2vec_finetune) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/kingabzpro/WOLOF-ASR-Wav2Vec2/blob/e389abae6887788894795b7fd0171b306e3ca752/3-asr-fine-tune-wolof-gdrive.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3IHgLup) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/2pbvnxdaKaw) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/tensorflow/mesh) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/LoniQin/english-spanish-translation-switch-transformer/blob/main/english_spanish_translation_switch_transformer.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pRazY7) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/HWna2c5VXDg) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huawei-noah/CV-Backbones/tree/master/tnt_pytorch) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Rishit-dagli/Transformer-in-Transformer/blob/main/example/tnt-example.ipynb) | /abs/1905.07799v2) | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31SYHwT) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/3GFNqib) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/facebookresearch/adaptive-span) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/prajjwal1/adaptive_transformer/blob/8f062a7d5c6573ebdb1aa2b57113db918156b15a/nbs/adaptive_train.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3s1eYKD) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/ze7poOz-5Pw) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research/tree/master/primer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/lucidrains/x-transformers#relu) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3GH3tfQ) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/debgj24BAZE) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/google-research/tree/master/charformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/lucidrains/charformer-pytorch) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lZ37cs) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/TsTib7b0zqU) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/tapas) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/google-research/tapas/blob/master/notebooks/sqa_predictions.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3IIzoy4) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/m-zrcmRd7E4) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/mlpen/Nystromformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/lucidrains/nystrom-attention) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3IKod7X) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/machelreid/subformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/33qph0M) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/dHHvdubDnYM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/chz816/esacl) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3pT0ABv) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/cpcp1998/permuteformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3DSZbQq) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/pytorch/fairseq) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3lZ4nME) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/qgUegkefocg) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/fastformers) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/wuch15/Fastformer/blob/main/Fastformer.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31Kfxy5) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huawei-noah/Pretrained-Language-Model) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/AutoTinyBERT) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rXLWvt) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/51_K8RDVlXY) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/shamim-hussain/egt) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | ](https://arxiv.org/abs/2109.05729v3) | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3oOI6mr) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/fastnlp/cpt) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/fastnlp/CPT) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dJjZzt) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/HO-_t0UArd4) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/dorarad/gansformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/GiorgiaAuroraAdorni/gansformer-reproducibility-challenge/blob/83c145d9e706d3814cf0eef7036a8e59c2accb2b/colab%20notebooks/Reproducibility_model_trainer.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3ERUCY6) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/cBVdz1FjwVM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/jayleicn/ClipBERT) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)]() | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3oMJp5t) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/salesforce/codet5) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Dehbaiyor/IDLFall2021Project/blob/b100172b4477447db82a5c1c96dcef2349592ae4/Baselines/codet5-baseline.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3yiN521) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)]() | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://huggingface.co/docs/transformers/model_doc/ibert) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dLRpxh) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/vEOYfPPu3ik) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/byt5) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1rxpI8IlKk-D2crFqi2hdzbTBIezqgsCg?usp=sharing) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EQym0N) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/E17qE148aSM) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/google-research/language/tree/master/language/canine) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/CANINE/Fine_tune_CANINE_on_IMDb_(movie_review_binary_classification).ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3DR2yrl) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/JJR3pBl78zw) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/rishikksh20/FNet-pytorch) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/vishal-burman/PyTorch-Architectures/blob/master/modeling_FNet/test_sample_FNet.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dQwpFq) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/3DRodzt) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/unilm) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/jdegange/MultimodalDocumentTransformers/blob/cc03caeca7efc1b17789567cc7a0b7e1c8bdac1a/Fine_tuning_LayoutLMv2ForTokenClassification_on_CORD.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3DPjZZ6) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/unilm/tree/master/layoutxlm) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/hieuthehungry/layout_xlm_vnm/blob/b35c9f13cd9ea75832d39a74587ca84610d8c659/fine_tuning_layoutxlm_fortokenclassification_on_cord.py) | ers/model_doc/gptj) | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EV9WmI) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/S9FhhhQEqiE) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/kingoflolz/mesh-transformer-jax) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/GPT-J-6B/Inference_with_GPT_J_6B.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3ETLjGU) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/p5M7CYZAqfA) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/huseinzol05/malaya-speech) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/shamik-biswas-rft/Speech2Text/blob/8c8663b6cd3dbff557e90a6e813b58b17005a2bf/notebooks/automatic_transcriptions.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dNUWLE) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/WJWBq4NZfvY) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/deepmind/deepmind-research/tree/master/perceiver) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/Perceiver/Perceiver_for_masked_language_modeling_and_image_classification.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/31TNbAX) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/rNG_hpSyZcE) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/ZhuiyiTechnology/roformer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://github.com/JunnYu/RoFormer_pytorch) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3ESxzw3) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/J0MoRQzZe8U) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/NVlabs/SegFormer) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/SegFormer/Segformer_inference_notebook.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3EQ4n8V) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/asappresearch/sew) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://huggingface.co/docs/transformers/model_doc/sew) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dI3iV3) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/asappresearch/sew) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://huggingface.co/docs/transformers/model_doc/sew_d) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dNMGLn) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/dJAoK5zK36M) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://arxiv.org/abs/2104.06678) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://arxiv.org/abs/2104.06678) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3dLX86f) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://bit.ly/3oUTyNi) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/oriram/splinter) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Qiwei97/Machine-Learning-Models/blob/67c713c411ec824a2dfcb0d75f1185d2d1b6e354/NLP%20Projects/Question%20Answering/Splinter%20TPU.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/30mlLmR) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)]() | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/unilm/tree/master/trocr) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/TrOCR/Inference_with_TrOCR_%2B_Gradio_demo.ipynb) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rZ5Aaq) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/hS42xD3O55E) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/UniSpeech) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://huggingface.co/docs/transformers/model_doc/unispeech) | | 2021 | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/b1.jpg)](https://bit.ly/3rY9wZ1) | [![Youtube](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/yt1.jpg)](https://youtu.be/l4t_ENqo5rE) | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/microsoft/unispeech) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://huggingface.co/docs/transformers/model_doc/unispeech_sat) | ormers/model_doc/marian) | - | | | [![](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)]() | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://huggingface.co/docs/transformers/model_doc/marian) | different languages blog such as Chinese, Korean etc. for this Please use [Google Tranlater Page Convert](https://chrome.google.com/webstore/detail/google-translate/aapbdbdomjkkjkaonfhkkikfgjllcleb?hl=en). send us email: [email protected] . hub.com/komal11lamba) for contributing. author(s). However, under fair use you are encouraged to fork and contribute minor corrections and updates for the benefit of the reader(s).

AI & Machine Learning Education & Learning

1.1K Github Stars

Open Source

ResourceBank_CV_NLP_MLOPS_2022

<p align="center"> <a href="" rel="noopener"> <img width=200px height=200px src="images\CV.png"" alt="Project logo"></a> </p> <h3 align="center">Resource Bank of Computer Vision, Natural Langauge Processing and MLops</h3> --- <p align="center"> This initiative compiles educational resources on a daily basis, making it possible for users to get all the data they want in one place. <br> </p> ## 📝 Table of Contents --- - [95% Data Science Skill Covered Course](#course) - [COMPUTER VISION](#CV) - [NATURAL LANGUAGE PROCESSING](#NLP) - [MLOPS](#MLOPS) ## ♾️ 95% Data Science Skills Covered Course<a name="course"></a> --- | Sr.No | Courses | Link | | ----- | ------------------------------------------------------------ | ------------------------------------------------------------ | | 1 | **Machine Learning Specialization** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/dUFfAdNS) | | 2 | **Deep Learning Specialization** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/gpQhgA2T) | | 3 | **Natural Language Processing Specialization** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/dswF7VtT) | | 4 | **TensorFlow Developer Professional Certificate** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/d5jS5gsU) | | 5 | **TensorFlow: Advanced Techniques Specialization** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/dnTEBAVk) | | 6 | **TensorFlow: Data and Deployment Specialization**| [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/dG7ZaMjF) | | 7 | **Machine Learning Engineering for Production (MLOps) Specialization** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/gicaDub6) | | 8 | **Generative Adversarial Networks (GANs) Specialization** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/dye_EFdb) | | 9 | **Practical Data Science on the Amazon Web Services (AWS) Cloud Specialization** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://lnkd.in/dShdTA2R) | | 10 | **Mathematics of Data Science** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)](https://www.youtube.com/playlist?list=PLiud-28tsatIKUitdoH3EEUZL-9i516IL) | | 11 | ** ** | [![](https://raw.githubusercontent.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/main/images/online-learning.png)]() | #### Extra Resources ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/extra.jpg) | Sr.No | Resource Name | Link | | ----- | ------------- | ------------------------------------------------------------ | | 1 | **Intro to optimization in deep learning: Gradient Descent** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://blog.paperspace.com/intro-to-optimization-in-deep-learning-gradient-descent/) | | 2 | **ML system design usecases** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://github.com/khangich/machine-learning-interview/blob/master/design.md) | | 2 | **Free datasets for Data Science, Data Analytics, and ML projects** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.linkedin.com/posts/dhavalsays_datasciencetraining-datasciencecareers-machinelearningtraining-activity-6973845094596542464-I0Cy/?utm_source=share&utm_medium=member_ios) | | 3 | **Accuracy and Loss: Things to Know about The Top 1 and Top 5 Accuracy** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://towardsdatascience.com/accuracy-and-loss-things-to-know-about-the-top-1-and-top-5-accuracy-1d6beb8f6df3) | | 4 | ** ** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | | 5 | ** ** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | | 6 | ** ** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | ## 👁️‍🗨️ COMPUTER VISION<a name = "CV"></a> **Computer Vision Learning Path Recommended by OpenCV** --- [![](https://github.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/blob/main/images/cv_learning_path.jpg?raw=true)](https://opencv.org/syllabus/cv1-syllabus.pdf) [![](https://github.com/ashishpatel26/ResourceBank_CV_NLP_MLOPS_2022/blob/main/images/cv_learning_path2.jpg?raw=true)](https://opencv.org/syllabus/cv2-syllabus.pdf) #### Books | Sr.No | Book Name | Link | | ----- | ------------------------------------------------------------ | ------------------------------------------------------------ | | 1 | **Computer Vision: Algorithms and Applications** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://szeliski.org/Book/) | | 2 | **Practical Deep Learning for Cloud, Mobile & Edge** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/gX4tKbD4) | | 3 | **Concise Computer Vision: An Introduction into Theory and Algorithms** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/g2pxMJax) | | 4 | **Computer Vision: Principles, Algorithms, Applications, Learning** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/gukyYGdZ) | | 5 | **Computer Vision: Models, Learning, and Inference** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/gDJ3_dbN) | | 6 | **Deep Learning for Vision Systems** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/gcqya3RJ) | | 7 | **Modern Computer Vision with Pytorch** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/gkY7zWH5) | | 8 | **Multiple View Geometry in Computer Vision** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/g963Hkki) | | 9 | **Learning OpenCV 5 Computer Vision with Python 3** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/gKs-W4h2) | | 10. | **Computer Vision Metrics: Survey, Taxonomy, and Analysis** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://lnkd.in/gGx782es) | #### Articles ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/blog.jpg) | Sr.No | Article Name | Link | | ----- | -------------------------------------------- | ------------------------------------------------------------ | | 1 | Computer Vision: Algorithms and Applications | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 2 | End to End Learning for Self-Driving Cars using python | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)](https://medium.com/@dipeshshtha4/end-to-end-learning-for-self-driving-cars-using-python-c5e8852af3e6) | | 3 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 4 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 5 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 6 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 7 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 8 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 9 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 10 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | #### Video ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/video.jpg) | Sr.No | Video Name | Link | | ----- | ---------- | ------------------------------------------------------------ | | 1 | **Stanford Computer Vision playlist** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLf7L7Kg8_FNxHATtLwDceyh72QQL9pvpQ) | | 2 | **Deep Learning for Computer Vision** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLyqSpQzTE6M_PI-rIz4O1jEgffhJU9GgG) | | 3 | **Computer Vision (Andreas Geiger)** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PL05umP7R6ij35L2MHGzis8AEHz7mg381_) | | 4 | **Deep Learning with PyTorch: Zero to GANs** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLyMom0n-MBroupZiLfVSZqK5asX8KfoHL) | | 5 | **Digital Image Processing** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLqhXzDruUpI-UV7R5nuJ6UcuQgK07AuDE) | | 6 | **Image Signal Processing** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLyqSpQzTE6M-T5ZrthkU763MHKIKCa0sX) | | 7 | **The Geometry of vision** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLyqSpQzTE6M_bepAWap9JE-i9UiO6-y_f) | | 8 | **UCF Computer Vision Video Lectures 2012** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLd3hlSJsX_Imk_BPmB_H3AQjFKZS9XgZm) | | 9 | **CAP5415 Computer Vision - Fall 2021** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLd3hlSJsX_IkXSinyREhlMjFvpNfpazfN) | | 10 | **UCF CRCV** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/c/UCFCRCV/featured) | | 11 | **Stanford Computer Vision** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLf7L7Kg8_FNxHATtLwDceyh72QQL9pvpQ) | | 12 | **Deep Learning for Computer Vision** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLyqSpQzTE6M_PI-rIz4O1jEgffhJU9GgG) | | 13 | **Deep Learning for Computer Vision** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PL5-TkQAfAZFbzxjBHtzdVCWE0Zbhomg7r) | | 14 | **Image Processing with C++** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLG5M8QIx5lkzdGkdYQeeCK__As6sI2tOY) | | 15 | **Full Stack Deep Learning - 2022** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PL1T8fO7ArWleMMI8KPJ_5D5XSlovTW_Ur) | | 16 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)]() | #### Extra Resources ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/extra.jpg) | Sr.No | Resource Name | Link | | ----- | ------------- | ------------------------------------------------------------ | | 1 | **Making Friends with Machine Learning** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PLRKtJ4IpxJpDxl0NTvNYQWKCYzHNuy2xG) | | 2 | **End to End Tutorial on CNN** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=58aFgtQRfhA&ab_channel=SatyajitPattnaik) | | 3 | **Compact GPU Powerhouse** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=ol27l73-NeE&ab_channel=GIGABYTE) | | 4 | **Machine Learning from Scratch - Python Tutoria**ls | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PLqnslRFeH2Upcrywf-u2etjdxxkL8nl7E) | | 5 | **CUDA Crash Course** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PLxNPSjHT5qvtYRVdNN1yDcdSl39uHV_sU) | | 6 | **Object Tracking Using Deep SORT and YOLOv4** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=kBahrCeaoDQ&ab_channel=CodeWithAarohi) | | 7 | **Protecting Your Machine Learning Against Drift** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=tL5sEaQha5o&ab_channel=EuroPythonConference) | | 8 | **LeetCode** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/c/NeetCode/videos) | | 9 | **Mathematics of Data Science** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PLiud-28tsatIKUitdoH3EEUZL-9i516IL) | | 10 | **Modern C++ (2021 Lecture & Tutorials)** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PLgnQpQtFTOGRv7VS6fYerEbT4ckBovKur) | | 11 | **Lecture: Modern C++ (Summer 2018, Uni Bonn)** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PLgnQpQtFTOGR50iIOtO36nK6aNPtVq98C) | | 12 | **Machine Learning** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PL5bUlblGfe0Ljo83LHtrRPXdQAsklFEFB) | | 13 | **Krish naik youtuber** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/user/krishnaik06) | | 14 | **NPTEL MOOC Machine Learning 2016** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PL1xHD4vteKYVpaIiy295pg6_SY5qznc77) | | 15 | **Deep Learning** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PLyqSpQzTE6M9gCgajvQbc68Hk_JKGBAYT) | | 16 | **3Blue1Brown: Calculus** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/playlist?list=PL0-GT3co4r2wlh6UHTUeQsrf3mlS2lk6x) | | 17 | **Learn TensorFlow and Deep Learning fundamentals with Python** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=tpCFfeUEGs8&ab_channel=DanielBourke) | | 18 | **GTC Sept 2022 Keynote with NVIDIA CEO Jensen Huang** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=PWcNlRI00jo&ab_channel=NVIDIA) | | 19 | **ML Model Training and Inference with a Data Mesh** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=3-JwOzqaUDI&ab_channel=SdAmVfGT1K8MnsmuYQby2wJibmeiHnQwVHn) | | 20 | **Attitude-Guided Loop Closure for Cameras with Negative Plane** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://github.com/flysoaryun/LF-VIO-Loop) | | 21 | **CVonline: The Evolving, Distributed, Non-Proprietary, On-Line Compendium of Computer Vision** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://homepages.inf.ed.ac.uk/rbf/CVonline/) | | 22 | **LearnopenCV** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://github.com/spmallick/learnopencv) | | 23 | **Expanding Language-Image Pretrained Models for General Video Recognition** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://github.com/microsoft/VideoX/tree/master/X-CLIP) | | 24 | **Open-Set Semi-Supervised Object Detection** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://ycliu93.github.io/projects/ossod.html) | | 25 | **How To Deal with Dataset Bias** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://youtu.be/nMDpcqx6ll8) | | 26 | ** ** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | ## 📝 NATURAL LANGUAGE PROCESSING<a name = "NLP"></a> --- **Learning Path NLP**: ![img](https://github.com/graykode/nlp-roadmap/raw/master/img/nlp.png) **Credit : [graykode](https://github.com/graykode)** #### Books ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/book.jpg) | Sr.No | Book Name | Link | | ----- | ------------------------------------------------------------ | ------------------------------------------------------------ | | 1 | **Natural Language Processing with Transformers, Revised Edition by Lewis Tunstall, Leandro von Werra, Thomas Wolf** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.oreilly.com/library/view/natural-language-processing/9781098136789/)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/nlp-with-transformers/notebooks) | | 2 | **Natural Language Processing with PyTorch Book by Brian McMahan and Delip Rao** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.oreilly.com/library/view/natural-language-processing/9781491978221/)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/delip/PyTorchNLPBook) | | 3 | **Transformers for Natural Language Processing by Denis Rothman, Antonio Gulli** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.packtpub.com/product/transformers-for-natural-language-processing/9781803247335?_ga=2.7871282.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/Denis2054/Transformers-for-NLP-2nd-Edition) | | 4 | **Mastering Transformers by Savaş Yıldırım , Meysam Asgari-Chenaghlu** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.packtpub.com/product/mastering-transformers/9781801077651?_ga=2.48763430.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/Mastering-Transformers) | | 5 | **Advanced Natural Language Processing with TensorFlow 2 by Ashish Bansal** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://subscription.packtpub.com/book/data/9781800200937/pref)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://account.packtpub.com/getfile/9781800200937/code#_ga=2.6058163.1232780291.1663736855-925719957.1663736855) | | 6 | **Python Natural Language Processing Cookbook By Zhenya Antić** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.packtpub.com/product/python-natural-language-processing-cookbook/9781838987312?_ga=2.3481136.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/Python-Natural-Language-Processing-Cookbook) | | 7 | **Getting Started with Google BERT By Sudharsan Ravichandiran** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.packtpub.com/product/getting-started-with-google-bert/9781838821593?_ga=2.179296420.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/Getting-Started-with-Google-BERT) | | 8 | **Exploring GPT-3 By Steve Tingiris** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg) ](https://www.packtpub.com/product/exploring-gpt-3/9781800563193?_ga=2.253722505.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/Exploring-GPT-3) | | 9 | **Applied Natural Language Processing in the Enterprise by Ankur A. Patel, Ajay Uppili Arasanipalai** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.oreilly.com/library/view/applied-natural-language/9781492062561/)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/nlpbook/nlpbook) | | 10 | **Natural Language Processing in Action, Second Edition by Hobson Lane and Maria Dyshel** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.manning.com/books/natural-language-processing-in-action-second-edition)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/totalgood/nlpia) | #### Articles ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/blog.jpg) | Sr.No | Article Name | Link | | ----- | -------------------------------------------- | ------------------------------------------------------------ | | 1 | Computer Vision: Algorithms and Applications | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 2 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 3 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 4 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 5 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 6 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 7 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 8 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 9 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 10 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | #### Video ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/video.jpg) | Sr.No | Video Name | Link | | ----- | ---------- | ------------------------------------------------------------ | | 1 | Natural Language Processing (University of Michigan) | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLLssT5z_DsK8BdawOVCCaTCO99Ya58ryR) | | 2 | Stanford CS224N NLP with Deep Learning | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLoROMvodv4rOSH4v6133s9LFPRHjEmbmJ) | | 3 | Chatbot by Binod Suman Academy | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLIRnO_sdVuEevLMSy7bE-Jaqyf1MK_wtr) | | 4 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)]() | | 5 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)]() | | 6 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)]() | | 7 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)]() | | 8 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)]() | | 9 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)]() | | 10 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)]() | #### Extra Resources ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/extra.jpg) | Sr.No | Resource Name | Link | | ----- | ------------- | ------------------------------------------------------------ | | 1 | Designing an ML Minded Product | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=Hv54e-9XnZ0&ab_channel=AssociationforComputingMachinery%28ACM%29) | | 2 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | | 3 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | | 4 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | | 5 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | ## 👨‍💻 MLOPS<a name = "MLOPS"></a> --- ![MLOps Principles](https://ml-ops.org/img/mlops-phasen.jpg) **Credit : ML-ops.org** #### Books ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/book.jpg) | Sr.No | Book Name | Link | | ----- | ------------------------------------------------------------ | ------------------------------------------------------------ | | 1 | **Engineering MLOps: By Emmanuel Raj** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.packtpub.com/product/engineering-mlops/9781800562882)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/EngineeringMLOps) | | 2 | **Machine Learning Design Patterns Book by Michael Munn, Sara Robinson, and Valliappa Lakshmanan** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.oreilly.com/library/view/machine-learning-design/9781098115777/)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/GoogleCloudPlatform/ml-design-patterns) | | 3 | **Designing Machine Learning Systems Book by Chip Huyen** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.oreilly.com/library/view/designing-machine-learning/9781098107956/)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/chiphuyen/machine-learning-systems-design) | | 4 | **Practical MLOps by Noah Gift, Alfredo Deza** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.oreilly.com/library/view/practical-mlops/9781098103002/)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/paiml/practical-mlops-book) | | 5 | **MLOps Engineering at Scale Book by Carl Osipov** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.manning.com/books/mlops-engineering-at-scale)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://www.manning.com/downloads/2158) | | 6 | **Machine Learning on Kubernetes by Faisal Masood, Ross Brigoli** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.packtpub.com/product/machine-learning-on-kubernetes/9781803241807?_ga=2.220534680.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/Machine-Learning-on-Kubernetes) | | 7 | **Machine Learning Engineering with MLflow By Natu Lauchande** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.packtpub.com/product/machine-learning-engineering-with-mlflow/9781800560796?_ga=2.40907298.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/Machine-Learning-Engineering-with-MLflow) | | 8 | **Machine Learning Engineering with Python By Andrew P. McMahon** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg) ](https://www.packtpub.com/product/machine-learning-engineering-with-python/9781801079259?_ga=2.48765478.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/Machine-Learning-Engineering-with-Python) | | 9 | **Kubeflow for Machine Learning by Trevor Grant, Holden Karau, Boris Lublinsky, Richard Liu, Ilan Filonenko** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.oreilly.com/library/view/kubeflow-for-machine/9781492050117/)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://oreil.ly/Kubeflow_for_ML) | | 10. | **Production-Ready Applied Deep Learning By Tomasz Palczewski , Jaejun (Brandon) Lee , Lenin Mookiah** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/book_link.jpg)](https://www.packtpub.com/product/production-ready-applied-deep-learning/9781803243665?_ga=2.238320512.1232780291.1663736855-925719957.1663736855)[![img](https://raw.githubusercontent.com/ashishpatel26/Treasure-of-Transformers/main/images/git.jpg)](https://github.com/PacktPublishing/Production-Ready-Applied-Deep-Learning) | #### Articles ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/blog.jpg) | Sr.No | Article Name | Link | | ----- | ------------ | ------------------------------------------------------------ | | 1 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 2 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 3 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 4 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 5 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 6 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 7 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 8 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 9 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | | 10 | | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/bloglink.jpg)]() | #### Video ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/video.jpg) | Sr.No | Video Name | Link | | ----- | ---------- | ------------------------------------------------------------ | | 1 | **MLOps Zoomcamp** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PL3MmuxUbc_hIUISrluw_A7wDSmfOhErJK) | | 2 | **Machine Learning Engineering for Production (MLOps) Specialization by Andrew Ng** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLVd1sFtZgLA7gPFPB8nPVEgOG1a5BkmSR) | | 3 | **Docker Tutorial in Hindi 2022** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLfP3JxW-T70HIvqQpoDpP-WK-uzD-wnsH) | | 4 | **CS 329S: Machine Learning Systems Design** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://stanford-cs329s.github.io/syllabus.html) | | 5 | **Full Stack Deep Learning 2019** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://fall2019.fullstackdeeplearning.com/) | | 6 | **MLOps - Machine Learning Operations** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PL3N9eeOlCrP5a6OA473MA4KnOXWnUyV_J) | | 7 | **MLOps: ML Deployment 2020** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLzq3B7Hh4uvbe9xXXEa1EuawIXTDHZpg1) | | 8 | **Mlops Live Webinar** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLH8M0UOY0uy4qzau2iAFunuT6cTMmTHvB) | | 9 | **Azure MLops** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLB1nTQo4_y6sMCAjWpAfEfXjC_t-7LeUm) | | 10 | **MLOps by Pragmatic AI Labs** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PLdfopzFjkPz9shHCeH9poe9sbAn0pIojX) | | 11 | **MLops Tutorial by DVC.org** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/playlist?list=PL7WG7YrwYcnDBDuCkFbcyjnZQrdskFsBz) | | 12 | **Kubernetes Tutorial for Beginners [FULL COURSE in 4 Hours]** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/watch?v=X48VuDVv0do&ab_channel=TechWorldwithNana) | | 13 | **Docker Tutorials For Beginner - 2 Million view** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/videolink.jpg)](https://www.youtube.com/watch?v=fqMOX6JJhGo&ab_channel=freeCodeCamp.org) | #### Extra Resources ![](https://raw.githubusercontent.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/main/images/extra.jpg) | Sr.No | Resource Name | Link | | ----- | --------------------------------------- | ------------------------------------------------------------ | | 1 | **Awesome MLops** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://github.com/visenger/awesome-mlops) | | 2 | **MadewithML** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://madewithml.com/#mlops) | | 3 | **Awesome Production Machine learning** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://github.com/EthicalML/awesome-production-machine-learning) | | 4 | **MLOps - Best Blog(Neptune.ai)** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://neptune.ai/blog) | | 5 | **OPERATIONALIZING MACHINE LEARNING** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://chicagodatascience.github.io/MLOps/) | | 6 | **Practical Guide of MLOps by Google** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://cloud.google.com/resources/mlops-whitepaper) | | 7 | **Awesome MLOps Guide Tools** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://github.com/kelvins/awesome-mlops) | | 8 | **MLops Blogs by MLOps BootCamp** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://kargarisaac.github.io/blog/categories/#mlops) | | 9 | **FedML MLOps Introduction** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)](https://www.youtube.com/watch?v=Xgm0XEaMlVQ&ab_channel=ChaoyangHe) | | 10 | ** ** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | | 11 | ** ** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | | 12 | ** ** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | | 13 | ** ** | [![](https://github.com/ashishpatel26/Resources_Bank_CV_NLP_MLops/raw/main/images/extralink.jpg)]() | --- ***🙏 Thanks for Reading 🙏 More is coming stay tune ⛹️‍♂️***

Education & Learning

422 Github Stars