Digest 2021-11 # ML / Papers Predicting Spreadsheet Formulas from Semi-structured Contexts - ai.googleblog.com/2021/10…rom.html ruDALL-E: генерируем изображения по текстовому описанию, или Самый большой вычислительный проект в России - habr.com/ru/comp…g/586926 AI voice-acting tool xVASynth gets even better at recreating videogame voices - www.pcgamer.com/ai-voic…e-voices GPT-3 is No Longer the Only Game in Town - lastweekin.ai/p/gpt-3…nly-game Accelerating PyTorch with CUDA Graphs - pytorch.org/blog/ac…a-graphs Model Ensembles Are Faster Than You Think - ai.googleblog.com/2021/11…you.html Self-Supervised Learning Advances Medical Image Classification - ai.googleblog.com/2021/10…ces.html MetNet-2: Deep Learning for 12-Hour Precipitation Forecasting - ai.googleblog.com/2021/11…our.html Predicting Text Readability from Scrolling Interactions - ai.googleblog.com/2021/11…rom.html Decisiveness in Imitation Learning for Robots - ai.googleblog.com/2021/11…for.html Paper Review: Swin Transformer V2 Scaling Up Capacity and Resolution - andlukyane.com//blog/p…-swin-v2 Explain Yourself - A Primer on ML Interpretability & Explainability - https://thegradient.pub/explain-yourself/ SimVLM: Simple Visual Language Model Pre-training with Weak Supervision - ai.googleblog.com/2021/10…pre.html Predicting Text Selections with Federated Learning - ai.googleblog.com/2021/11…ith.html The Inherent Limitations of GPT-3 - lastweekin.ai/p/the-i…of-gpt-3 Turing Bletchley: A Universal Image Language Representation model by Microsoft - www.microsoft.com/en-us/r…icrosoft - Encoder-decoder - Trained using billions of image-caption pairs drawn from the web - Parallel corpus of 500 million translation pairs - Pairs were created by extracting sentences from document-aligned webpages from common crawl corpus - Transformer-based image and text encoders which are both analogous to the BERT-large architecture #digest