AI DIGEST #MAY20

By Alisher Abdulkhaev and Suzana Ilić

Issue #11: April 2020

  • GameGAN: NVIDIA recreates PAC-MAN
  • ACL 2020 announced accepted papers
  • NVIDIA released a new GPU: A100
  • Hugging Face models’ performance visualization
  • The Big Bad NLP Database
  • OSS release of pytorch-pfn-extras
  • New website for Keras has been launched
  • Reinforcement Learning with Augmented Data (RAD)
  • CNN Explainer

GameGAN: NVIDIA recreates PAC-MAN

GameGAN, a generative adversarial network trained on 50,000 PAC-MAN episodes, produces a fully functional version of the dot-munching classic without an underlying game engine.

ACL 2020 announced accepted papers

The 2020 Annual Conference of the Association for Computational Linguistics (ACL) announced this year’s accepted papers. 571 Long Papers and 208 Short Papers out of 3,088 submissions were accepted, an acceptance rate of 25.2 % this year. Originally scheduled to be held in Seattle, USA, ACL 2020 will be a virtual conference held online from July 5 to 10, due to COVID-19. Source

NVIDIA released a new GPU: A100

NVIDIA unveiled a new GPU at GTC 2020 Keynote: NVIDIA GTX A100. A100 is the world’s first 5 petaflops system that packages the power of an entire data center into a unified platform for AI training, inference, and analytics. NVIDIA GTX A100 has:

  • 40GB of VRAM
  • 6912 FP32 CUDA cores
  • 54.2 Billion transistors
  • INT8 OPs (624 TOPs) which is the first time we see this in NVIDIA GPUs.

Source | GTC 2020 Keynote

Hugging Face models’ performance visualization

Hugging Face and Weights & Biases published a python notebook on how to visualize s psrticular Hugging Face model performance. You can compare hyperparameters, output metrics, and system stats like GPU utilization across your models.

W&B is like GitHub for machine learning models— save machine learning experiments to your private, hosted dashboard. Experiment quickly with the confidence that all the versions of your models are saved for you, no matter where you’re running your scripts.

Step-by-step guide | Google Colab notebook

The Big Bad NLP Database

The Big Bad NLP Database contains more than 400 NLP related datasets spanning multiple languages and different tasks. It is managed by Quantum Stat. If you are working and NLP tasks and are seeking for datasets you may want to check it out.

The Big Bad NLP Database | Quantum Stat

OSS release of pytorch-pfn-extras

The Tokyo-based AI Startup Preferred Networks released pytorch-pfn-extras, an open-source library that supports research and development in deep learning using PyTorch. The new library is part of PFN’s ongoing effort to strengthen its ties with the PyTorch developer community as well as Optuna™, the open-source hyperparameter optimization framework for machine learning, which recently joined the PyTorch Ecosystem.

Source: PFN

Keras’s new website has been launched

Keras is an API designed for human beings, not machines. Keras follows best practices for reducing cognitive load: it offers consistent & simple APIs, it minimizes the number of user actions required for common use cases, and it provides clear & actionable error messages. It also has extensive documentation and developer guides.

Now, Keras has a new website, which includes a 100% refreshed list of developer guides and code examples.

Reinforcement Learning with Augmented Data

UC Berkeley, BAIR released RAD – Reinforcement Learning with Augmented Data (Michael Laskin, Kimin Lee*, Adam Stooke, Lerrel Pinto, Pieter Abbeel, Aravind Srinivas).

“We perform the first extensive study of image augmentation in the RL setting and show, surprisingly, that simple RL algorithms with augmented data achieve state-of-the-art results for data-efficiency on DeepMind control and test-time generalization on OpenAI ProcGen environments.”

CNN Explainer

CNN Explainer is an interactive visualization tool to learn, interpret and visualize CNN networks. It runs a pre-trained CNN in the browser. The CNN Explainer was created by Jay Wang, Robert Turko, Omar Shaikh, Haekyu Park, Nilaksh Das, Fred Hohman, Minsuk Kahng, and Polo Chau, which was the result of a research collaboration between Georgia Tech and Oregon State.

Leave a Reply