Diffusion Models for Content Creation and Perceptron

Flash Attentions (KOR) #attention #transformer

Efficient LLMs with more data & instruct based LLMs (KOR) #llm #gpt #chatgpt

Orca:Progressive Learning from Complex Explanation Traces of GPT-4 - Minho Park at Neubla (KOR) #LLM

Adapting Language Models to Compress Contexts - Raegeun Park at Neubla (KOR) #llm #transformer

Neubla UK

ZeroQuant Series - Jinsol Kim at Neubla (KOR) #DeepSpeed #Quantization #LLM #Transformer #ZeroQuant

Minimizing Reconstruction Error for Low Bit PTQ

Serving Heterogeneous Machine Learning Models on Multi-GPU Servers with Spatio-Temporal Sharing

Kernel Fusion in OpenCL

Orca: A Distributed Serving System for Transformer-Based Generative Models

Triton: An Intermediate Language and Compiler for Tiled Neural Network Computations

Scaling Laws for Neural Language Models and Quantization #chatgpt #languagemodel #transformers

Time Series Analysis #timeseries #datascience

Timeloop: A Systematic Approach to DNN Accelerator Evaluation #accelerator #deeplearning

SEDONA: Search For Decoupled Neural Networks Toward Greedy Block-wise Learning #training

The Forward-Forward Algorithm: Some Preliminary Investigations #backpropagation #training

Make-A-Video: Text-to-Video Generation without Text-Video Data #videoclip #clip #multimodal

(Stable Diffusion) High-Resolution Image Synthesis with Latent Diffusion Models #diffusion

(CLIP) Learning Transferable Visual Models From Natural Language Supervision #clip #multimodal

Singularity: Planet-Scale, Preemptive and Elastic Scheduling of AI Workloads #scheduler

Attention is All You Need #transformers #attention

Learning to see in the dark #denoising #deeplearning #lowlight

Understanding Data Storage and Ingestion for Large-Scale Deep Recommendation Model Training

Mastering the game of Go with deep neural networks and tree search #alphago #reinforcementlearning