Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:1706.03762

A collection of arXiv papers from Chip Huyen's AI Engineering organized by chapter and ordered by when each appears in the book.

Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning

Paper • 2211.04325 • Published Oct 26, 2022 • 1
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 32
On the Opportunities and Risks of Foundation Models

Paper • 2108.07258 • Published Aug 16, 2021 • 2
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

Paper • 2204.07705 • Published Apr 16, 2022 • 2

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

250 Years of America, 250 Open AI Milestones

For the 250th birthday of the USA: the 250 most important American open models, datasets, papers and Spaces, ranked from #1 down. Happy 4th of July!

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133
PyTorch: An Imperative Style, High-Performance Deep Learning Library

Paper • 1912.01703 • Published Dec 3, 2019 • 2
google-bert/bert-base-uncased

Fill-Mask • 0.1B • Updated Feb 19, 2024 • 95.2M • • 2.71k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 14M • 3.37k

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Paper • 2006.03654 • Published Jun 5, 2020 • 3
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 32
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Paper • 1907.11692 • Published Jul 26, 2019 • 10
Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

Natural Language Processing and Large Language Models 💬

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

Paper • 1406.1078 • Published Jun 3, 2014 • 1
Distributed Representations of Sentences and Documents

Paper • 1405.4053 • Published May 16, 2014
Sequence to Sequence Learning with Neural Networks

Paper • 1409.3215 • Published Sep 10, 2014 • 4
Neural Machine Translation by Jointly Learning to Align and Translate

Paper • 1409.0473 • Published Sep 1, 2014 • 7

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133
LoRA: Low-Rank Adaptation of Large Language Models

Paper • 2106.09685 • Published Jun 17, 2021 • 64

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

Paper • 2205.14135 • Published May 27, 2022 • 15
Efficient Memory Management for Large Language Model Serving with PagedAttention

Paper • 2309.06180 • Published Sep 12, 2023 • 63
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

Paper • 2307.08691 • Published Jul 17, 2023 • 9

#LLM_foundations

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

A collection of arXiv papers from Chip Huyen's AI Engineering organized by chapter and ordered by when each appears in the book.

Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning

Paper • 2211.04325 • Published Oct 26, 2022 • 1
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 32
On the Opportunities and Risks of Foundation Models

Paper • 2108.07258 • Published Aug 16, 2021 • 2
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

Paper • 2204.07705 • Published Apr 16, 2022 • 2

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133
LoRA: Low-Rank Adaptation of Large Language Models

Paper • 2106.09685 • Published Jun 17, 2021 • 64

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

Paper • 2205.14135 • Published May 27, 2022 • 15
Efficient Memory Management for Large Language Model Serving with PagedAttention

Paper • 2309.06180 • Published Sep 12, 2023 • 63
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

Paper • 2307.08691 • Published Jul 17, 2023 • 9

250 Years of America, 250 Open AI Milestones

For the 250th birthday of the USA: the 250 most important American open models, datasets, papers and Spaces, ranked from #1 down. Happy 4th of July!

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133
PyTorch: An Imperative Style, High-Performance Deep Learning Library

Paper • 1912.01703 • Published Dec 3, 2019 • 2
google-bert/bert-base-uncased

Fill-Mask • 0.1B • Updated Feb 19, 2024 • 95.2M • • 2.71k
openai-community/gpt2

Text Generation • 0.1B • Updated Feb 19, 2024 • 14M • 3.37k

#LLM_foundations

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Paper • 2006.03654 • Published Jun 5, 2020 • 3
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Paper • 1810.04805 • Published Oct 11, 2018 • 32
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Paper • 1907.11692 • Published Jul 26, 2019 • 10
Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

Natural Language Processing and Large Language Models 💬

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

Paper • 1406.1078 • Published Jun 3, 2014 • 1
Distributed Representations of Sentences and Documents

Paper • 1405.4053 • Published May 16, 2014
Sequence to Sequence Learning with Neural Networks

Paper • 1409.3215 • Published Sep 10, 2014 • 4
Neural Machine Translation by Jointly Learning to Align and Translate

Paper • 1409.0473 • Published Sep 1, 2014 • 7

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 133

Previous
1
2
3
...
11
Next

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs