nanochat miniseries v1

2026-01-07

The Personal Panoptican

2026-01-07

ChatGPT Health and what AI can do for a broken system

2026-01-07

The Final Offshoring

2026-01-07

Why did AMD’s random number generator start returning 0x0000?

2026-01-07

RL Environments and RL for Science: Data Foundries and Multi-Agent Architectures

2026-01-07

A4 Paper Stories

2026-01-07

do what you love and you'll hate what you love

2026-01-06

Closing the capability gap between frontier AI and everyday use in 2026

2026-01-05

Standing Out

2026-01-05

Ralph Wiggum as a "software engineer"

2026-01-05

It’s hard to justify Tahoe icons

2026-01-05

There’s more to mathematics than rigour and proofs

2026-01-05

2025 letter

2026-01-04

The Bitter Lessons

2026-01-04

The gap between a Helpful Assistant and a Senior Engineer

2026-01-04

where good ideas come from (for coding agents)

2026-01-04

‘Chinese Peptides’ Are the Latest Biohacking Trend in the Tech World

2026-01-03

Humans of Structured Taste

2026-01-02

Scaling agents

2026-01-02

Not For Human Consumption

2026-01-02

A rationalist’s guide to manifestation

2026-01-01

2025: The year in LLMs

2026-01-01

Reflections on 2025

2026-01-01

How AI Labs Are Solving the Power Crisis: The Onsite Gas Deep Dive

2025-12-31

entering my ROCK ERA

2025-12-31

batteries

2025-12-31

Capital in the 22nd Century

2025-12-31

You will be OK

2025-12-31

Turning 20 while the world turns upside-down

2025-12-31

Favourite Papers of 2025

2025-12-31

2025 letter

2025-12-31

The Electric Slide

2025-12-31

The Bayesian Geometry of Transformer Attention

2025-12-30

Times New American: A Tale of Two Fonts

2025-12-30

When someone says they hate your product with a burning passion

2025-12-29

What Does Information Theory Say About Designing Agentic Systems?

2025-12-29

Neural network training makes beautiful fractals

2025-12-29

Shipping at Inference-Speed

2025-12-29

I unplugged my router for 12 hours

2025-12-29

A Guide to Claude Code 2.0 and getting better at using coding agents

2025-12-28

San Francisco Identities

2025-12-28

Links for Winter 2026

2025-12-28

The Prison of Financial Mediocrity

2025-12-28

Publishing your work increases your luck

2025-12-28

Rethinking Thinking Tokens: LLMs as Improvement Operators

2025-12-27

A Call for New Aesthetics

2025-12-27

Compound Engineering: How Every Codes With Agents

2025-12-26

You should probably post more

2025-12-26

Why did Nvidia acqui-hire Groq?

2025-12-26

2025

2025-12-26

2025 reflections

2025-12-26

LFM2 Technical Report

2025-12-26

How We Exploited CodeRabbit: From a Simple PR to RCE and Write Access on 1M Repositories

2025-12-26

Creating General User Models from Computer Use

2025-12-26

How Well Does RL Scale?

2025-12-25

Most Algorithmic Progress is Data Progress

2025-12-25

Thoughts on AI progress (Dec 2025)

2025-12-25

The Final Offshoring

2025-12-25

Does It Help to Know History?

2025-12-25

Poison Fruit

2025-12-25

Command Line Interface Guidelines

2025-12-25

Improving Cursor Tab with online RL

2025-12-24

The Company Man

2025-12-24

RL's Deadly Triad Meets Optimization

2025-12-24

Waymo’s Gemini system prompt

2025-12-23

How to be more agentic

2025-12-23

Better Blog Design

2025-12-23

Interface Anxiety

2025-12-23

Test, don't (just) verify

2025-12-23

Predictions for 2026

2025-12-23

Steam, Steel, and Infinite Minds

2025-12-23

Open sourcing a more precise time appliance

2025-12-23

This life gives you nothing

2025-12-23

We removed 80% of our agent’s tools

2025-12-22

What I would do if I was 18 now

2025-12-22

MSCHF

2025-12-22

Training the Idea Muscle

2025-12-22

Scaling LLMs to larger codebases

2025-12-22

Logging Sucks

2025-12-21

Backing up Spotify

2025-12-21

2025 LLM Year in Review

2025-12-20

Simon Corry on How to Hire in the AI Era

2025-12-20

Why is South Korean fertility so low?

2025-12-19

Inventing the near future

2025-12-19

you have all these rules, and you think they'll save you

2025-12-19

Frankenstein's Holiday Guide to Personal Branding

2025-12-19

Your job is to deliver code you have proven to work

2025-12-18

All I Want for Christmas Are Unregulated Chinese Peptides

2025-12-18

How we pwned X (Twitter), Vercel, Cursor, Discord, and hundreds of companies through a supply-chain attack

2025-12-18

Redacted by Counsel: A supply chain postmortem

2025-12-18

how to hack discord, vercel and more with one easy trick

2025-12-18

The ability to choose

2025-12-18

The inner world

2025-12-18

How we wrote the prompts behind Granola's Crunched 2025

2025-12-17

Contra DSPy and GEPA

2025-12-17

Prediction: AI will make formal verification go mainstream

2025-12-16

Advent of Code 2025 with AI

2025-12-16

Liar's Valuation

2025-12-16

Why Have Sentence Lengths Decreased?

2025-12-16

Why use an ontology for text-to-sql?

2025-12-15

Economics of Orbital vs. Terrestrial Data Centers

2025-12-15

Sharp Monocular View Synthesis in Less Than a Second

2025-12-15

ChinaRxiv

2025-12-15

Making Sense of React Server Components

2025-12-13

Coding Agents & Complexity Budgets

2025-12-12

YOU NEED MORE LUX

2025-12-12

Build education machines

2025-12-12

The highest quality codebase

2025-12-11

OpenAI Supply Co.

2025-12-11

A visual editor for the Cursor Browser

2025-12-11

Distilling the Knowledge in a Neural Network

2025-12-09

Demonstrably Safe AI For Autonomous Driving

2025-12-09

If You’re Going to Vibe Code, Why Not Do It in C?

2025-12-09

The Heisenbug lurking in your async code

2025-12-08

An Interactive Guide To The Fourier Transform

2025-12-07

Website Inspo

2025-12-07

The binding problem

2025-12-06

Perpetual futures, explained

2025-12-05

AV1 — Now Powering 30% of Netflix Streaming

2025-12-04

Kings and Electors

2025-12-04

TSMC Overseas Fabs – A Success?

2025-12-03

Getting from tested to battle-tested

2025-12-03

Inside ThunderKittens' Python Bindings

2025-12-03

Claude 4.5 Opus' Soul Document

2025-12-02

An Intermittent Podcast Strategy Doc

2025-12-01

Titles

2025-11-30

Bikeshedding, or why I want to build a laptop

2025-11-29

Things to buy

2025-11-28

Google TPUv7: The 900lb Gorilla In the Room

2025-11-28

Antimatter Development Program

2025-11-26

Effective harnesses for long-running agents

2025-11-26

How I Use Claude Code on My Phone with Termux and Tailscale

2025-11-26

Genesis Mission

2025-11-25

We're moving from the age of scaling to the age of research

2025-11-25

My Experience using Tinker

2025-11-24

Screen As Room: An Architectural Perspective on User Interfaces

2025-11-24

LLMs can invent their own compression

2025-11-24

Commit Mono

2025-11-24

Departure Mono

2025-11-24

Fran Sans Essay

2025-11-23

The realities of being a pop star

2025-11-23

Shaders

2025-11-23

From shortcuts to sabotage: natural emergent misalignment from reward hacking

2025-11-23

Jmail

2025-11-21

Where Soil is Holy, and Climate Change Is Seldom Mentioned

2025-11-19

Offrange

2025-11-19

Questions for Cloudflare

2025-11-19

A broken pricing paradigm

2025-11-18

Do Not Put Your Site Behind Cloudflare if You Don't Need To

2025-11-18

Why I Spent a Week on a 10-Line Code Change

2025-11-17

WeatherNext 2

2025-11-17

Dark Pattern Games

2025-11-16

Kosmos: An AI Scientist for Autonomous Discovery

2025-11-16

AI World Clocks

2025-11-14

Pre and Post Training Data Vendors

2025-11-13

A World of Automatable Domains

2025-11-13

Android Dreams

2025-11-13

Zed Is Our Office

2025-11-13

Startup Operating Principles

2025-11-11

Patchwork: Version control for everything

2025-11-11

SF Personals

2025-11-10

Prison Map

2025-11-10

Discrete Structures for Computer Science

2025-11-10

Spatial Intelligence is AI’s Next Frontier

2025-11-10

Optical effects in user interfaces

2025-11-10

The Manuscripts of Edsger W. Dijkstra

2025-11-09

Angel Investors, A Field Guide

2025-11-07

Improving agent with semantic search

2025-11-07

Inside Cursor

2025-11-06

Intelligent robotics: the new era of physical AI

2025-11-05

How we built OWL, the new architecture behind our ChatGPT-based browser, Atlas

2025-11-04

Thoughts by a non-economist on AI and economics

2025-11-04

Please just tell me what you do

2025-11-04

The Continual Learning Problem

2025-11-03

streaming halloween

2025-11-03

The Hidden Cost of URL Design

2025-11-02

Your URL Is Your State

2025-11-02

21 Facts About Throwing Good Parties

2025-11-02

Defeating the Training-Inference Mismatch via FP16

2025-11-01

Ghosts in the Codex Machine

2025-11-01

Standing Invitation

2025-10-31

The ear does not do a Fourier transform

2025-10-30

Introducing Aardvark: OpenAI’s agentic security researcher

2025-10-30

Free software scares normal people

2025-10-30

The Math Mode Problem

2025-10-30

Board

2025-10-29

How to Kill 2 Monopolies with 1 Tool

2025-10-29

Composer: Building a fast frontier model with RL

2025-10-29

Emergent introspective awareness in large language models

2025-10-29

SF Privately Owned Public Open Spaces

2025-10-28

If you don't tinker, you don't have taste

2025-10-28

Gossip is Good

2025-10-28

Why study math? Is it even useful?

2025-10-27

On-Policy Distillation

2025-10-27

More Than DNS: The 14 hour AWS us-east-1 outage

2025-10-27

Bookshelf · Patrick Collison

2025-10-26

Burning out

2025-10-26

Stress-Testing Model Specs Reveals Character Differences among Language Models

2025-10-26

Curated Supply

2025-10-25

What Are Elliptic Curve Pairings?

2025-10-24

Blackbox Model Provenance via Palimpsestic Membership Inference

2025-10-24

192 Weeks

2025-10-24

Laws of Tech: Commoditize Your Complement

2025-10-22

Detecting Adversarial Fine-tuning with Auditing Agents

2025-10-22

My Antichrist Lecture

2025-10-22

How Starcloud Is Bringing Data Centers to Outer Space

2025-10-21

LLMs Can Get "Brain Rot"!

2025-10-21

Build Your Own Database

2025-10-21

A Linear spin on Liquid Glass

2025-10-21

AI trading in real markets

2025-10-21

How To Scale

2025-10-21

Lexiconic

2025-10-20

Production RAG: what I learned from processing 5M+ documents

2025-10-20

BERT is just a Single Text Diffusion Step

2025-10-20

The 24 Hour Life

2025-10-18

Will AI Resist Your Efforts To Change Its Totally Fake Values?

2025-10-14

Joshua Kushner, Thrive Capital, and the American dream

2025-10-13

Vibing a Non-Trivial Ghostty Feature

2025-10-11

InferenceMAX by SemiAnalysis

2025-10-09

Subway Builder

2025-10-09

Animated Sign-In Dialog

2025-10-08

The future of AI is already written

2025-10-07

Vibe engineering

2025-10-07

Generating sortable Stripe-like IDs with Segment's KSUIDs

2025-10-07

AI and the Technological Richter Scale

2025-10-07

Hashcards: A Plain-Text Spaced Repetition System

2025-10-06

Frequently Asked Questions (And Answers) About AI Evals

2025-10-06

Indefinite Backpack Travel

2025-10-06

ALIGNMENT

2025-10-05

Memory access is O(N^[1/3])

2025-10-05

How Not To Sort By Average Rating

2025-10-03

Building the heap: racking 30 petabytes of hard drives for pretraining

2025-10-02

On The Vital Question by Nick Lane

2025-10-01

Tinker: a training API for researchers

2025-10-01

Sora 2

2025-09-30

LoRA Without Regret

2025-09-29

The QMA Singularity

2025-09-29

When I say "alphabetical order", I mean "alphabetical order"

2025-09-28

Failing to Understand the Exponential, Again

2025-09-28

Typst: a possible LaTeX replacement

2025-09-27

SimpleFold: Folding Proteins is Simpler than You Think

2025-09-26

What Philosophy Is Good For

2025-09-26

Modular Manifolds

2025-09-26

Becoming a Research Engineer at a Big LLM Lab

2025-09-25

Slack is extorting us with a $195k/yr bill increase

2025-09-25

How to make an antibody

2025-09-25

Why we committed to a zero-bugs policy

2025-09-24

A new (or rather, old) approach to typography on the web

2025-09-24

Stop trying to get preempted

2025-09-24

Find My Parking Cops

2025-09-23

ssh-hypervisor: "SimCity for VMs"

2025-09-22

Why Local-First Apps Haven’t Become Popular?

2025-09-22

Unified Line and Paragraph Detection by Graph Convolutional Networks

2025-09-21

I'm Not a Robot

2025-09-20

Web Interface Guidelines

2025-09-20

ETAI course materials

2025-09-19

How to computer better

2025-09-19

Founder as Prophet, Founder as Priest

2025-09-19

Cluely Thesis on Virality and Hype

2025-09-19

Writing a Hypervisor in 1,000 Lines

2025-09-18

A postmortem of three recent issues \ Anthropic

2025-09-17

Inside Modal Notebooks: How we built a cloud GPU notebook that boots in seconds

2025-09-16

Hosting a Website on a Disposable Vape

2025-09-15

APIs as ladders

2025-09-13

UTF-8 is a Brilliant Design

2025-09-12

Many Hard Leetcode Problems are Easy Constraint Problems

2025-09-12

Writing effective tools for LLM agents

2025-09-11

Behind The Scenes of Bun Install

2025-09-11

Defeating Nondeterminism in LLM Inference

2025-09-10

Real-Time Detection of Hallucinated Entities in Long-Form Generation

2025-09-09

The Training Imperative

2025-09-09

Formatting code should be unnecessary

2025-09-07

You Don't Need Animations

2025-09-04

Almost anything you give sustained attention to will begin to loop on itself and bloom

2025-09-04

Making Minecraft Spherical

2025-09-01

Adaptive LLM Routing under Budget Constraints

2025-09-01

Draw a fish

2025-08-31

No Clicks, No Content: The Unsustainable Future of AI Search

2025-08-31

Cognitive Load is what matters

2025-08-31

mess with dns

2025-08-30

Do the simplest thing that could possibly work

2025-08-29

A Clock That Doesn't Snap

2025-08-27

Breakneck: China's Quest to Engineer the Future

2025-08-26

A visual introduction to Big O notation

2025-08-25

How To Scale Your Model

2025-08-25

Abridged notes on the LLM scaling book

2025-08-25

Colf

2025-08-25

What is a color space?

2025-08-25

Materialized views are obviously useful

2025-08-23

What makes Claude Code so damn good

2025-08-23

What are OKLCH colors?

2025-08-21

Weaponizing image scaling against production AI systems

2025-08-21

Moving Objects in 3D Space

2025-08-20

3 weeks to live

2025-08-19

How We Exploited CodeRabbit: From a Simple PR to RCE and Write Access on 1M Repositories

2025-08-19

Tiny TPU

2025-08-19

Who Cares If It's Been Tried Before?

2025-08-19

Frequently Asked Questions (And Answers) About AI Evals

2025-08-19

Susam Pal

2025-08-19

Prime Grid

2025-08-19

tokens are getting more expensive

2025-08-19

THE DONALD BOAT STORY

2025-08-19

How the jax.jit() JIT compiler works in jax-js

2025-08-17

LL3M: Large Language 3D Modelers

2025-08-17

Why you can't get a job

2025-08-13

Supercell Case Study

2025-08-13

all text in nyc

2025-08-13

How Does A Blind Model See The Earth?

2025-08-11

Engineering.fyi - Latest Tech Articles from Top Companies

2025-08-10

Retention is all you need

2025-08-07

No One is Really Working

2025-08-06

Genie 3: A new frontier for world models

2025-08-05

Open models by OpenAI

2025-08-05

Effective system design requires insights drawn from serious contexts of use

2025-08-05

Security in the Vibe Coding Age

2025-08-04

How to fully automate software engineering

2025-08-04

Sweatshop data is over

2025-08-04

Figma’s IPO was fine, actually

2025-08-04

12 Principles of Animation

2025-08-04

I spent 6 years building a ridiculous wooden pixel display

2025-08-04

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

2025-08-04

Hierarchical Reasoning Model

2025-08-02

Caches: LRU v. random

2025-08-02

Why I don’t think AGI is right around the corner

2025-08-02

Persona vectors: Monitoring and controlling character traits in language models

2025-08-01

My Internship Experiences at Pixar, Google, and Two Sigma

2025-08-01

You Suck at Securing S3, Here's Why

2025-08-01

900 Sites, 125 million accounts, 1 vulnerability

2025-08-01

Ramblings

2025-08-01

How to Win the AI Talent War

2025-07-31

The Math Is Haunted

2025-07-30

Python tooling could be much, much faster

2025-07-30

fast

2025-07-30

Our designer built an OS with Cursor

2025-07-30

Subliminal Learning: Language models transmit behavioral traits via hidden signals in data

2025-07-29

Learning to See Inside Opaque Liquid Containers using Speckle Vibrometry

2025-07-29

THE METIS LIST

2025-07-29

The Convenience Trap: Why Seamless Banking Access Can Turn 2FA into 1FA

2025-07-29

Fluid compute: How we built serverless servers

2025-07-29

DataRater: Meta-Learned Dataset Curation

2025-07-27

Enough AI copilots! We need AI HUDs

2025-07-27

How I practice at what I do

2025-07-26

I Drank Every Cocktail

2025-07-25

Meaning Ltd.

2025-07-25

Maxwell Social

2025-07-25

Don't animate height!

2025-07-22

Inverse Scaling in Test-Time Compute

2025-07-22

Build AI in America: Anthropic Energy Report

2025-07-22

AI Market Clarity

2025-07-22

What's going on here, with this human?

2025-07-22

Sporks of AGI

2025-07-21

Rethinking CLI interfaces for AI

2025-07-19

Why your website should be under 14kB in size

2025-07-18

how to design systems for agents

2025-07-17

Designing Next.js Dev Tools

2025-07-17

I'm Switching to Python and Actually Liking It

2025-07-16

Progress · Patrick Collison

2025-07-15

Asymmetry of verification and verifier’s law

2025-07-15

Reflections on OpenAI

2025-07-15

Animating in Public

2025-07-15

To be a better programmer, write little proofs in your head

2025-07-15

Felt AI unleashed: Build spatial applications with just a prompt

2025-07-15

From Memo to Movement: Shopify’s Cultural Adoption of AI

2025-07-15

LLM Daydreaming

2025-07-14

Context Rot: How Increasing Input Tokens Impacts LLM Performance

2025-07-14

no days off

2025-07-14

Let's Learn x86-64 Assembly!

2025-07-14

Strategies for very fast Lexers

2025-07-14

The upcoming GPT-3 moment for RL

2025-07-13

How does a screen work?

2025-07-13

Dynamic Chunking for End-to-End Hierarchical Sequence Modeling

2025-07-12

Shipping Linear Drafts

2025-07-12

5 things I learned from 5 years at Vercel

2025-07-11

Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity

2025-07-10

rotating parts

2025-07-10

How To Validate Product Ideas Before (And After) Building Them

2025-07-09

the void

2025-07-08

React Still Feels Insane And No One Is Talking About It

2025-07-08

Agency is Eating the World

2025-07-07

i said arigato to fred again and he started boiling eggs for me great guy

2025-07-07

Solving Wordle with uv's dependency resolver

2025-07-06

How to remember everything and feel nothing

2025-07-06

being too ambitious is a clever form of self-sabotage

2025-07-05

Local-first software: You own your data, in spite of the cloud

2025-07-05

I built something that changed my friend group's social fabric

2025-07-01

INTDEV

2025-07-01

Spegel - A Terminal Browser That Uses LLMs to Rewrite Webpages

2025-07-01

That boolean should probably be something else

2025-06-30

A new standard for image sequences on the web

2025-06-30

The New Skill in AI is Not Prompting, It's Context Engineering

2025-06-30

The Gen Z Recession

2025-06-30

New Ensō

2025-06-30

There Are No New Ideas in AI… Only New Datasets

2025-06-30

Performance Prediction for Large Systems via Text-to-Text Regression

2025-06-30

how we accidentally solved robotics by watching 1 million hours of YouTube

2025-06-29

Stochastic Parameter Decomposition

2025-06-28

AlphaGenome: AI for better understanding the genome

2025-06-27

OpenAI Charges by the Minute, So Make the Minutes Shorter

2025-06-25

Reverse Engineering an AI Backdoor

2025-06-24

how i use my terminal

2025-06-23

Backyard Coffee And Jazz In Kyoto, Japan

2025-06-23

Jeff Bezos Shareholder Letters

2025-06-23

Startup Win Conditions

2025-06-23

Mechanical Watch: Exploded View

2025-06-22

TPU Deep Dive

2025-06-22

Agentic Search for Dummies

2025-06-21

Any Distance Goes Open Source

2025-06-20

LMPnL Leaderboard

2025-06-20

The strategy behind Dia's design

2025-06-18

Andrej Karpathy's YC AI SUS talk

2025-06-18

I Counted All of the Yurts in Mongolia Using Machine Learning

2025-06-18

o3 Turns Pro

2025-06-17

Warp 2.0: How we rebuilt the Warp UI from scratch

2025-06-17

The lethal trifecta for AI agents: private data, untrusted content, and external communication

2025-06-16

How we built our multi-agent research system

2025-06-14

No Rivals: The Founders Fund Story

2025-06-12

The Future of Infrastructure is Invisible

2025-06-12

On How Long it Takes to Know if a Job is Right for You or Not

2025-06-11

The Gentle Singularity

2025-06-10

God is hungry for Context: First thoughts on o3 pro

2025-06-10

Physicality: the new age of UI

2025-06-09

Bruteforcing the phone number of any Google user

2025-06-09

my first attempt at iOS app development

2025-06-09

Some thoughts on human-AI relationships

2025-06-06

Mapping latitude and longitude to country, state, or city

2025-06-04

You Might Not Need an Effect

2025-06-02

Introducing the v0 composite model family

2025-06-01

Can the Bloomberg Terminal be “Toppled”?

2025-05-31

Surprisingly Fast AI-Generated Kernels We Didn’t Mean to Publish (Yet)

2025-05-29

Open-sourcing circuit-tracing tools

2025-05-29

DOGE Days

2025-05-28

Newcomb's Poison Paradox

2025-05-27

Why is quality so rare?

2025-05-27

The Screen Time Network

2025-05-27

Square Theory

2025-05-27

Meet us in the browser

2025-05-26

Letter to Arc members 2025

2025-05-26

How I used o3 to find CVE-2025-37899, a remote zeroday vulnerability in the Linux kernel’s SMB implementation

2025-05-24

Honkish

2025-05-23

DumPy: NumPy except it's OK if you're dum

2025-05-23

The Way of Code | Rick Rubin

2025-05-23

Harnessing the Universal Geometry of Embeddings

2025-05-21

Visualizing algorithms for rate limiting

2025-05-19

Why We Think

2025-05-18

Types of Memetic Information

2025-05-18

Bret Victor’s Reading List

2025-05-17

XX^t Can Be Faster

2025-05-16

Top Down and Bottom Up Companies

2025-05-14

Building, launching, and scaling ChatGPT Images

2025-05-13

Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution

2025-05-13

Muon and a Selective Survey on Steepest Descent in Riemannian and Non-Riemannian Manifolds

2025-05-11

I'd rather read the prompt

2025-05-04

Dummy's Guide to Modern Samplers

2025-05-04

Testing AI's GeoGuessr Genius

2025-05-03

Expanding on what we missed with sycophancy

2025-05-02

Vibe coding MenuGen

2025-05-01

[untitled]

2025-04-30

Circuits Updates - April 2025

2025-04-30

The Leaderboard Illusion

2025-04-30

Mechanical Computing

2025-04-30

The indifference engine

2025-04-29

Good vs Great Animations

2025-04-29

Ramp Economics Lab

2025-04-28

Real Time Science

2025-04-27

[2504.11651] 70% Size, 100% Accuracy: Lossless LLM Compression for Efficient GPU Inference via Dynamic-Length Float

2025-04-25

The Urgency of Interpretability

2025-04-24

AI Horseless Carriages

2025-04-24

Me at the zoo

2025-04-23

Atuin Desktop: Runbooks that Run

2025-04-22

Devouring Details: Behind scenes

2025-04-22

Questions about the Future of AI

2025-04-21

Impact, agency, and taste

2025-04-21

Better interfaces for dialogue

2025-04-20

Computational Complexity of Air Travel Planning

2025-04-19

mysterious met machine

2025-04-17

Our first brand campaign | Modal

2025-04-17

Generative modelling in latent space

2025-04-16

Two Years of Rust

2025-04-15

Meta's Opening Statement

2025-04-14

The Interfaces With Which We Think

2025-04-14

Stevens: a hackable AI assistant using a single SQLite table and a handful of cron jobs

2025-04-14

Some Nice Things with SVG

2025-04-12

MAKING SOFTWARE

2025-04-11

Rethinking Reflection in Pre-Training

2025-04-10

The Intelligence Consolidation

2025-04-09

How Do Large Language Monkeys Get Their Power (Laws)?

2025-04-09

YZY TWTS

2025-04-09

Baking the Y Combinator from scratch

2025-04-09

Market Ending Moves

2025-04-08

How I don't use LLMs

2025-04-08

Paradigm Shifts

2025-04-07

Transformer Language Models without Positional Encodings Still Learn Positional Information

2025-04-07

Design for the AI age

2025-04-07

LLMs Understand Nullability

2025-04-07

Everything that turned out well in my life followed the same design process

2025-04-07

Recent AI model progress feels mostly like bullshit

2025-04-06

The “S” in MCP Stands for Security

2025-04-06

The Colors Of Her Coat

2025-04-05

Ten Rules for Negotiating a Job Offer

2025-04-05

Prism: mapping interpretable concepts and features in a latent space of language

2025-04-05

Rope to Nope and Back Again: A New Hybrid Attention Strategy

2025-04-05

Graph Search Algorithm: The Game

2025-04-03

What 2026 looks like

2025-04-03

AI 2027

2025-04-03

That's a Lot of Fish: PlaidCTF 2020

2025-04-02

tv.garden

2025-04-02

radio.garden

2025-04-02

you can’t put the genie back in the feed

2025-04-01

Proof or Bluff? Evaluating LLMs on 2025 USA Math Olympiad

2025-04-01

The next big thing will start out looking like a toy

2025-03-31

LooksMapping

2025-03-31

Why MCP Won

2025-03-30

The plummeting cost of intelligence

2025-03-30

on language models, research directions, skill deflation

2025-03-30

OpenAI abuse

2025-03-30

Everyone knows all the apps on your phone

2025-03-30

Finding the Best Sleep Tracker

2025-03-30

On the Biology of a Large Language Model

2025-03-28

The case against conversational interfaces

2025-03-27

Tracing the thoughts of a large language model

2025-03-27

1K+ IRR

2025-03-26

The Whispering Earring

2025-03-24

Evaluating Large Language Models' Capability to Launch Fully Automated Spear Phishing Campaigns: Validated on Human Subjects

2025-03-23

Not all AI-assisted programming is vibe coding (but vibe coding rocks)

2025-03-23

Reflecting on WikiTok

2025-03-23

A friendly introduction to machine learning compilers and optimizers

2025-03-22

attention is logarithmic, actually

2025-03-22

Neural GPUs Learn Algorithms

2025-03-22

From Dorm Rooms to Boardrooms: Why Now Is a Special Time for Young Founders

2025-03-21

Pen and Paper Exercises in Machine Learning

2025-03-21

SuperBPE: Space Travel for Language Models

2025-03-21

The "think" tool: Enabling Claude to stop and think

2025-03-21

The Frontend Treadmill

2025-03-20

OpenAI.fm

2025-03-20

AI Blindspots

2025-03-19

How Fast the Days Are Getting Longer

2025-03-19

My Thoughts on the Future of "AI"

2025-03-18

Digital hygiene

2025-03-18

Paying less for your house (if that's important to you)

2025-03-15

Gradual Disempowerment

2025-03-15

Things Read | Jan/Feb 2025

2025-03-15

My notes while reading about GPUs

2025-03-15

Powerful AI Is Coming. We’re not ready.

2025-03-14

Harder Tasks Need More Experts: Dynamic Routing in MoE Models

2025-03-12

Lumon Industries WoeMeter

2025-03-11

Gemini Embedding: Generalizable Embeddings from Gemini

2025-03-11

Here’s how I use LLMs to help me write code

2025-03-11

What Makes Code Hard To Read: Visual Patterns of Complexity

2025-03-11

Factorio Learning Environment

2025-03-11

Math -> GPU

2025-03-10

I quit my FAANG job because it'll be automated by the end of 2025

2025-03-10

Probabilistic Artificial Intelligence

2025-03-10

Geist Design System

2025-03-09

Jhourney

2025-03-08

Understanding Transformers... (beyond the Math)

2025-03-08

Separation of concerns in a bug tracker

2025-03-08

Lena

2025-03-07

To B or not to B: B-Trees with Optimistic Lock Coupling

2025-03-07

Saving Aranet4 data to Raspberry Pi

2025-03-06

Tailscale is pretty useful

2025-03-05

Crossing the uncanny valley of conversational voice

2025-03-05

Why PyTorch is an amazing place to work... and Why I'm Joining Thinking Machines

2025-03-04

Handy Arrows

2025-03-03

LLM Post-Training: A Deep Dive into Reasoning Large Language Models

2025-03-03

Text Buffer Reimplementation

2025-03-02

Every productivity thought I've ever had, as concisely as possible

2025-03-02

Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone

2025-03-01

Troubleshooting: The Skill That Never Goes Obsolete

2025-03-01

Claude Code can decompile itself

2025-03-01

Why ContentEditable is Terrible

2025-02-28

how to gain code execution on millions of people and hundreds of popular apps

2025-02-28

3,200% CPU Utilization

2025-02-28

Migrating millions of lines of code to TypeScript

2025-02-27

Towards an AI co-scientist

2025-02-26

I Went To SQL Injection Court

2025-02-25

Hard problems that reduce to document ranking

2025-02-25

3D knitting

2025-02-25

content list

2025-02-25

The closer to the train station, the worse the kebab

2025-02-24

Cursor Directory

2025-02-24

Memos

2025-02-23

Neobrutalism components

2025-02-22

The Profitable Startup

2025-02-21

Removing Jeff Bezos From My Bed

2025-02-21

I proposed to my girlfriend in Quordle

2025-02-21

Running Pong in 240 Browser Tabs

2025-02-20

When Imperfect Systems are Good, Actually

2025-02-19

The Ultra-Scale Playbook

2025-02-19

Relaxed Radix Balanced Trees

2025-02-19

My LLM codegen workflow

2025-02-18

XOR

2025-02-18

Thinking Machines Lab

2025-02-18

Being a High-Leverage Generalist

2025-02-18

The Joy of Nand2Tetris

2025-02-18

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention

2025-02-18

New Junior Developers Can’t Actually Code

2025-02-16

Brand Biographies

2025-02-16

uchū color scheme

2025-02-16

Homemade polarimetric synthetic aperture radar drone

2025-02-16

"A calculator app? Anyone could make that."

2025-02-16

My Life in Weeks

2025-02-15

Is it okay?

2025-02-15

Japanese Print Search and Database

2025-02-14

We Were Wrong About GPUs

2025-02-14

The hardest working font in Manhattan

2025-02-14

TeX and Typst: Layout Models

2025-02-14

Generalized Transformers from Applicative Functors

2025-02-14

SQL Noir

2025-02-13

What if Eye...?

2025-02-13

Distillation Scaling Laws

2025-02-13

Smuggling arbitrary data through an emoji

2025-02-12

The Economics of Being a Founding Engineer

2025-02-12

OpenAI Model Spec

2025-02-12

Competitive Programming with Large Reasoning Models

2025-02-11

The Subtle Art of Designing Physical Controls for Cars

2025-02-11

building a personal, private ai computer on a budget

2025-02-11

Index Companies

2025-02-11

Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputs

2025-02-11

Citibike Stories

2025-02-11

We Replaced Our React Frontend with Go and WebAssembly

2025-02-10

PySkyWiFi: completely free, unbelievably stupid wi-fi on long-haul flights

2025-02-10

Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach

2025-02-10

Anthropic Economic Index

2025-02-10

Why Blog If Nobody Reads It?

2025-02-09

The Bid/Ask Spread for Top Talent

2025-02-09

LIMO: Less is More for Reasoning

2025-02-09

HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models

2025-02-09

Robust Autonomy Emerges from Self-Play

2025-02-09

Three Observations

2025-02-09

Epoch Semantic Versioning

2025-02-09

From hours to 360ms: over-engineering a puzzle solution

2025-02-08

Jackson Pollock

2025-02-08

Your AI can’t see gorillas

2025-02-08

Do-nothing scripting: the key to gradual automation

2025-02-08

engineering the perfect group chat

2025-02-07

Technocapital

2025-02-07

Understanding Reasoning LLMs

2025-02-06

Making a case for letter case

2025-02-06

Simulating water over terrain

2025-02-06

Selling my first startup

2025-02-06

The best interface is no interface

2025-02-06

Personal Software

2025-02-05

Ingesting Millions of PDFs and why Gemini 2.0 Changes Everything

2025-02-05

Animated icons

2025-02-05

Leaving Delaware

2025-02-05

Software development topics I've changed my mind on after 10 years in the industry

2025-02-05

WikiTok

2025-02-04

Chat is a bad UI pattern for development tools

2025-02-04

Everyone knows your location

2025-02-03

Scalable-Softmax Is Superior for Attention

2025-02-02

s1: Simple test-time scaling

2025-02-02

Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming

2025-02-02

A Little Bit of Reinforcement Learning from Human Feedback

2025-02-01

What fully automated firms will look like

2025-01-31

A Young Man Used AI to Build A Nuclear Fusor and Now I Must Weep

2025-01-30

Sacred computer UI

2025-01-29

The Zizians

2025-01-29

R1-Zero and R1 Results and Analysis

2025-01-29

On DeepSeek and Export Controls

2025-01-29

Why DeepSeek had to be open-source

2025-01-29

Using uv as your shebang line

2025-01-28

99% of the code in this PR is written by DeekSeek-R1

2025-01-28

How has DeepSeek improved the Transformer architecture?

2025-01-28

Slack Overflow: How We Scaled Slack to Support 1000s of Developers

2025-01-27

Building personal software with Claude

2025-01-27

I’m Lovin’ It: Exploiting McDonald’s APIs to hijack deliveries and order food for a penny

2025-01-27

Speeding up this site by 50x

2025-01-26

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

2025-01-26

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

2025-01-26

Universal Paperclips

2025-01-25

Anomalous Tokens in DeepSeek-V3 and r1

2025-01-24

Introducing Operator | OpenAI

2025-01-23

Taking a Look at Compression Algorithms

2025-01-23

I made an open-source laptop from scratch

2025-01-22

alana goyal | messages

2025-01-21

Lens and Land

2025-01-21

UK's elite hardware talent is being wasted

2025-01-20

Evolving Deeper LLM Thinking

2025-01-19

100% user-supported

2025-01-19

Titans: Learning to Memorize at Test Time

2025-01-18

Using ChatGPT is not bad for the environment

2025-01-17

So You Want to Build Your Own Data Center

2025-01-17

Dropping hashes: an idiom used to demonstrate provenance of documents

2025-01-17

How to hire ML engineers/researchers

2025-01-16

Book Review: Talent

2025-01-16

No calls

2025-01-16

Towards Benchmarking LLM Diversity & Creativity

2025-01-15

Homomorphic Encryption in iOS 18

2025-01-14

David A. Wheeler's Review of "Debugging" by David J. Agans

2025-01-13

20 lines of code that will beat A/B testing every time

2025-01-13

The Best Tacit Knowledge Videos on Every Subject

2025-01-12

uv has a killer feature you should know about

2025-01-12

The illustrated guide to a Ph.D.

2025-01-11

Interface Gallery

2025-01-11

a reinforcement learning guide

2025-01-11

Static search trees: 40x faster than binary search

2025-01-10

On the Inductive Bias of Stacking Towards Improving Reasoning

2025-01-09

Algorithms for Modern Hardware

2025-01-09

The Lindy PM Standard of Performance

2025-01-09

Fluid layout customization with Splits

2025-01-08

Progressive Reduction

2025-01-08

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

2025-01-08

Agents

2025-01-07

On LLMs and Code Optimization

2025-01-06

Superhuman performance of a large language model on the reasoning tasks of a physician

2025-01-06

They're Made out of Meat

2025-01-06

Predicting Human Brain States with Transformer

2025-01-05

Engineer Eats Efficiently (for $2.50 a Day)

2025-01-05

Remote code execution via MIDI messages

2025-01-05

Vim Koans

2025-01-05

Git Koans

2025-01-05

The day I taught AI to read code like a Senior Developer

2025-01-05

NY Systems Reading Group

2025-01-04

5 ways to draw an outline

2025-01-04

Continutity 1: G0, G1, G2, G3

2025-01-03

B-Trees: More Than I Thought I'd Want to Know

2025-01-03

Scaling of Search and Learning: A Roadmap to Reproduce o1 from Reinforcement Learning Perspective

2025-01-03

2024: Year in Review

2025-01-03

What we learned copying all the best code assistants

2025-01-03

Algorithmic Language Models with Neurally Compiled Libraries

2025-01-03

I am rich and have no idea what to do with my life

2025-01-03

i sensed anxiety and frustration at NeurIPS’24

2025-01-03

AI and Stress

2025-01-02

Centaur: a foundation model of human cognition

2025-01-02

How I Use Claude

2025-01-01

How to write complex software

2025-01-01

Things we learned about LLMs in 2024

2024-12-31

Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data

2024-12-30

Friendly And Hostile Analogies For Taste

2024-12-30

2024 letter

2024-12-30

The best facts I heard this year

2024-12-30

Notes on China

2024-12-30

The Unbearable Slowness of Being: Why do we live at 10 bits/s?

2024-12-30

Why Deep Learning Works Even Though It Shouldn’t

2024-12-29

2024 AI reflections

2024-12-29

Steve Jobs' Calculator

2024-12-28

That's not an abstraction, that's just a layer of indirection

2024-12-27

People who are going to change the world

2024-12-27

PlasticList

2024-12-27

The 2025 AI Engineering Reading List

2024-12-27

Chain-of-Thought Reasoning Without Prompting

2024-12-26

Cognitive load is what matters

2024-12-25

FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI

2024-12-25

FrontierMath

2024-12-25

How bloom filters made SQLite 10x faster

2024-12-22

On Ousterhout's Dichotomy

2024-12-21

tldraw computer

2024-12-21

Deliberative alignment: reasoning enables safer language models

2024-12-20

OpenAI o3 Breakthrough High Score on ARC-AGI-Pub

2024-12-20

Building Blocks for Theoretical Computer Science

2024-12-19

Universal Transformers

2024-12-19

An Alternative to Test-Time Scaling

2024-12-19

Building effective agents

2024-12-19

Advent of Code on the Nintendo DS

2024-12-19

How to make something great

2024-12-19

ISO 8583: The language of credit cards

2024-12-19

The Llama 3 Herd of Models

2024-12-18

Cultural Evolution of Cooperation among LLM Agents

2024-12-17

Moon

2024-12-17

What Did Ada Lovelace's Program Actually Do?

2024-12-16

Playing different games

2024-12-14

GPU Glossary

2024-12-12

Outcome-based pricing for AI Agents

2024-12-10

Quantum error correction below the surface code threshold

2024-12-10

The Google Willow thing

2024-12-10

From where I left

2024-12-10

Training Large Language Models to Reason in a Continuous Latent Space

2024-12-09

Structured 3D Latents for Scalable and Versatile 3D Generation

2024-12-09

How does batching work on modern GPUs?

2024-12-09

Frontier Models are Capable of In-context Scheming

2024-12-09

Reinforcement Learning: An Overview

2024-12-09

Zen and The Art of Semiconductor Manufacturing

2024-12-08

How to read a book using o1

2024-12-08

Guide to GeoGuessr

2024-12-06

Intro to Transformers

2024-12-06

Next-level frosted glass with backdrop-filter

2024-12-06

Writing down (and searching through) every UUID

2024-12-06

Every UUID V4

2024-12-06

Intelligence Arbitrage

2024-12-05

7 Databases in 7 Weeks for 2025

2024-12-05

How to pack ternary numbers in 8-bit bytes

2024-12-05

Late Takes on OpenAI o1

2024-12-04

Optimizing AI Inference at Character.AI

2024-12-04

Grifters, believers, grinders, and coasters

2024-12-04

Goodbye, Clean Code

2024-12-03

IMG_0001

2024-12-03

Accelerated AI Inference via Dynamic Execution Methods

2024-12-02

Active Data Curation Effectively Distills Large-Scale Multimodal Models

2024-12-02

Facebook's Little Red Book

2024-12-02

Reward Hacking in Reinforcement Learning

2024-12-01

Thirty Observations at Thirty

2024-11-30

There’s no speed limit

2024-11-29

Why pipes sometimes get "stuck": buffering

2024-11-29

How Much Memory Do You Need in 2024 to Run 1 Million Concurrent Tasks?

2024-11-28

Competitive Programmer’s Handbook

2024-11-28

The UX of LEGO Interface Panels

2024-11-28

TÜLU 3: Pushing Frontiers in Open Language Model Post-Training

2024-11-27

Interfacing Artificial Intelligence through Paper

2024-11-27

Do Ten Times as Much

2024-11-26

Information Theory: A Tutorial Introduction

2024-11-26

Model Context Protocol (MCP)

2024-11-25

Amortizing intractable inference in large language models

2024-11-25

Solving Boolean satisfiability and integer programming with Python packaging

2024-11-25

The Problem with Reasoners

2024-11-25

Web Interface Guidelines

2024-11-24

Coalescence: making LLM inference 5x faster

2024-11-24

dottxt - make ai speak computer

2024-11-24

Fantastic Learning Resources

2024-11-24

Frosted Glass from Games to the Web

2024-11-23

RE-Bench

2024-11-23

Dear Sir, You Have Built a Compiler

2024-11-22

Phased Array Microphone

2024-11-22

Bayesian Neural Networks

2024-11-21

SQL, Homomorphisms and Constraint Satisfaction Problems

2024-11-20

1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs

2024-11-19

Understanding the BM25 full text search algorithm

2024-11-19

Hand Tracking for Mouse Input

2024-11-19

Don't Do This - PostgreSQL wiki

2024-11-18

What I Wish Someone Told Me About Postgres

2024-11-18

20 things you didn’t know about Google Scholar

2024-11-18

nGPT: Normalized Transformer with Representation Learning on the Hypersphere

2024-11-18

AlphaProof’s Greatest Hits

2024-11-17

1 week with David Beazley and SICP

2024-11-17

Principles

2024-11-17

An Elementary Introduction to Kalman Filtering

2024-11-17

LAN Party House

2024-11-16

WebVM - Linux virtualization in WebAssembly

2024-11-16

YC is wrong about LLMs for chip design

2024-11-16

OpenAI Email Archives (from Musk v. Altman)

2024-11-16

Why GPT-3 Matters

2024-11-15

The /llms.txt file

2024-11-15

Subway Stories

2024-11-15

GeoHints

2024-11-15

SF ARCHIVES

2024-11-14

What will GPT-2030 look like?

2024-11-14

MomBoard: E-ink display for a parent with amnesia

2024-11-14

Adding payments to your LLM agentic workflows

2024-11-14

How XBOW found a Scoold authentication bypass

2024-11-14

The Surprising Effectiveness of Test-Time Training for Abstract Reasoning

2024-11-13

My Math Academy Learning Workflow

2024-11-13

Rapid Response: Mitigating LLM Jailbreaks with a Few Examples

2024-11-13

How We Built a Self-Healing System to Survive a Terrifying Concurrency Bug At Netflix

2024-11-13

No GPS required: our app can now locate underground trains

2024-11-13

An attempt to backdoor the kernel

2024-11-12

The github plugin my coworkers asked me not to write

2024-11-11

How I ship projects at big tech companies

2024-11-11

PyTorch internals

2024-11-11

Increasing the Supply of Very High-IQ Workers

2024-11-09

SQLite does not do checksums

2024-11-09

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

2024-11-09

Zig's (.{}){} syntax

2024-11-09

System tests have failed

2024-11-09

Internal Software Builders

2024-11-08

cobalt tools

2024-11-07

Oasis: A Universe in a Transformer

2024-11-05

Hacking 700 Million Electronic Arts Accounts

2024-11-05

ASCII control characters in my terminal

2024-11-05

Burst Damage

2024-11-05

Project Sid: Many-agent simulations toward AI civilization

2024-11-04

Losing My Hands

2024-11-03

Memory bandwidth vs capacity

2024-11-02

TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters

2024-11-01

On Memorization of Large Language Models in Logical Reasoning

2024-11-01

Group Crosscoders for Mechanistic Analysis of Symmetry

2024-11-01

Everyone is wrong about that Slack flowchart

2024-10-31

Our First Generalist Policy

2024-10-31

How we shrunk our Javascript monorepo git size by 94%

2024-10-30

Zero Bubble Pipeline Parallelism

2024-10-30

Setting Your Pet Rock Free

2024-10-29

Why are Modern Neural Nets the way they are? And Hidden Hypernetworks.

2024-10-29

LLM Transformer Model Visually Explained

2024-10-29

How I write code using Cursor: A review

2024-10-29

Understanding Round Robin DNS

2024-10-26

The Future of Compute: NVIDIA's Crown is Slipping

2024-10-25

Detecting when LLMs are Uncertain

2024-10-25

Rekindling Is Refining

2024-10-25

Big tech transitions are slow

2024-10-24

Scaling Automatic Neuron Description

2024-10-23

Monitor: An AI-Driven Observability Interface

2024-10-23

What happens when you make a move in lichess.org?

2024-10-23

A personal summary of "Designing Data-Intensive Applications"

2024-10-23

You Should Probably Pay Attention to Tokenizers

2024-10-23

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

2024-10-22

If I wanted to spend WAY more on AI, what would I spend it on?

2024-10-22

How we built a new powerful JSON data type for ClickHouse

2024-10-22

God Mode

2024-10-22

Developing a computer use model

2024-10-22

Introducing computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

2024-10-22

Why do Random Forests Work? Understanding Tree Ensembles as Self-Regularizing Adaptive Smoothers

2024-10-19

Introducing the prompt() Function: Use the Power of LLMs with SQL!

2024-10-17

reflections on palantir

2024-10-16

Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Prediction

2024-10-16

The Auditooor Grindset

2024-10-15

Energy & Humanity

2024-10-15

We have AE at home

2024-10-15

AI is the new plastic

2024-10-14

Busy Status Bar

2024-10-14

Starship is Still Not Understood

2024-10-13

the quiet art of attention

2024-10-13

What's the Magic Word? A Control Theory of LLM Prompting

2024-10-13

Shadow Workspace: Iterating on Code in the Background

2024-10-13

Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think

2024-10-13

Designing bug-proof engines

2024-10-13

Unusual Holidays

2024-10-13

1 bug, $50,000+ in bounties, how Zendesk intentionally left a backdoor in hundreds of Fortune 500 companies

2024-10-12

Machines of Loving Grace

2024-10-11

Conway's Gradient of Life

2024-10-11

MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

2024-10-10

Pixtral 12B

2024-10-09

How Cloudflare auto-mitigated world record 3.8 Tbps DDoS attack

2024-10-09

Addition is All You Need for Energy-efficient Language Models

2024-10-09

John Carmack on Inlined Code

2024-10-09

The Static Site Paradox

2024-10-08

On the Nature of Time

2024-10-08

An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generation

2024-10-08

Personality Basins

2024-10-08

Differential Transformer

2024-10-08

Doing a Research Startup

2024-10-07

Contextual Document Embeddings

2024-10-07

Deciphering the Factors Influencing the Efficacy of Chain-of-Thought: Probability, Memorization, and Noisy Reasoning

2024-10-07

Mikutap

2024-10-07

Patatap

2024-10-07

Transformer Inference Arithmetic

2024-10-07

Can You Get Root With Only a Cigarette Lighter?

2024-10-07

Notion engineers sped up Notion's browser speed with WASM SQLite

2024-10-06

What the smartest people do on the weekend is what everyone else will do during the week in ten years

2024-10-06

We’re Entering Uncharted Territory for Math

2024-10-05

Getting my daily news from a dot matrix printer

2024-10-04

Why does man print "gimme gimme gimme" at 00:30?

2024-10-04

Meta Movie Gen

2024-10-04

Canvas is a new way to write and code with ChatGPT

2024-10-03

VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment

2024-10-03

Stripe Dot Dev

2024-10-03

How I cleared L6 System Design

2024-10-01

Bop Spotter

2024-09-30

From bare metal to a 70B model: infrastructure set-up and scripts

2024-09-30

Optimizing crop planting with mixed integer linear programming in Stardew Valley

2024-09-30

Post-hyperscale II

2024-09-30

NotebookLM’s automatically generated podcasts are surprisingly effective

2024-09-30

socialization

2024-09-29

I want to destroy the words "interesting" and "sparkly"

2024-09-29

The Friendship That Made Google Huge

2024-09-29

Being Raised by the Internet

2024-09-29

Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law

2024-09-28

How Discord Stores Trillions of Messages

2024-09-28

Personal Finance Tips

2024-09-28

I love calculator

2024-09-28

Eyeballing training runs

2024-09-27

Collaborative Text Editing with Eg-walker: Better, Faster, Smaller

2024-09-27

It's hard to write code for computers, but it's even harder to write code for humans

2024-09-27

Attacking UNIX Systems via CUPS, Part I

2024-09-26

uiwtf — an experimental laboratory for user interfaces

2024-09-25

On Those Undefeatable Arguments for AI Doom

2024-09-25

On Impactful AI Research

2024-09-24

Challenging projects every programmer should try

2024-09-23

The Intelligence Age

2024-09-23

What Are the Robots Going to Do?

2024-09-23

Concrete Steps to Get Started in Transformer Mechanistic Interpretability

2024-09-22

Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queries

2024-09-22

Sanding UI

2024-09-21

inference.net

2024-09-21

Why React Re-Renders

2024-09-21

How Replit used legal threats to kill my open-source project

2024-09-20

Caravel Robotics

2024-09-20

gaining access to anyones browser without them even visiting a website

2024-09-19

SOAP: Improving and Stabilizing Shampoo using Adam

2024-09-18

overthinking transformers

2024-09-18

What is Entropy?

2024-09-17

1X World Model

2024-09-17

Book review: Xenosystems

2024-09-17

Chain of Thought Empowers Transformers to Solve Inherently Serial Problems

2024-09-16

How to Succeed at MrBeast Production

2024-09-14

meet.hn

2024-09-14

Critical zero-click vulnerability chain in macOS

2024-09-13

flirting with quant

2024-09-13

Learning to Reason with LLMs | OpenAI

2024-09-12

NotebookLM

2024-09-12

Synthetic continued pretraining

2024-09-12

A Bunch of Programming Advice I’d Give To Myself 15 Years Ago

2024-09-11

Features of your font you had no idea about

2024-09-10

Towards high-performance AI compilers

2024-09-10

Google Illuminate

2024-09-10

Tutorial on Diffusion Models for Imaging and Vision

2024-09-10

A good day to trie-hard: saving compute 1% at a time

2024-09-10

How to be more agentic

2024-09-10

we have reached rabbit hole rock bottom

2024-09-10

Creating a Git commit: The Hard Way

2024-09-08

FlexAttention for Efficient High-Resolution Vision-Language Models

2024-09-07

A Real Life Off-By-One Error

2024-09-04

Dynamicland

2024-09-04

100k H100 Clusters: Power, Network Topology, Ethernet vs InfiniBand, Reliability, Failures, Checkpointing

2024-09-03

The secret inside One Million Checkboxes

2024-08-29

Scaling One Million Checkboxes to 650,000,000 checks

2024-08-29

Bypassing airport security via SQL injection

2024-08-29

Air Con: $1697 for an on/off switch

2024-08-28

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

2024-08-28

Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model

2024-08-28

Generative Verifiers: Reward Modeling as Next-Token Prediction

2024-08-27

The end of software

2024-08-27

Diffusion Models Are Real-Time Game Engines

2024-08-27

Free Public APIs

2024-08-27

The Git Parable

2024-08-27

The Fast Track – Sheafification

2024-08-27

Erasure Coding for Distributed Systems

2024-08-26

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies

2024-08-26

@levelsio Blog

2024-08-26

Memory Augmented Large Language Models are Computationally Universal

2024-08-26

Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability

2024-08-26

Removing stuff is never obvious yet often better

2024-08-25

SQL Has Problems. We Can Fix Them: Pipe Syntax In SQL

2024-08-25

On becoming competitive when joining a new company

2024-08-25

You Are NOT Dumb, You Just Lack the Prerequisites

2024-08-24

LiveGraph: real-time data fetching at Figma

2024-08-23

The data model behind Notion's flexibility

2024-08-23

Did you lose your AirPods?

2024-08-23

Why Ed-tech Startups Don't Scale

2024-08-23

InstantDB: The Realtime Client-Side Database

2024-08-23

What is the self-driving car of NLP?

2024-08-21

I've Built My First Successful Side Project, and I Hate It

2024-08-21

Dwarkesh Podcast Progress Update

2024-08-20

Toasts are Bad UX

2024-08-20

Cool URIs don't change

2024-08-20

Parsing Protobuf at 2+GB/s: How I Learned To Love Tail Calls in C

2024-08-19

Peritext: A CRDT for Rich-Text Collaboration

2024-08-19

5000x faster CRDTs: An Adventure in Optimization

2024-08-19

MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning

2024-08-19

Classifying all of the PDFs on the Internet

2024-08-19

Eric Schmidt’s AI prophecy

2024-08-17

DifuzCam: Replacing Camera Lens with a Mask and a Diffusion Model

2024-08-16

Imagen 3

2024-08-16

How I won $2,750 using JavaScript, AI, and a can of WD-40

2024-08-14

If YouTube had actual channels

2024-08-14

Sort, sweep, and prune: Collision detection algorithms

2024-08-14

Examples of Great URL Design

2024-08-14

postgres.new

2024-08-12

How to avoid losing items? Holding pens

2024-08-11

Building a highly-available web service without a database

2024-08-09

Hacking a Virtual Power Plant

2024-08-09

Perceived Age

2024-08-09

How I Use "AI"

2024-08-08

GPT-4o System Card

2024-08-08

Rostra

2024-08-08

An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models

2024-08-07

Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters

2024-08-07

100 gigs for your headtop

2024-08-07

EP–1320 medieval - teenage engineering

2024-08-06

I'm Switching Into AI Safety

2024-08-06

How I program in 2024

2024-08-04

"We ran out of columns" - The best, worst codebase

2024-08-04

Vector quantization is a sparse MLP

2024-08-03

Read the one-star reviews

2024-08-03

Eigenvectors from eigenvalues: A survey of a basic identity in linear algebra

2024-08-03

Refocusing - Jacob Rintamaki

2024-08-02

How Google handles JavaScript throughout the indexing process

2024-08-02

After 10 Years, Yelp Gave My App 4 Days

2024-07-31

just disconnect the internet

2024-07-31

Stupider Than You Realize

2024-07-31

The Idiocy Of The Average - And Why It Matters

2024-07-31

Fast Multidimensional Matrix Multiplication on CPU from Scratch

2024-07-31

`find` + `mkdir` is Turing complete

2024-07-30

The Truth about Linear Regression

2024-07-30

Friend

2024-07-30

A Visual Guide to Quantization

2024-07-30

Family Values

2024-07-29

Movable tree CRDTs and Loro's implementation

2024-07-29

Aaron Greenspan :: The Lost Chapter

2024-07-29

CrowdStrike's Impact on Aviation

2024-07-29

Apple Intelligence Technical Report

2024-07-29

Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budget

2024-07-28

The Matrix Calculus You Need For Deep Learning

2024-07-28

Reverse-engineering my speakers' API to get reasonable volume control

2024-07-26

Finding a Random Seed That Solves a LeetCode Problem

2024-07-26

SearchGPT

2024-07-25

AI achieves silver-medal standard solving International Mathematical Olympiad problems

2024-07-25

The UNIX Pipe Card Game

2024-07-23

Button Stealer

2024-07-23

The Llama 3 Herd of Models

2024-07-23

Open Source AI Is the Path Forward

2024-07-23

Distributed Systems Reading List

2024-07-23

Copying is the way design works

2024-07-22

No More Blue Fridays

2024-07-22

how to pwn a billion dollar vc firm using inspect element

2024-07-21

The Quant Thesis

2024-07-18

Jigsaw Puzzle Robot – Mark Rober

2024-07-18

GPT-4o mini: advancing cost-efficient intelligence

2024-07-18

Objects of Our Life | Steve Jobs Archive

2024-07-18

SSH has become our universal (Unix) external access protocol

2024-07-18

𝘁𝗶𝗻𝘆Pod

2024-07-17

Prover-Verifier Games improve legibility of language model outputs

2024-07-17

Panic! at the Tech Job Market

2024-07-17

Jailbreaking RabbitOS: Uncovering Secret Logs, and GPL Violations

2024-07-17

xLSTMTime : Long-term Time Series Forecasting With xLSTM

2024-07-16

Eureka Labs

2024-07-16

SCALE by Spectral Compute

2024-07-15

We need visual programming. No, not like that.

2024-07-14

Efficient Guided Generation for Large Language Models

2024-07-14

Asimov Collective

2024-07-14

CARI | the Consumer Aesthetics Research Institute

2024-07-14

Fitting an Elephant with Four non-Zero Parameters

2024-07-14

Good Houses in SF

2024-07-13

WebGPU Fundamentals

2024-07-12

Landing Page Copywriting

2024-07-12

FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision

2024-07-11

Vision language models are blind

2024-07-10

A Trustworthy, Free (Libre), Linux Capable, Self-Hosting 64bit RISC-V Computer

2024-07-10

ML Code Challenges

2024-07-10

turbopuffer: fast search on object storage

2024-07-10

The Valley of Code

2024-07-09

Chinchilla Scaling: A replication attempt

2024-07-09

Evaluating Chunking Strategies for Retrieval | Chroma Research

2024-07-09

Epistemic calibration and searching the space of truth

2024-07-09

Learning to (Learn at Test Time): RNNs with Expressive Hidden States

2024-07-08

Reverse Engineering TicketMaster's Rotating Barcodes

2024-07-08

My Text Editor Journey: Vim, Spacemacs, Atom and Sublime Text

2024-07-07

OthelloGPT learned a bag of heuristics

2024-07-07

Simple and Effective Masked Diffusion Language Models

2024-07-07

A reawakening of systems programming meetups

2024-07-07

Reasoning in Large Language Models: A Geometric Perspective

2024-07-07

An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers v2

2024-07-07

The Jacobian vs. the Hessian vs. the Gradient

2024-07-06

Omnigrok: Grokking Beyond Algorithmic Data

2024-07-05

What every systems programmer should know about concurrency

2024-07-05

Many-Shot In-Context Learning

2024-07-05

Startup options are much better than they look

2024-07-02

vin.gg

2024-07-01

State of JavaScript 2023

2024-07-01

My Python code is a neural network

2024-07-01

TextTransform

2024-07-01

Respite from the OOM killer

2024-07-01

The Super Effectiveness of Pokémon Embeddings Using Only Raw JSON and Images

2024-06-30

Convolutions, Fast Fourier Transform and Polynomials

2024-06-30

VimGolf - real Vim ninjas count every keystroke!

2024-06-30

Finding GPT-4’s mistakes with GPT-4

2024-06-27

Queueing – An interactive study of queueing strategies

2024-06-27

State Soup: In-Context Skill Learning, Retrieval and Mixing

2024-06-27

One Million Checkboxes

2024-06-26

Building an interactive 3D event badge with React Three Fiber

2024-06-26

The Missing Curve Detectors of InceptionV1: Applying Sparse Autoencoders to InceptionV1 Early Vision

2024-06-25

I am using AI to automatically drop hats outside my window onto New Yorkers

2024-06-24

Shape Rotation 101: An Intro to Einsum and Jax Transformers

2024-06-22

Hacking Millions of Modems (and Investigating Who Hacked My Modem)

2024-06-22

After my dad died, I ran and sold his company (and I was completely clueless)

2024-06-22

Testing Generative AI for Circuit Board Design

2024-06-21

Teensy ELF Executables for Linux

2024-06-20

Shamelessness as a strategy

2024-06-20

Atkinson Dithering

2024-06-20

Graph coloring math puzzles

2024-06-20

Diffusion Models | Andrew Chan

2024-06-20

Tetris Font

2024-06-20

Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generation

2024-06-20

Jason’s Story - New Computer

2024-06-20

Getting 50% (SoTA) on ARC-AGI with GPT-4o

2024-06-18

Refusal in Language Models Is Mediated by a Single Direction

2024-06-17

Nemotron-4 15B Technical Report

2024-06-17

Sycophancy to subterfuge: Investigating reward tampering in language models

2024-06-17

Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models

2024-06-17

Introducing Gen-3 Alpha: A New Frontier for Video Generation

2024-06-17

The Programmer's Brain

2024-06-17

Why Structure and Interpretation of Computer Programs matters

2024-06-16

Speculative Streaming: Fast LLM Inference without Auxiliary Models

2024-06-16

What You Get After Running an SSH Honeypot for 30 Days

2024-06-15

Perplexity AI Is Lying about Their User Agent

2024-06-15

Topological Problems in Voting

2024-06-15

AI Search: The Bitter-er Lesson

2024-06-14

Tool Documentation Enables Zero-Shot Tool-Usage with Large Language Models

2024-06-14

How an empty S3 bucket can make your AWS bill explode

2024-06-13

notebooks are McDonalds of code

2024-06-13

Group chats rule the world

2024-06-13

the Gilbert–Johnson–Keerthi algorithm explained as simply as possible

2024-06-12

How Meta trains large language models at scale

2024-06-12

ARC Prize

2024-06-11

Harder Drive: Hard drives we didn't want or need

2024-06-09

σ-GPTs: A New Approach to Autoregressive Models

2024-06-07

Extracting Concepts from GPT-4 | OpenAI

2024-06-06

An animated introduction to Fourier Serie

2024-06-05

Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models

2024-06-05

SITUATIONAL AWARENESS: The Decade Ahead

2024-06-04

Cutting through buggy adversarial example defenses: fixing 1 line of code breaks Sabre

2024-06-03

A Programmer's Introduction to Mathematics

2024-06-01

Wired Elements

2024-06-01

Engineering for Slow Internet

2024-05-31

How Figma's Databases Team Lived to Tell the Scale

2024-05-29

Hierarchical World Models as Visual Whole-Body Humanoid Controllers

2024-05-28

LLM Problems for 2024-2025

2024-05-27

Diffusion for World Modeling: Visual Details Matter in Atari

2024-05-24

Where are the builders? | near.blog

2024-05-24

Daylight | A More Caring Computer

2024-05-23

A hacker’s guide to Language Models

2024-05-23

All about that grain — fxhash

2024-05-22

Neural Networks Graph Game

2024-05-21

UI Density || Matthew Ström

2024-05-21

Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet

2024-05-21

Observational Scaling Laws and the Predictability of Language Model Performance

2024-05-21

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning

2024-05-20

Identifying and Correcting Programming Language Behavior Misconceptions

2024-05-20

Enlightenmentware

2024-05-20

The Mirror of Language - deepfates

2024-05-19

Szymon Kaliski — Cartographist

2024-05-19

LoRA Learns Less and Forgets Less

2024-05-18

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

2024-05-18

Gemini 1.5 Technical Report

2024-05-18

Second System Effect

2024-05-17

Thinking out loud about 2nd-gen Email

2024-05-17

Context caching for Google Gemini

2024-05-16

Higher Order Company

2024-05-16

explained: latent consistency models

2024-05-16

Why do CPUs have multiple cache levels?

2024-05-16

⚛️ Deep Tech Database

2024-05-16

Near-Instant Full-File Edits

2024-05-15

Better & Faster Large Language Models via Multi-token Prediction

2024-05-15

Veo - Google DeepMind

2024-05-14

List of Patterns

2024-05-14

Greg Egan’s Home Page

2024-05-14

More Agents Is All You Need

2024-05-13

GPT-4o

2024-05-13

asm garden

2024-05-12

So We've Got a Memory Leak…

2024-05-11

Exploring Hacker News by mapping and analyzing 40 million posts and comments for fun

2024-05-09

Intriguing properties of neural networks

2024-05-08

A Neural Network Playground

2024-05-08

VILA: On Pre-training for Visual Language Models

2024-05-08

Efficient Transformers: A Survey

2024-05-08

Supplements I take | near.blog

2024-05-07

xLSTM: Extended Long Short-Term Memory

2024-05-07

The problem with using a UUID primary key in MySQL — PlanetScale

2024-05-07

Bountylist | Small bounties for serial hackers

2024-05-07

Map of my Internet

2024-05-06

Measure for Measure

2024-05-05

Monitoring energy usage with smart plugs, Prometheus and Grafana

2024-05-05

Machine Unlearning in 2024 - Ken Ziyu Liu - Stanford Computer Science

2024-05-05

Ilya 30u30

2024-05-05

kaiokendev/SuperCOT-dataset · Interesting Papers

2024-05-05

Dissecting the NVIDIA Volta GPU Architecture via Microbenchmarking

2024-05-04

How we’ve saved 98% in cloud costs by writing our own database

2024-05-03

Why Does Biological Evolution Work? A Minimal Model for Biological Evolution and Other Adaptive Processes

2024-05-03

When to Retrieve: Teaching LLMs to Utilize Information Retrieval Effectively

2024-05-01

KAN: Kolmogorov-Arnold Networks

2024-05-01

The days are long but the decades are short - Sam Altman

2024-04-30

Strangely, Matrix Multiplications on GPUs Run Faster When Given "Predictable" Data!

2024-04-30

Understanding Emergent Abilities of Language Models from the Loss Perspective

2024-04-29

Common DB schema change mistakes

2024-04-29

SB-1047 will stifle open-source AI and decrease safety

2024-04-29

Autodidax: JAX core from scratch — JAX documentation

2024-04-28

How I cut GTA Online loading times by 70%

2024-04-28

My favourite animation trick: exponential smoothing

2024-04-27

Refusal in LLMs is mediated by a single direction

2024-04-27

Let's Think Dot by Dot: Hidden Computation in Transformer Language Models

2024-04-27

Foundational distributed systems papers

2024-04-27

Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding

2024-04-26

Affordable, Rapid Bootstrapping of the Space Industry and Solar System Civilization

2024-04-25

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

2024-04-25

François Fleuret's ML Terms

2024-04-25

Self-playing Adversarial Language Game Enhances LLM Reasoning

2024-04-24

SnapKV: LLM Knows What You are Looking for Before Generation

2024-04-23

The Topos of Transformer Networks

2024-04-23

Google’s war against latency

2024-04-23

The Man Who Killed Google Search

2024-04-23

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

2024-04-22

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

2024-04-22

Equinox

2024-04-22

Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking

2024-04-22

jsomers.net | I should have loved biology

2024-04-22

VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time

2024-04-22

Load Balancing

2024-04-21

Speculative Decoding - philkrav

2024-04-21

From $r$ to $Q^*$: Your Language Model is Secretly a Q-Function

2024-04-21

Disentangling Length from Quality in Direct Preference Optimization

2024-04-21

LLM Agents can Autonomously Exploit One-day Vulnerabilities

2024-04-20

Devouring Details

2024-04-20

How to write good prompts: using spaced repetition to create understanding

2024-04-20

Using machine learning to generate good spaced repetition prompts from explanatory text

2024-04-20

Progress Update #1 from the GDM Mech Interp Team: Summary — AI Alignment Forum

2024-04-19

Justin's Guide to Computer Ergonomics | Justin Liang

2024-04-19

Editing Models with Task Arithmetic

2024-04-19

Meta Llama 3

2024-04-18

Online normalizer calculation for softmax

2024-04-17

Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study

2024-04-17

Why Facebook doesn’t use Git

2024-04-16

The race to replace Redis [LWN.net]

2024-04-16

My deep learning rig – Non_Interactive – Software & ML

2024-04-16

This is a teenager

2024-04-16

High Resolution Guitar Transcription via Domain Adaptation

2024-04-16

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length

2024-04-15

You Need to Pay Better Attention

2024-04-15

My Cat Alerted Me to a DDoS Attack

2024-04-14

Ring Attention Explained

2024-04-12

Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision

2024-04-12

From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples

2024-04-12

LEDITS++: Limitless Image Editing using Text-to-Image Models

2024-04-11

Anyone got a contact at OpenAI. They have a spider problem.

2024-04-11

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

2024-04-10

Code Search is Hard

2024-04-10

Double-Entry Bookkeeping as a Directed Graph · Matheus Portela

2024-04-10

Wu's Method can Boost Symbolic AI to Rival Silver Medalists and AlphaGeometry to Outperform Gold Medalists at IMO Geometry

2024-04-10

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

2024-04-09

AutoCodeRover: Autonomous Program Improvement

2024-04-09

TacticAI: an AI assistant for football tactics - Google DeepMind

2024-04-09

GPT & Chill | Machine Learning Practice Problems

2024-04-09

ML Times | Lambda Labs

2024-04-09

CodeGemma

2024-04-09

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs

2024-04-08

Physics of Language Models: Part 3.2, Knowledge Manipulation

2024-04-08

Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws

2024-04-08

Physics of Language Models: Part 3.1, Knowledge Storage and Extraction

2024-04-08

Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction

2024-04-08

Antonymph

2024-04-08

AWS CLI Max Concurrent Requests Tuning – Jason R. Ralph

2024-04-07

AutoWebGLM: Bootstrap And Reinforce A Large Language Model-based Web Navigating Agent

2024-04-07

Personalized Audiobook Recommendations at Spotify Through Graph Neural Networks

2024-04-07

The RenTech Process | Nick Patterson

2024-04-06

Representation Engineering Mistral-7B an Acid Trip

2024-04-05

94% on CIFAR-10 in 3.29 Seconds on a Single GPU

2024-04-04

The end of Airplane.dev | Benjamin Yolken

2024-04-04

ReFT: Representation Finetuning for Language Models

2024-04-04

Training LLMs over Neurally Compressed Text

2024-04-04

Compressed Sensing Lecture | Terence Tao

2024-04-04

Anatomy of a credit card rewards program

2024-04-04

Do language models plan ahead for future tokens?

2024-04-04

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

2024-04-03

ReALM: Reference Resolution As Language Modeling

2024-04-02

After the Beep

2024-04-02

Some tactics for writing in public | Julia Evans

2024-04-02

How we built the GitHub globe

2024-04-02

Many-shot jailbreaking \ Anthropic

2024-04-02

Reflections on Qualitative Research

2024-04-01

Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models

2024-04-01

Hierarchical Navigable Small Worlds (HNSW) | Frank’s Ramblings

2024-04-01

FirstMark | 2024 MAD (ML/AI/Data) Landscape

2024-04-01

Jamba: A Hybrid Transformer-Mamba Language Model

2024-04-01

Listening with LLM - moomou

2024-04-01

What Shapes Do Matrix Multiplications Like?

2024-04-01

A Story About ‘Magic'

2024-04-01

The case of the 500-mile email

2024-04-01

The Wi-Fi only works when it's raining

2024-04-01

Bridging Discrete and Backpropagation: Straight-Through and Beyond

2024-04-01

LLaMA Now Goes Faster on CPUs

2024-03-31

Everything I know about the XZ backdoor

2024-03-31

The Merge

2024-03-30

TERRA — A COMPANION FOR MINDFUL WANDERING

2024-03-29

Navigating the Challenges and Opportunities of Synthetic Voices

2024-03-29

Introducing Jamba

2024-03-28

Long-form factuality in large language models

2024-03-27

The Unreasonable Ineffectiveness of the Deeper Layers

2024-03-27

Unlocking progress

2024-03-27

Mess Detector with Redstone

2024-03-26

Building WOPR: A 7x4090 AI Server

2024-03-26

Processing One Billion Rows in PHP

2024-03-26

Anomalous tokens reveal the original identities of Instruct models

2024-03-26

Fixing the train-test resolution discrepancy

2024-03-25

Welcome to hell - cybermonk

2024-03-25

Scent Teleportation

2024-03-25

grep, awk and sed

2024-03-25

STARLINKMAP.ORG - Real-Time Starlink Satellite Tracker

2024-03-24

The Cognitive Style of Powerpoint - Tufte

2024-03-24

Unexplanations: sql is syntactic sugar for relational algebra

2024-03-23

Automated Unit Test Improvement using Large Language Models at Meta

2024-03-22

Learn Git Branching

2024-03-21

Nintil - Massive input and/or spaced repetition

2024-03-21

Evolutionary Optimization of Model Merging Recipes

2024-03-20

Evolving New Foundation Models: Unleashing the Power of Automating Model Development

2024-03-20

How to Train Really Large Models on Many GPUs? | Lil'Log

2024-03-19

Bringing HPC Techniques to Deep Learning - Andrew Gibiansky

2024-03-19

Index 1,600,000,000 Keys with Automata and Rust - Andrew Gallant's Blog

2024-03-19

infinite backrooms

2024-03-19

🔬 How Do Language Models put Attention Weights over Long Context?

2024-03-18

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

2024-03-18

Choose Good Quests – Founders Fund

2024-03-18

Isaac Asimov's "Three Laws of Robotics"

2024-03-17

Superiority by Arthur C. Clarke (Full Text) – Metallicman

2024-03-17

Semantic Complexity in End-to-End Spoken Language Understanding

2024-03-17

Open Release of Grok-1

2024-03-17

Integer tokenization is insane

2024-03-17

OpenAI Microscope

2024-03-16

How web bloat impacts users with slow devices

2024-03-16

zeux.io - LLM inference speed of light

2024-03-16

i feel dizzy (again) - by Judah - Be Wrong

2024-03-15

Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking

2024-03-15

Towards General Computer Control: A Multimodal Agent for Red Dead Redemption II as a Case Study

2024-03-14

MUX-PLMs: Data Multiplexing for High-throughput Language Models

2024-03-14

A very short solution (13 lines) to ICPC WF Problem N, in Julia - Codeforces

2024-03-14

Lambda on hard mode: Inside Modal's web infrastructure | Modal Blog

2024-03-14

SIMA generalist AI agent for 3D virtual environments - Google DeepMind

2024-03-13

Stealing Part of a Production Language Model

2024-03-13

Truffle–1 • Features & Specs

2024-03-12

Building Meta’s GenAI Infrastructure

2024-03-12

How HEAD works in git

2024-03-11

JSON Canvas — An open file format for infinite canvas data

2024-03-11

Ushering in the Thermodynamic Future - Extropic

2024-03-11

S3 is files, but not a filesystem

2024-03-10

My new job is AI sommelier and I detect the bouquet of progress

2024-03-09

The GPT-4 barrier has finally been broken

2024-03-09

Notes from a Prompt Factory

2024-03-09

Luck Surface Area

2024-03-08

understanding - Nabeel S. Qureshi

2024-03-08

Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

2024-03-08

Euler’s FizzBuzz

2024-03-08

Surya | High Agency

2024-03-07

Building a Profitable, Bootstrapped AI App to over 50,000 Users

2024-03-07

DUSt3R: Geometric 3D Vision Made Easy

2024-03-07

DUSt3R: Geometric 3D Vision Made Easy

2024-03-07

You can not simply publicly access private secure links, can you?

2024-03-07

A Programmer’s Introduction to Unicode

2024-03-07

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

2024-03-07

tinyBenchmarks: evaluating LLMs with fewer examples

2024-03-06

Student of Games: A unified learning algorithm for both perfect and imperfect information games

2024-03-06

Training great LLMs entirely from ground zero in the wilderness as a startup — Yi Tay

2024-03-05

Talking-Heads Attention

2024-03-05

Help! Linux ate my RAM!

2024-03-04

The Hunt for the Missing Data Type

2024-03-04

The Grug Brained Developer

2024-03-03

Learning Theory from First Principles

2024-03-03

bash debugging | wizardzines

2024-03-03

On Commodities, Pricing, and Assets | Evan Conrad

2024-03-02

How video games use LUTs and how you can too

2024-02-28

MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge

2024-02-28

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

2024-02-27

Shape Suffixes — Good Coding Style | by Noam Shazeer

2024-02-27

Airfoil – Bartosz Ciechanowski

2024-02-27

CPU Flame Graphs

2024-02-27

1950's Graphic Studies from a Gujarati Designer

2024-02-27

The Technium: You Are Not Late

2024-02-26

Picking a vector database: a comparison and guide for 2023

2024-02-26

QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks

2024-02-25

Orca-Math: Unlocking the potential of SLMs in Grade School Math

2024-02-25

Coroutines in C

2024-02-25

TinyStories: How Small Can Language Models Be and Still Speak Coherent English?

2024-02-24

An Empirical Evaluation of LLMs for Solving Offensive Security Challenges

2024-02-23

Mamba: The Easy Way

2024-02-23

OK-Robot: What Really Matters in Integrating Open-Knowledge Models for Robotics

2024-02-23

Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping

2024-02-23

SDXL Lightning - by fal.ai

2024-02-22

Supermaven

2024-02-22

The killer app of Gemini Pro 1.5 is video

2024-02-21

Singular Value Decomposition Part 1: Perspectives on Linear Algebra – Math ∩ Programming

2024-02-21

Strategy Letter V – Joel on Software

2024-02-21

Neural Network Diffusion

2024-02-21

A Software-defined Tensor Streaming Multiprocessor for Large-scale Machine Learning

2024-02-21

Gemma: Google introduces new state-of-the-art open models

2024-02-21

Scaling ChatGPT: Five Real-World Engineering Challenges

2024-02-20

My benchmark for large language models

2024-02-20

In defense of simple architectures

2024-02-20

Mamba: The Hard Way

2024-02-19

SPAR: Personalized Content-Based Recommendation via Long Engagement Attention

2024-02-19

Arthur C. Clarke: The Nine Billion Names of God

2024-02-18

Clean your codebase with basic information theory

2024-02-18

Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents

2024-02-17

My Sixth Year as a Bootstrapped Founder · mtlynch.io

2024-02-16

UI = f(statesⁿ)

2024-02-16

How to Train Data-Efficient LLMs

2024-02-16

V-JEPA: The next step toward advanced machine intelligence

2024-02-15

Gradient Descent into Madness - Building an LLM from scratch

2024-02-15

LESS: Selecting Influential Data for Targeted Instruction Tuning

2024-02-15

Introducing Gemini 1.5, Google's next-generation AI model

2024-02-15

OpenAI Sora

2024-02-15

The Best GPUs for Deep Learning in 2023 — An In-depth Analysis

2024-02-14

A Full Hardware Guide to Deep Learning — Tim Dettmers

2024-02-14

The boundary of neural network trainability is fractal

2024-02-13

Understanding Mixtral-8x7b

2024-02-12

The internet used to be fun

2024-02-12

Kalman Filter Explained Simply

2024-02-12

Balancing cube – Willem Pennings

2024-02-11

Stripe Press — The Art of Doing Science and Engineering

2024-02-11

Tools for Verifying Neural Models' Training Data

2024-02-10

Grandmaster-Level Chess Without Search

2024-02-10

ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

2024-02-10

An Interactive Agent Foundation Model

2024-02-10

Data Structures for Data-Intensive Applications

2024-02-09

Hyperbolic Image Embeddings

2024-02-09

Figure out who's leaving the company: dump, diff, repeat

2024-02-09

Memory Consolidation Enables Long-Context Video Understanding

2024-02-08

Log of conversation with gpt-4-1106-preview solving a cybersecurity challenge

2024-02-08

A Distributed Systems Reading List

2024-02-08

A search engine in 80 lines of Python

2024-02-07

Programming in 1969

2024-02-05

Vesuvius Challenge 2023 Grand Prize awarded: we can read the scrolls! | Vesuvius Challenge

2024-02-05

Understanding LLMs: A Comprehensive Overview from Training to Inference

2024-02-05

Fastest JSON Decoding for Local LLMs with Compressed Finite State Machine | LMSYS Org

2024-02-05

Nomic Embed: Training a Reproducible Long Context Text Embedder

2024-02-05

Efficient Exploration for LLMs

2024-02-04

Beyond Self-Attention: How a Small Language Model Predicts the Next Token | Shyam's Blog

2024-02-04

Browser extensions are underrated: the promise of hackable software

2024-02-04

Scaling Sparse Fine-Tuning to Large Language Models

2024-02-03

Sparse is Enough in Scaling Transformers

2024-02-02

Lexinvariant Language Models

2024-02-02

how a neuron learns - quentin

2024-02-02

Tree Prompting: Efficient Task Adaptation without Fine-Tuning

2024-02-02

My favourite Git commit | dhwthompson.com

2024-02-01

Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens

2024-01-31

Infinite Craft

2024-01-31

Digital Voicing of Silent Speech

2024-01-30

Muffin or Chihuahua? Challenging Large Vision-Language Models with Multipanel VQA

2024-01-30

Efficiently Programming Large Language Models using SGLang

2024-01-30

StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generation

2024-01-30

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

2024-01-30

Chess Tactics Explained in English: Ward Farnsworth

2024-01-29

Where do LLMs spend their FLOPS? - by Finbarr Timbers

2024-01-29

Practical Deep Learning | Jack Morris

2024-01-29

Learning Universal Predictors

2024-01-28

SliceGPT: Compress Large Language Models by Deleting Rows and Columns

2024-01-28

I looked through attacks in my access logs

2024-01-28

Just use the command line

2024-01-28

Matryoshka Representation Learning

2024-01-27

Lossy CSS compression for fun and loss (or profit)

2024-01-26

MambaByte: Token-free Selective State Space Model

2024-01-25

VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks

2024-01-25

Adept Fuyu-Heavy: A new multimodal model

2024-01-24

Zayd's Blog – Why is machine learning 'hard'?

2024-01-23

Machine Culture

2024-01-23

What's that touchscreen in my room? | Nikita Lapkov

2024-01-19

AGI Trades

2024-01-19

Self-Rewarding Language Models

2024-01-18

AlphaGeometry: An Olympiad-level AI system for geometry - Google DeepMind

2024-01-17

How Apple built iCloud to store billions of databases

2024-01-17

Rephrase and Respond: Let Large Language Models Ask Better Questions for Themselves

2024-01-16

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference

2024-01-16

Fine-tuning gpt-3.5-turbo to learn to play "Connections"

2024-01-15

The Unreasonable Effectiveness of Easy Training Data for Hard Tasks

2024-01-15

Effective learning: Twenty rules of formulating knowledge - SuperMemo

2024-01-15

Micromorts

2024-01-15

Perfecting Merge-kit MoE's

2024-01-15

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training

2024-01-12

Vector Databases: A Technical Primer

2024-01-12

The most entertaining outcome is the most likely • Surya

2024-01-12

A Love Letter to Tinkerable Software

2024-01-11

Factory factory factory

2024-01-10

I am a Strange Dataset: Metalinguistic Tests for Language Models

2024-01-10

How I pwned half of America’s fast food chains, simultaneously

2024-01-10

All my favorite tracing tools: eBPF, QEMU, Perfetto, new ones I built and more - Tristan Hume

2024-01-09

A Minimaximalist Approach to Reinforcement Learning from Human Feedback

2024-01-09

A Meta Reinforcement Learning Approach for Predictive Autoscaling in the Cloud

2024-01-08

MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts

2024-01-08

Terry Tao's Generals

2024-01-08

Mixtral of Experts

2024-01-08

An Overview of Distributed PostgreSQL Architectures | Crunchy Data Blog

2024-01-08

A simulation of me: fine-tuning an LLM on 240k text messages - Edward Donner

2024-01-07

Advice to Young People, The Lies I Tell Myself - jxnl.co

2024-01-07

Behind the scenes: the struggle for each paper

2024-01-07

Retro on Viberary | Vicki Boykis

2024-01-06

LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning

2024-01-06

savelost

2024-01-05

V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs

2024-01-05

Tensor Diagram Notation

2024-01-05

LLM Augmented LLMs: Expanding Capabilities through Composition

2024-01-04

LLaMA Pro: Progressive LLaMA with Block Expansion

2024-01-04

Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation

2024-01-04

What’s up with LLMs representing XORs of arbitrary features? — LessWrong

2024-01-04

Efficient LLM inference - by Finbarr Timbers

2024-01-04

The Missing Semester of Your CS Education

2024-01-03

My experience on finetuning LLMs on custom data - Reddit

2024-01-03

Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models

2024-01-03

A Spectral Condition for Feature Learning

2024-01-03

Neural Slime Volleyball

2024-01-03

Mind2Web: Towards a Generalist Agent for the Web

2024-01-02

SeeAct - a generalist web agent

2024-01-02

CommonCanvas: An Open Diffusion Model Trained with Creative-Commons Images

2024-01-02

What's In My Big Data?

2024-01-02

Proving Test Set Contamination in Black Box Language Models

2024-01-02

Unsupervised Temperature Scaling: An Unsupervised Post-Processing Calibration Method of Deep Networks

2024-01-02

GPQA: A Graduate-Level Google-Proof Q&A Benchmark

2024-01-02

Representation Alignment in Neural Networks

2024-01-02

how do you ocr on a mac using the cli or just python for free | the greg technology blog

2024-01-02

Getting things done (in small increments)

2024-01-01

The Manga Guide to Linear Algebra

2024-01-01

Explaining grokking through circuit efficiency

2024-01-01

The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning

2024-01-01

MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining

2024-01-01

Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

2024-01-01

A* Tricks for Videogame Path Finding | Tim Mastny

2024-01-01

Employee #1 - YC

2023-12-29

Evolution as Backstop for Reinforcement Learning · Gwern.net

2023-12-29

4 billion if statements | Blabbin’

2023-12-28

Replacing my best friends with an LLM trained on 500,000 group chat messages

2023-12-28

Man-Computer Symbiosis

2023-12-27

Text Editor: Data Structures | averylaird.com

2023-12-26

LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment

2023-12-26

Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models

2023-12-26

Understanding xii.tex | Blog

2023-12-23

Adapting Large Language Models via Reading Comprehension

2023-12-23

Fact Finding: Attempting to Reverse-Engineer Factual Recall on the Neuron Level (Post 1) — AI Alignment Forum

2023-12-23

An In-depth Look at Gemini's Language Abilities

2023-12-22

How Big is YouTube? - Ethan Zuckerman

2023-12-22

AppAgent: Multimodal Agents as Smartphone Users

2023-12-22

ROBOT9000 and #xkcd-signal: Attacking Noise in Chat

2023-12-21

Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesis

2023-12-21

Deep Differentiable Logic Gate Networks

2023-12-21

What I Wish Someone Had Told Me - Sam Altman

2023-12-21

Gemini: A Family of Highly Capable Multimodal Models

2023-12-20

Starter Guide to SF for Founders

2023-12-20

Chatbot Arena - lmsys

2023-12-20

Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

2023-12-20

Information hygiene - ftlsid

2023-12-19

Sindarin AI Pitch Deck

2023-12-19

Smarter Child - Sindarin

2023-12-19

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

2023-12-19

math team, and other horrible things you do to get into stanford - bene dictio

2023-12-19

OpenAI Preparedness Framework

2023-12-18

How to make LLMs go fast

2023-12-18

Weight subcloning: direct initialization of transformers using larger pretrained ones

2023-12-17

Knowledge Distillation of Large Language Models

2023-12-16

Del Complex - VonGoom

2023-12-14

A Conversation with Grimes, Roon, and Curio's Founders • Curio

2023-12-14

papers.day: AI papers made easy

2023-12-14

StemGen: A music generation model that listens

2023-12-14

DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines

2023-12-14

FunSearch: Making new discoveries in mathematical sciences using Large Language Models - Google DeepMind

2023-12-14

Weak-to-strong generalization

2023-12-14

Bad Students Make Great Teachers: Active Learning Accelerates Large-Scale Visual Understanding

2023-12-14

Concept Learning with Energy-Based Models

2023-12-13

Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models

2023-12-13

Dear future undergraduate researcher

2023-12-13

Delphi - Clone yourself

2023-12-13

In The ChatGPT Era, Your Data is More Valuable Than Ever · Hazy Research

2023-12-13

Zoology (Blogpost 1): Measuring and Improving Recall in Efficient Language Models · Hazy Research

2023-12-13

GitHub - Mozilla-Ocho/llamafile: Distribute and run LLMs with a single file.

2023-12-13

Fine-tuning language models in embedding space

2023-12-13

Towards Reasoning in Large Language Models: A Survey

2023-12-13

Bash One-Liners for LLMs

2023-12-13

Machine Learning Systems

2023-12-13

Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models

2023-12-12

LLM360: Towards Fully Transparent Open-Source LLMs

2023-12-12

Steering at the Frontier: Extending the Power of Prompting - Microsoft Research

2023-12-12

Phi-2: The surprising power of small language models - Microsoft Research

2023-12-12

Answer.AI - Practical AI R&D

2023-12-12

Privacy Auditing with One (1) Training Run

2023-12-12

Embracing change and resetting expectations – Microsoft Unlocked

2023-12-11

Audiobox - Meta

2023-12-11

Looped Transformers as Programmable Computers

2023-12-11

Can you feel the MoE? Mixtral available with over 100 tokens per second through Together Platform!

2023-12-11

Introducing General World Models

2023-12-11

Efficient Transformers with Dynamic Token Pooling

2023-12-11

Mechanical Watch – Bartosz Ciechanowski

2023-12-11

Mixtral of experts | Mistral AI | Open source models

2023-12-11

A Remake of the Google Gemini Fake Demo, Except Using GPT-4 and It’s Real

2023-12-10

Web Design in 4 minutes

2023-12-10

On the Theory of Stochastic Processes, With Particular Reference to Applications

2023-12-10

Linear Diffusion: Building a Diffusion Model from linear Components — Count Bayesie

2023-12-10

HyperAttention: Long-context Attention in Near-Linear Time

2023-12-10

Project Lyra

2023-12-10

How Lucy Found its Way | Lockheed Martin

2023-12-10

Parallelizing Linear Recurrent Neural Nets Over Sequence Length

2023-12-10

Modeling Sequences with Structured State Spaces - Albert Gu

2023-12-09

CONVERSABLE ECONOMIST: 1957: When Machines that Think, Learn, and Create Arrived

2023-12-09

Why GOFAI failed

2023-12-09

QuIP#

2023-12-08

A New Alchemy: Language Model Development as a Subfield?

2023-12-08

Paving the way to efficient architectures: StripedHyena-7B, open source models offering a glimpse into a world beyond Transformers

2023-12-08

MegaBlocks: Efficient Sparse Training with Mixture-of-Experts

2023-12-08

Secrets of RLHF in Large Language Models Part I: PPO

2023-12-07

Making noisy SVGs — Daniel Immke

2023-12-07

Efficient Transformer Knowledge Distillation: A Performance Review

2023-12-07

Announcing Purple Llama: Towards open trust and safety in the new world of generative AI

2023-12-07

Aswath Krishnan: Aha Explanations

2023-12-06

Silent Data Corruptions at Scale

2023-12-06

Gemini Technical Report

2023-12-06

Introducing Gemini: Google’s most capable AI model yet

2023-12-06

The Normal Blog - A First Demonstration of Thermodynamic Matrix Inversion

2023-12-05

Thermodynamic Linear Algebra

2023-12-05

Feynman's Nobel Ambition

2023-12-05

Introducing the AI Alliance

2023-12-05

Language Model Inversion

2023-12-05

One Embedder, Any Task: Instruction-Finetuned Text Embeddings

2023-12-05

Language model self-teaching for domain adaptation | Morph

2023-12-05

Putting the "You" in CPU

2023-12-05

iMessage, explained - JJTech

2023-12-05

Generative Modeling by Estimating Gradients of the Data Distribution

2023-12-05

Modeling Context in Referring Expressions

2023-12-05

Are Emergent Abilities of Large Language Models a Mirage?

2023-12-04

Towards Accurate Differential Diagnosis with Large Language Models

2023-12-04

Every Model Learned by Gradient Descent Is Approximately a Kernel Machine

2023-12-04

mcyoung - compilers blog

2023-12-04

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

2023-12-04

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

2023-12-04

Extropic assembles itself from the future

2023-12-04

Sequential Modeling Enables Scalable Learning for Large Vision Models

2023-12-03

LLM Visualization

2023-12-03

CoDi-2: In-Context, Interleaved, and Interactive Any-to-Any Generation

2023-12-03

Unnatural Error Correction: GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text

2023-12-03

mlabonne/llm-course: Course to get into Large Language Models.

2023-12-02

One-step Diffusion with Distribution Matching Distillation

2023-12-01

Accelerating Generative AI with PyTorch II: GPT, Fast | PyTorch

2023-11-30

Plexus Voices

2023-11-29

trudy.computer

2023-11-29

Feynman's Tips on Physics

2023-11-29

Introducing SDXL Turbo: A Real-Time Text-to-Image Generation Model — Stability AI

2023-11-29

Some intuitions about large language models — Jason Wei

2023-11-28

Intro To Large Language Models (LLMs)

2023-11-28

Scalable Extraction of Training Data from (Production) Language Models

2023-11-28

Extracting Training Data from ChatGPT

2023-11-28

Pika Labs

2023-11-28

What Universal Human Experiences Are You Missing Without Realizing It? | Slate Star Codex

2023-11-28

Neural Networks, Types, and Functional Programming -- colah's blog

2023-11-28

Positional Description Matters for Transformers Arithmetic

2023-11-28

The Core Primitive of AI: Experimental Learning

2023-11-27

Calibrated Language Models Must Hallucinate

2023-11-27

Flipper Zero

2023-11-27

A ConvNet for the 2020s

2023-11-27

Simplifying Transformer Blocks

2023-11-27

Using llama.cpp with AWS instances · ggerganov/llama.cpp

2023-11-27

Woodpecker: Hallucination Correction for Multimodal Large Language Models

2023-11-27

Mistral AI Strategic Memo

2023-11-27

AI x Labor Lit Review

2023-11-27

Llama from scratch (or how to implement a paper without crying) | Brian Kitano

2023-11-26

Adding Gradient Noise Improves Learning for Very Deep Networks

2023-11-24

Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization

2023-11-24

Vector Quantized Models for Planning

2023-11-24

Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model

2023-11-24

🔴 Live | Stripe BFCM

2023-11-24

White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?

2023-11-24

Black-Box Prompt Optimization: Aligning Large Language Models without Model Training

2023-11-23

ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and Quantization

2023-11-23

Equivalence Between Policy Gradients and Soft Q-Learning

2023-11-23

Shopify's Black Friday Cyber Monday Live Coverage

2023-11-23

Breathing Life Into Sketches Using Text-to-Video Priors

2023-11-23

Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers

2023-11-23

Rainbow: Combining Improvements in Deep Reinforcement Learning

2023-11-23

How to Build a Multi-GPU System for Deep Learning in 2023

2023-11-23

Senior Engineer Jobsearch

2023-11-23

Transformer inference tricks - by Finbarr Timbers

2023-11-23

Neural Story Planning

2023-11-23

Reinforced Self-Training (ReST) for Language Modeling

2023-11-23

Efficient Estimation of Word Representations in Vector Space

2023-11-23

How I'm able to take notes in mathematics lectures using LaTeX and Vim | Gilles Castel

2023-11-23

Confronting Reward Model Overoptimization with Constrained RLHF

2023-11-22

WebArena: A Realistic Web Environment for Building Autonomous Agents

2023-11-22

A* Search Without Expansions: Learning Heuristic Functions with Deep Q-Networks

2023-11-22

Toward General Virtual Agents

2023-11-22

Language Models can Solve Computer Tasks

2023-11-22

Let's Verify Step by Step

2023-11-22

Offline RL for Natural Language Generation with Implicit Language Q Learning

2023-11-22

Why GPT-3.5 is (mostly) cheaper than Llama 2

2023-11-22

Hixie's Natural Log: Reflecting on 18 years at Google

2023-11-22

FP8-LM: Training FP8 Large Language Models

2023-11-22

DiLoCo: Distributed Low-Communication Training of Language Models

2023-11-21

Bad Global Minima Exist and SGD Can Reach Them

2023-11-21

LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuning

2023-11-21

TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP

2023-11-21

Break the Sequential Dependency of LLM Inference Using Lookahead Decoding | LMSYS Org

2023-11-21

Introducing Stable Video Diffusion — Stability AI

2023-11-21

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

2023-11-21

Embark: Dynamic documents for making plans

2023-11-21

Physics of Language Models: Part 1, Context-Free Grammar

2023-11-21

GitHub - stas00/ml-engineering: Machine Learning Engineering Guides and Tools

2023-11-21

Exponentially Faster Language Modelling

2023-11-20

Orca 2: Teaching Small Language Models How to Reason

2023-11-20

LLMs cannot find reasoning errors, but can correct them!

2023-11-20

Implicit Chain of Thought Reasoning via Knowledge Distillation

2023-11-20

Text and Code Embeddings by Contrastive Pre-Training

2023-11-20

Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity

2023-11-20

blog | Yang Song

2023-11-19

StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

2023-11-19

An automatic indexing system for Postgres

2023-11-18

Text-to-3D using Gaussian Splatting

2023-11-18

Chronicles of OPT development

2023-11-18

How I became a machine learning practitioner

2023-11-18

Accelerating Generative AI with PyTorch: Segment Anything, Fast | PyTorch

2023-11-17

Is Attention All You Need?

2023-11-16

Fine-tuning Language Models for Factuality

2023-11-14

xAI PromptIDE

2023-11-14

MemGPT: Towards LLMs as Operating Systems

2023-11-14

You and Your Research - Richard Hamming

2023-11-14

Beyond Memorization: Violating Privacy Via Inference with Large Language Models

2023-11-14

The Transient Nature of Emergent In-Context Learning in Transformers

2023-11-14

SadServers - Troubleshooting Linux Servers

2023-11-14

Summarizing books with human feedback

2023-11-13

Experiments in Image Variation

2023-11-13

Levels of AGI: Operationalizing Progress on the Path to AGI

2023-11-13

Hacking Google Bard - From Prompt Injection to Data Exfiltration · Embrace The Red

2023-11-13

Fast and forward stable randomized algorithms for linear least-squares problems

2023-11-13

Does Sketching Work? – Ethan N. Epperly

2023-11-13

At the Intersection of LLMs and Kernels - Research Roundup

2023-11-13

Troy Hunt: Beg Bounties

2023-11-12

Hacker's guide to Neural Networks

2023-11-12

A Recipe for Training Neural Networks

2023-11-12

JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models

2023-11-12

Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V

2023-11-11

The Quest to Replace Passwords

2023-11-10

the world’s largest distributed LLM training job on TPU v5e | Google Cloud Blog

2023-11-10

Add AI to your Playwright tests | ZeroStep

2023-11-10

What I learned getting acquired by Google

2023-11-09

Typing Fast Is About Latency, Not Throughput

2023-11-09

Transformers as Recognizers of Formal Languages: A Survey on Expressivity

2023-11-09

NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities

2023-11-09

OtterHD: A High-Resolution Multi-modality Model

2023-11-08

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

2023-11-08

Beej's Guide to Network Concepts

2023-11-08

List of emerging technologies - Wikipedia

2023-11-08

GLaMM: Pixel Grounding Large Multimodal Model

2023-11-08

The Linear Representation Hypothesis and the Geometry of Large Language Models

2023-11-08

Do LLMs exhibit human-like response biases? A case study in survey design

2023-11-08

GateLoop: Fully Data-Controlled Linear Recurrence for Sequence Modeling

2023-11-07

Learning to Compress Prompts with Gist Tokens

2023-11-07

CogVLM: Visual Expert for Pretrained Language Models

2023-11-07

Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models

2023-11-06

Pretraining Data Mixtures Enable Narrow Model Selection Capabilities in Transformer Models

2023-11-05

The Matrix Calculus You Need For Deep Learning

2023-11-03

💡 How does GPT Obtain its Ability? Tracing Emergent Abilities of Language Models to their Sources

2023-11-03

Efficient LLM Inference on CPUs

2023-11-03

What Algorithms can Transformers Learn? A Study in Length Generalization

2023-11-01

Phind - AI Search Engine and Pair Programmer

2023-11-01

Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection

2023-10-31

Brain decoding: toward real-time reconstruction of visual perception

2023-10-31

The Impact of Depth and Width on Transformer Language Model Generalization

2023-10-31

Deta Space

2023-10-30

CodeFusion: A Pre-trained Diffusion Model for Code Generation

2023-10-30

How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers

2023-10-30

Internet Artifacts

2023-10-26

ConvNets Match Vision Transformers at Scale

2023-10-26

The “it” in AI models is the dataset. – Non_Interactive – Software & ML

2023-10-26

QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models

2023-10-25

Detecting Pretraining Data from Large Language Models

2023-10-25

Animated AI

2023-10-24

Monosemantic Search

2023-10-24

Open Source Replication & Commentary on Anthropic's Dictionary Learning Paper — LessWrong

2023-10-24

On Calibration of Modern Neural Networks

2023-10-24

Matryoshka Diffusion Models

2023-10-24

AI for Mathematics: A Cognitive Science Perspective

2023-10-24

Towards Understanding Sycophancy in Language Models

2023-10-23

Folklore.org: -2000 Lines Of Code

2023-10-22

Large Language Models Cannot Self-Correct Reasoning Yet

2023-10-21

Chain-of-Verification Reduces Hallucination in Large Language Models

2023-10-20

Introducing pplx-api

2023-10-20

Embodied AI: Toward effective collaboration between humans and socially intelligent robots

2023-10-20

The 5 Levels of Readable Code

2023-10-20

Dalle-3 Whitepaper

2023-10-19

Eureka: Human-Level Reward Design via Coding Large Language Models

2023-10-19

uc berkeley ml club talk oct 18 2023 (jason wei) - Google Slides

2023-10-19

What I Learned about Payment Systems While Working at a Pizza Place — Nick Janetakis

2023-10-18

REPLUG: Retrieval-Augmented Black-Box Language Models

2023-10-18

unRLHF - Efficiently undoing LLM safeguards — LessWrong

2023-10-18

The Efficiency Misnomer

2023-10-17

A Long Way to Go: Investigating Length Correlations in RLHF

2023-10-17

In-Context Pretraining: Language Modeling Beyond Document Boundaries

2023-10-17

Factorio and Software Engineering

2023-10-14

Finetuning LLMs with LoRA and QLoRA: Insights from Hundreds of Experiments - Lightning AI

2023-10-13

TimeGPT-1

2023-10-13

Flash-Decoding for Long-Context Inference | Princeton NLP Group

2023-10-13

Tensor Programs VI: Feature Learning in Infinite-Depth Neural Networks

2023-10-13

Large Language Models Are Zero-Shot Time Series Forecasters

2023-10-13

Text Embeddings Reveal (Almost) As Much As Text

2023-10-12

Segment Anything

2023-10-11

Mistral 7B

2023-10-11

How to legally pirate every font on Earth in an afternoon - Will DePue

2023-10-11

Scaling Slack’s Job Queue - Slack Engineering

2023-10-09

Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models

2023-10-09

The Last Question

2023-10-08

Git scraping: track changes over time by scraping to a Git repository

2023-10-08

Subdomain Center

2023-10-07

Ring Attention with Blockwise Transformers for Near-Infinite Context

2023-10-07

Fast · Patrick Collison

2023-10-07

Functions are Vectors

2023-10-07

Everything is Fertile

2023-10-06

Decoding speech perception from non-invasive brain recordings

2023-10-05

Towards Monosemanticity: Decomposing Language Models With Dictionary Learning

2023-10-05

Everything about Distributed Training and Efficient Finetuning | Sumanth's Personal Website

2023-10-05

The Turing Test — Can you tell a human from an AI?

2023-10-05

Computers can be understood - Made of Bugs

2023-10-05

Damn Cool Algorithms

2023-10-05

Think before you speak: Training Language Models With Pause Tokens

2023-10-05

Large Language Models as Analogical Reasoners

2023-10-05

turbopuffer

2023-10-04

Effective Spaced Repetition

2023-10-04

Language Models Represent Space and Time

2023-10-04

Choose Postgres queue technology :: Adriano Caloiaro's personal blog

2023-10-03

Announcing our Multimodal AI Assistant - Reka AI

2023-10-03

Scaling up learning across many different robot types

2023-10-03

Efficient Streaming Language Models with Attention Sinks

2023-10-02

3D Gaussian Splatting for Real-Time Radiance Field Rendering

2023-10-02

The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)

2023-10-01

Directly Fine-Tuning Diffusion Models on Differentiable Rewards

2023-10-01

Vision Transformers Need Registers

2023-09-29

Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond

2023-09-29

Wifi without internet on a Southwest flight - james vaughan

2023-09-28

Orca: Progressive Learning from Complex Explanation Traces of GPT-4

2023-09-28

Jointly Training Large Autoregressive Multimodal Models

2023-09-28

Bringing open AI models to the frontier | Mistral AI | Open source models

2023-09-27

OCR-free Document Understanding Transformer

2023-09-25

The Adventure of the Errant Hardware

2023-09-20

DALL·E 3

2023-09-20

Language Modeling Is Compression

2023-09-19

How To Become A Hacker

2023-09-14

Efficient Memory Management for Large Language Model Serving with PagedAttention

2023-09-13

Uncovering mesa-optimization algorithms in Transformers

2023-09-12

MADLAD-400: A Multilingual And Document-Level Large Audited Dataset

2023-09-12

Nougat: Neural Optical Understanding for Academic Documents

2023-09-12

Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning

2023-09-12

Textbooks Are All You Need II: phi-1.5 technical report

2023-09-11

I made a transformer by hand (no training!)

2023-09-11

Are Emergent Abilities in Large Language Models just In-Context Learning?

2023-09-09

Large Language Models as Optimizers

2023-09-07

Towards CausalGPT: A Multi-Agent Approach for Faithful Knowledge Reasoning via Promoting Causal Consistency in LLMs

2023-09-07

Releasing Persimmon-8B

2023-09-07

Universal and Transferable Attacks on Aligned Language Models

2023-09-05

fast.ai - Can LLMs learn from a single example?

2023-09-05

Robust fine-tuning of zero-shot models

2023-09-04

Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time

2023-09-04

A GPT-4 Capability Forecasting Challenge

2023-09-04

YaRN: Efficient Context Window Extension of Large Language Models

2023-09-03

RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback

2023-09-03

Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models

2023-09-02

Fast Inference from Transformers via Speculative Decoding

2023-09-01

Accelerating Large Language Model Decoding with Speculative Sampling

2023-09-01

Blockwise Parallel Decoding for Deep Autoregressive Models

2023-09-01

Accelerating LLM Inference with Staged Speculative Decoding

2023-08-31

DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining

2023-08-31

Absurd Success @ marginalia.nu

2023-08-30

LLMatic: Neural Architecture Search via Large Language Models and Quality-Diversity Optimization

2023-08-30

Level Generation Through Large Language Models

2023-08-30

Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges

2023-08-30

Normcore LLM Reads

2023-08-30

Gzip versus bag-of-words for text classification

2023-08-30

Challenges and Applications of Large Language Models

2023-08-30

Supporting the Open Source AI Community | Andreessen Horowitz

2023-08-30

Boyd's Law of Iteration

2023-08-28

Catala: A Programming Language for the Law

2023-08-27

Halloween Problem - Wikipedia

2023-08-26

Deep Neural Nets: 33 years ago and 33 years from now

2023-08-26

Phind: AI Search Engine and Pair Programmer

2023-08-25

Graph of Thoughts: Solving Elaborate Problems with Large Language Models

2023-08-24

Introducing Code Llama, an AI Tool for Coding | Meta

2023-08-24

Sigmoid Loss for Language Image Pre-Training

2023-08-22

Announcing Python in Excel

2023-08-22

Jewish Problems

2023-08-22

OctoPack: Instruction Tuning Code Large Language Models

2023-08-20

Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification

2023-08-20

TeCH: Text-guided Reconstruction of Lifelike Clothed Humans

2023-08-20

How is LLaMa.cpp possible?

2023-08-15

Towards a Unified View of Parameter-Efficient Transfer Learning

2023-08-11

Generative Agents: Interactive Simulacra of Human Behavior

2023-08-10

Simple synthetic data reduces sycophancy in large language models

2023-08-09

Generators for Systems Programmers

2023-08-09

The Hydra Effect: Emergent Self-repair in Language Model Computations

2023-08-08

Do Machine Learning Models Memorize or Generalize?

2023-08-08

A Practical Deep Learning-Based Acoustic Side Channel Attack on Keyboards

2023-08-05

The Netflix Prize and Singular Value Decomposition | CS-301

2023-08-05

From Sparse to Soft Mixtures of Experts

2023-08-04

Non-determinism in GPT-4 is caused by Sparse MoE - 152334H

2023-08-04

AudioCraft: A simple one-stop shop for audio modeling

2023-08-03

AlpaGasus: Training A Better Alpaca with Fewer Data

2023-08-03

A non-mathematical introduction to Kalman Filters for programmers - Pravesh Koirala

2023-08-02

Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️

2023-08-02

Augmenting Long-term Memory

2023-07-31

RT-2: Vision-Language-Action Models

2023-07-28

Monarch Mixer: Revisiting BERT, Without Attention or MLPs · Hazy Research

2023-07-28

Universal and Transferable Adversarial Attacks on Aligned Language Models

2023-07-28

index - research by ftlsid

2023-07-27

The First Room-Temperature Ambient-Pressure Superconductor

2023-07-26

Attention Is Off By One – Evan Miller

2023-07-24

ELI5: Flash Attention

2023-07-24

Detailed Scratchpad Prompting

2023-07-20

Kernel Cookbook

2023-07-19

How is ChatGPT's behavior changing over time?

2023-07-19

Llama 2: Open Foundation and Fine-Tuned Chat Models | Meta AI Research

2023-07-18

Bad numbers in the "gzip beats BERT" paper?

2023-07-18

Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration

2023-07-17

HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models

2023-07-17

Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning

2023-07-17

AI research journey and advice

2023-07-17

Learning to Retrieve In-Context Examples for Large Language Models

2023-07-17

Making Deep Learning go Brrrr From First Principles

2023-07-17

Large Language Models as General Pattern Machines

2023-07-16

Provably Faster Gradient Descent via Long Steps

2023-07-14

Acceleration via Fractal Learning Rate Schedules

2023-07-14

ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT

2023-07-14

Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution

2023-07-14

Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

2023-07-14

Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes

2023-07-13

Parallel Computing and Scientific Machine Learning (SciML): Methods and Applications - MIT Parallel Computing and Scientific Machine Learning (SciML)

2023-07-13

The Many Ways that Digital Minds Can Know – Ryan Moulton's Articles

2023-07-13

Towards Automated Circuit Discovery for Mechanistic Interpretability

2023-07-13

Index of /class/cs224n/slides

2023-07-13

Less is More: Parameter-Free Text Classification with Gzip

2023-07-12

SqueezeLLM: Dense-and-Sparse Quantization

2023-07-12

Large Language Models Can Be Easily Distracted by Irrelevant Context

2023-07-12

Stay on topic with Classifier-Free Guidance

2023-07-12

Pen and Paper Exercises in Machine Learning

2023-07-11

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

2023-07-11

Invisible Details of Interaction Design

2023-07-11

Teaching Arithmetic to Small Transformers

2023-07-09

The Novice's LLM Training Guide

2023-07-09

Can a Rubik's Cube be brute-forced?

2023-07-09

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM's Translation Capability

2023-07-07

Conditioning Predictive Models: Risks and Strategies

2023-07-07

Semantic Tokenizer for Enhanced Natural Language Processing

2023-07-07

Language Models are Multilingual Chain-of-Thought Reasoners

2023-07-07

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

2023-07-07

Lost in the Middle: How Language Models Use Long Contexts

2023-07-07

Inflection Memo 1

2023-07-07

LongNet: Scaling Transformers to 1,000,000,000 Tokens

2023-07-07

SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis

2023-07-07

Geeks, MOPs, and sociopaths in subculture evolution | Meaningness

2023-07-04

Joins 13 Ways

2023-07-03

Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs

2023-07-03

Courses – Stanford Artificial Intelligence Laboratory

2023-07-02

MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers

2023-06-30

Announcing the first Machine Unlearning Challenge – Google Research Blog

2023-06-30

Toward Actionable Generative AI | Salesforce Research

2023-06-29

SETs and Anti-SETs: The math behind the game of SET

2023-06-29

cdixon | The idea maze for AI startups

2023-06-28

Extending Context Window of Large Language Models via Positional Interpolation

2023-06-28

What every programmer should know about memory, Part 1 [LWN.net]

2023-06-27

What the interns have wrought, 2018 edition

2023-06-27

What the interns have wrought, 2022 edition

2023-06-27

Predicting Grokking Long Before it Happens: A look into the loss landscape of models which grok

2023-06-27

InRank: Incremental Low-Rank Learning

2023-06-27

LLM Powered Autonomous Agents | Lil'Log

2023-06-26

Nadia Asparouhova | Explaining tech's notion of talent scarcity

2023-06-26

Scenius

2023-06-26

AlphaFold @ CASP13: “What just happened?” | Some Thoughts on a Mysterious Universe

2023-06-26

Keeping up with AGI

2023-06-25

Creative Thinking by Claude Shannon -

2023-06-24

What Is a Transformer Model? | NVIDIA Blogs

2023-06-23

Twitter API Story.md

2023-06-23

How to Optimize a CUDA Matmul Kernel for cuBLAS-like Performance: a Worklog

2023-06-22

Textbooks Are All You Need

2023-06-22

MPT-30B: Raising the bar for open-source foundation models

2023-06-22

SequenceMatch: Imitation Learning for Autoregressive Sequence Modelling with Backtracking

2023-06-22

Lockhart’s Lament

2023-06-22

RoboCat: A self-improving robotic agent

2023-06-20

How a Single Line of Code Made a 24-core Server Slower Than a Laptop | Piotr Kołaczkowski

2023-06-19

I Don't Need Your Query Language

2023-06-17

Tools embody mediums

2023-06-17

A history of NVidia Stream Multiprocessor

2023-06-17

What I Learned From Two Years of Teaching High School CS | Charlie Meyer's Blog

2023-06-16

Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture

2023-06-16

Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models

2023-06-16

The Bitter Lesson - Rich Sutton

2023-06-16

Introduction to Machine Learning Interviews Book · MLIB

2023-06-15

How to crawl a quarter billion webpages in 40 hours – DDI

2023-06-14

11 years of hosting a SaaS - Alex Ghiculescu's Newsletter

2023-06-14

Native JSON Output From GPT-4 - by Simon Farshid

2023-06-14

I booted Linux 292,612 times | Richard WM Jones

2023-06-14

Freaky Leaky SMS: Extracting User Locations by Analyzing SMS Timings

2023-06-14

The Curse of Recursion: Training on Generated Data Makes Models Forget

2023-06-14

Is Parallel Programming Hard, And, If So, What Can You Do About It? (Release v2023.06.11a)

2023-06-13

Understanding DeepMind's Sorting Algorithm

2023-06-13

Benchmarking Neural Network Training Algorithms

2023-06-12

Migrating from Supabase

2023-06-10

Tracking Everything Everywhere All at Once

2023-06-10

Simple and Controllable Music Generation

2023-06-09

LEACE: Perfect linear concept erasure in closed form

2023-06-07

A Succinct Summary of Reinforcement Learning

2023-06-06

MaMMUT: A Simple Architecture for Joint Learning for MultiModal Tasks

2023-06-06

Visual Instruction Tuning

2023-06-06

GLM: General Language Model Pretraining with Autoregressive Blank Infilling

2023-06-06

Knowledge Graphs

2023-06-06

SegGPT: Segmenting Everything In Context

2023-06-06

State Spaces Aren't Enough: Machine Translation Needs Attention

2023-06-06

LongForm: Optimizing Instruction Tuning for Long Text Generation with Corpus Extraction

2023-06-06

Spreading vectors for similarity search

2023-06-06

ImageBind: One Embedding Space To Bind Them All

2023-06-06

Pipeline MoE: A Flexible MoE Implementation with Pipeline Parallelism

2023-06-06

Training Large Language Models Efficiently with Sparsity and Dataflow

2023-06-06

Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?

2023-06-06

Text-to-Image Diffusion Models are Zero-Shot Classifiers

2023-06-06

Vision Transformers with Mixed-Resolution Tokenization

2023-06-06

ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models

2023-06-06

Answering Questions by Meta-Reasoning over Multiple Chains of Thought

2023-06-06

G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

2023-06-06

Bayesian Optimization of Catalysts With In-context Learning

2023-06-06

Better Aligning Text-to-Image Models with Human Preference

2023-06-06

ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction Benchmark

2023-06-06

AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models

2023-06-06

Capabilities of GPT-4 on Medical Challenge Problems

2023-06-06

Hyperbolic Image-Text Representations

2023-06-06

SparseFormer: Sparse Visual Recognition via Limited Latent Tokens

2023-06-06

DETRs Beat YOLOs on Real-time Object Detection

2023-06-06

EVA-CLIP: Improved Training Techniques for CLIP at Scale

2023-06-06

Training Language Models with Language Feedback at Scale

2023-06-06

MAGVLT: Masked Generative Vision-and-Language Transformer

2023-06-06

Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models

2023-06-06

Spatial-Language Attention Policies for Efficient Robot Learning

2023-06-06

SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

2023-06-06

Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statements

2023-06-06

Optimizing Memory Mapping Using Deep Reinforcement Learning

2023-06-06

Speed Is All You Need: On-Device Acceleration of Large Diffusion Models via GPU-Aware Optimizations

2023-06-06

Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models

2023-06-06

An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion

2023-06-06

Learning in High Dimension Always Amounts to Extrapolation

2023-06-06

Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation

2023-06-06

Towards Agile Text Classifiers for Everyone

2023-06-06

Affordances from Human Videos as a Versatile Representation for Robotics

2023-06-06

DeiT III: Revenge of the ViT

2023-06-06

AugGPT: Leveraging ChatGPT for Text Data Augmentation

2023-06-06

REFINER: Reasoning Feedback on Intermediate Representations

2023-06-06

Proto-Value Networks: Scaling Representation Learning with Auxiliary Tasks

2023-06-06

Boosted Prompt Ensembles for Large Language Models

2023-06-06

Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

2023-06-06

Why think step by step? Reasoning emerges from the locality of experience

2023-06-06

Self-Refine: Iterative Refinement with Self-Feedback

2023-06-06

OpenScene: 3D Scene Understanding with Open Vocabularies

2023-06-06

Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

2023-06-06

FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization

2023-06-06

The Quantization Model of Neural Scaling

2023-06-06

End-to-End Spatio-Temporal Action Localisation with Video Transformers

2023-06-06

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models

2023-06-06

Rethinking the Role of Token Retrieval in Multi-Vector Retrieval

2023-06-06

Emergent autonomous scientific research capabilities of large language models

2023-06-06

Answering Questions Over Knowledge Graphs Using Logic Programming Along with Language Models

2023-06-06

Reflexion: Language Agents with Verbal Reinforcement Learning

2023-06-06

TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs

2023-06-06

Recurrent Memory Transformer

2023-06-06

Low-code LLM: Visual Programming over LLMs

2023-06-06

M2T: Masking Transformers Twice for Faster Decoding

2023-06-06

Forward Thinking: Building Deep Random Forests

2023-06-06

Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human Attention

2023-06-06

Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning

2023-06-06

CoBIT: A Contrastive Bi-directional Image-Text Generation Model

2023-06-06

AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators

2023-06-06

Brainformers: Trading Simplicity for Efficiency

2023-06-03

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

2023-06-03

Training Verifiers to Solve Math Word Problems

2023-06-01

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

2023-06-01

Scaling Data-Constrained Language Models

2023-05-31

Improving Mathematical Reasoning with Process Supervision

2023-05-31

NVIDIA Grace CPU Superchip Architecture In Depth

2023-05-31

Adam: A Method for Stochastic Optimization

2023-05-31

DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale

2023-05-30

Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors

2023-05-29

5 years of GPTs

2023-05-29

READ: Recurrent Adaptation of Large Transformers

2023-05-28

QLoRA: Efficient Finetuning of Quantized LLMs

2023-05-28

Build tools around workflows, not workflows around tools | thesephist.com

2023-05-28

The Leverage of LLMs for Individuals | TL;DR

2023-05-28

The Larger They Are, the Harder They Fail: Language Models do not Recognize Identifier Swaps in Python

2023-05-27

SoundStorm: Efficient Parallel Audio Generation

2023-05-27

SLiC-HF: Sequence Likelihood Calibration with Human Feedback

2023-05-27

Voyager: An Open-Ended Embodied Agent with Large Language Models

2023-05-26

Gorilla: Large Language Model Connected with Massive APIs

2023-05-25

Everything you always wanted to know about mathematics

2023-05-25

Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

2023-05-24

"Attention", "Transformers", in Neural Network "Large Language Models"

2023-05-23

Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality | LMSYS Org

2023-05-23

Hot Pixels: Frequency, Power, and Temperature Attacks on GPUs and ARM SoCs

2023-05-23

Instruction Tuning with GPT-4

2023-05-23

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold

2023-05-22

Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond

2023-05-22

Seeing is Believing: Brain-Inspired Modular Training for Mechanistic Interpretability

2023-05-22

Towards Expert-Level Medical Question Answering with Large Language Models

2023-05-22

Tree of Thoughts: Deliberate Problem Solving with Large Language Models

2023-05-22

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

2023-05-22

Any-to-Any Generation via Composable Diffusion

2023-05-22

Improving language model behavior by training on a curated dataset

2023-05-22

LIMA: Less Is More for Alignment

2023-05-22

How Does Generative Retrieval Scale to Millions of Passages?

2023-05-21

Learning to Compress Prompts with Gist Tokens

2023-05-20

Active Retrieval Augmented Generation

2023-05-19

Effective Theory of Transformers at Initialization

2023-05-19

People + AI Research

2023-05-18

Communicating Model Uncertainty Over Space

2023-05-18

Pre-Training to Learn in Context

2023-05-17

AGI Futures - roon’s blog

2023-05-16

Symbol tuning improves in-context learning in language models

2023-05-16

High Performance Browser Networking (O'Reilly)

2023-05-15

MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers

2023-05-14

Surya | Social Capital

2023-05-13

Monte Carlo Methods

2023-05-13

Ask HN: What is new in algorithms and data structures these days? | Hacker News

2023-05-11

Anthropic | Introducing 100K Context Windows

2023-05-11

ImageBind by Meta AI

2023-05-10

Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting

2023-05-09

Unlimiformer: Long-Range Transformers with Unlimited Length Input

2023-05-09

Language models can explain neurons in language models

2023-05-09

Go smol or go home | Harm de Vries

2023-05-07

LoRA: Low-Rank Adaptation of Large Language Models

2023-05-07

WizardLM: Empowering Large Language Models to Follow Complex Instructions

2023-05-04

Billion-Scale Approximate Nearest Neighbor Search

2023-05-04

Common arguments regarding emergent abilities — Jason Wei

2023-05-03

Semantic reconstruction of continuous language from non-invasive brain recordings | Nature Neuroscience

2023-05-01

Quantifying Memorization Across Neural Language Models

2023-04-30

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

2023-04-30

Actually, Othello-GPT Has A Linear Emergent World Representation - LessWrong

2023-04-30

Meditations On Moloch

2023-04-29

Scaling Laws for Transfer

2023-04-29

Pretrain on just structure: Understanding linguistic inductive biases using transfer learning

2023-04-28

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning

2023-04-27

Shortformer: Better Language Modeling using Shorter Inputs

2023-04-27

Transformers from Scratch

2023-04-27

An Opinionated Guide to ML Research

2023-04-27

Why <s>does</s> did Google Brain exist?

2023-04-26

Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesis

2023-04-26

A Cookbook of Self-Supervised Learning

2023-04-25

Scaling Transformer to 1M tokens and beyond with RMT

2023-04-23

Double descent in human learning · Chris Said

2023-04-21

The Embedding Archives: Millions of Wikipedia Article Embeddings in Many Languages

2023-04-20

DINOv2: Learning Robust Visual Features without Supervision

2023-04-20

Transformer Math 101 | EleutherAI Blog

2023-04-19

Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models

2023-04-19

Pretraining Without Attention

2023-04-19

The Complete Beginners Guide To Autonomous Agents

2023-04-18

Synthetic Data from Diffusion Models Improves ImageNet Classification

2023-04-17

BERT Fine-Tuning Tutorial with PyTorch · Chris McCormick

2023-04-16

Sparks of Artificial General Intelligence: Early experiments with GPT-4

2023-04-15

GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

2023-04-15

Layer Normalization

2023-04-14

Optimisation & Generalisation in Networks of Neurons

2023-04-14

[2304.05187] Automatic Gradient Descent: Deep Learning without Hyperparameters

2023-04-14

Automatic Gradient Descent: Deep Learning without Hyperparameters

2023-04-14

ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generation

2023-04-14

Segment Everything Everywhere All at Once

2023-04-13

Cost to Train Anthropic’s Claude-Next Model

2023-04-13

Calibrated Chaos: Variance Between Runs of Neural Network Training is Harmless and Inevitable

2023-04-13

Building LLM applications for production

2023-04-12

Teaching Large Language Models to Self-Debug

2023-04-12

Multimodal Analogical Reasoning over Knowledge Graphs

2023-04-12

Shtetl-Optimized » Blog Archive » GPT-4 gets a B on my quantum computing final exam!

2023-04-11

Text-to-Table: A New Way of Information Extraction

2023-04-10

Transformer Deep Dive: Parameter Counting

2023-04-10

Generative Agents: Interactive Simulacra of Human Behavior

2023-04-10

Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark

2023-04-09

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

2023-04-08

Erase your darlings: immutable infrastructure for mutable systems - Graham Christensen

2023-04-06

The Forward-Forward Algorithm: Some Preliminary Investigations

2023-04-06

Diffusion language models – Sander Dieleman

2023-04-05

Segment Anything | Meta AI

2023-04-05

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

2023-04-04

Twist Decoding: Diverse Generators Guide Each Other

2023-04-04

A Survey of Large Language Models

2023-04-03

Examples of AI Improving AI

2023-04-02

Optimizing Open Addressing – Max Slater – Computer Graphics, Programming, and Math

2023-04-02

Generative Adversarial Networks

2023-04-02

Deep contextualized word representations

2023-04-02

HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace

2023-04-02

The effectiveness of MAE pre-pretraining for billion-scale pretraining

2023-04-02

Natural Selection Favors AIs over Humans

2023-04-02

The case for 4-bit precision: k-bit Inference Scaling Laws

2023-04-02

The Power of Scale for Parameter-Efficient Prompt Tuning

2023-04-01

AI Safety via Luck - LessWrong

2023-04-01

Formal Algorithms for Transformers

2023-04-01

BloombergGPT: A Large Language Model for Finance

2023-03-31

Scaling Laws for Neural Language Models

2023-03-30

ST-MoE: Designing Stable and Transferable Sparse Expert Models

2023-03-30

Constitutional AI: Harmlessness from AI Feedback

2023-03-30

Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

2023-03-30

A data-driven approach for learning to control computers

2023-03-30

Root Mean Square Layer Normalization

2023-03-30

Finetuned Language Models Are Zero-Shot Learners

2023-03-30

Solving Quantitative Reasoning Problems with Language Models

2023-03-30

LaMDA: Language Models for Dialog Applications

2023-03-30

Pretraining Language Models with Human Preferences

2023-03-30

WebGPT: Browser-assisted question-answering with human feedback

2023-03-30

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

2023-03-30

Improving alignment of dialogue agents via targeted human judgements

2023-03-30

Training Compute-Optimal Large Language Models

2023-03-30

Proximal Policy Optimization Algorithms

2023-03-30

Toolformer: Language Models Can Teach Themselves to Use Tools

2023-03-30

The Curious Case of Neural Text Degeneration

2023-03-30

Efficient Training of Language Models to Fill in the Middle

2023-03-30

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

2023-03-30

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

2023-03-30

Training language models to follow instructions with human feedback

2023-03-30

DeepNet: Scaling Transformers to 1,000 Layers

2023-03-30

Competition-Level Code Generation with AlphaCode

2023-03-30

Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm

2023-03-30

PaLM: Scaling Language Modeling with Pathways

2023-03-30

FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

2023-03-30

Language Models are Few-Shot Learners

2023-03-30

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

2023-03-30

A General Language Assistant as a Laboratory for Alignment

2023-03-30

Unified Scaling Laws for Routed Language Models

2023-03-30

Fast Transformer Decoding: One Write-Head is All You Need

2023-03-30

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

2023-03-30

Self-attention Does Not Need $O(n^2)$ Memory

2023-03-30

Flamingo: a Visual Language Model for Few-Shot Learning

2023-03-30

GPT-NeoX-20B: An Open-Source Autoregressive Language Model

2023-03-30

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

2023-03-30

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

2023-03-30

GLM-130B: An Open Bilingual Pre-trained Model

2023-03-30

Efficient Large Scale Language Modeling with Mixtures of Experts

2023-03-30

Towards a Human-like Open-Domain Chatbot

2023-03-30

The Capacity for Moral Self-Correction in Large Language Models

2023-03-30

muNet: Evolving Pretrained Deep Neural Networks into Scalable Auto-tuning Multitask Systems

2023-03-30

Attention Is All You Need

2023-03-30

Improving language models by retrieving from trillions of tokens

2023-03-30

Galactica: A Large Language Model for Science

2023-03-30

A Generalist Agent

2023-03-30

Fine-Tuning Language Models from Human Preferences

2023-03-30

Mixture-of-Experts with Expert Choice Routing

2023-03-30

OPT: Open Pre-trained Transformer Language Models

2023-03-30

Language Models (Mostly) Know What They Know

2023-03-30

PaLI: A Jointly-Scaled Multilingual Language-Image Model

2023-03-30

Transformer Taxonomy (the last lit review) | kipply's blog

2023-03-30

Task-driven Autonomous Agent Utilizing GPT-4, Pinecone, and LangChain for Diverse Applications – Yohei Nakajima

2023-03-30

SemDeDup: Data-efficient learning at web-scale through semantic deduplication

2023-03-30

Hyena Hierarchy: Towards Larger Convolutional Language Models

2023-03-28

From Deep to Long Learning? · Hazy Research

2023-03-28

Scaling Expert Language Models with Unsupervised Domain Discovery

2023-03-28

Turing Test - by Scott Alexander - Astral Codex Ten

2023-03-28

ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks

2023-03-27

Can LLMs Critique and Iterate on Their Own Outputs? | Eric Jang

2023-03-26

ChatGPT + Code Interpreter = Magic – @AndrewMayne

2023-03-26

Deep Learning, NLP, and Representations - colah's blog

2023-03-26

Toy Models of Superposition

2023-03-26

Superposition of many models into one

2023-03-26

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

2023-03-26

Polysemanticity and Capacity in Neural Networks

2023-03-26

Decoding by Linear Programming

2023-03-26

Decoding the Thought Vector

2023-03-26

Learning Transferable Visual Models From Natural Language Supervision

2023-03-25

Lila Scavenger Hunt

2023-03-25

GPT-4 Technical Report

2023-03-25

Learning Models of Individual Behavior in Chess

2023-03-25

A simple explanation of why advanced AI could be incredibly dangerous

2023-03-25

ARC: Eliciting Latent Knowledge

2023-03-25

Optimizing Neural Networks with Kronecker-factored Approximate Curvature

2023-03-25

The alignment problem from a deep learning perspective

2023-03-24

Sequence to Sequence Learning with Neural Networks

2023-03-24

Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations

2023-03-24

Thinking Like Transformers

2023-03-23

The Last Question

2023-03-23

Attention Approximates Sparse Distributed Memory

2023-03-23

Convex Optimization: Algorithms and Complexity

2023-03-22

On-Device Training Under 256KB Memory

2023-03-22

Principles for Productive Group Meetings

2023-03-22

A Mechanistic Interpretability Analysis of Grokking - AI Alignment Forum

2023-03-22

Expository papers by K. Conrad

2023-03-22

labml.ai Annotated PyTorch Paper Implementations

2023-03-20

Simplified State Space Layers for Sequence Modeling

2023-03-20

Prompt Engineering | Lil'Log

2023-03-20

Memorizing Transformers

2023-03-20

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers

2023-03-20

Can Humans Do Less-Than-One-Shot Learning?

2023-03-19

CoLT5: Faster Long-Range Transformers with Conditional Computation

2023-03-19

HiPPO: Recurrent Memory with Optimal Polynomial Projections

2023-03-19

Generating Long Sequences with Sparse Transformers

2023-03-19

Singularity: Planet-Scale, Preemptive and Elastic Scheduling of AI Workloads

2023-03-19

Update on ARC's recent eval efforts - ARC Evals

2023-03-19

How to Label 1M Data Points/Week | Blog | Scale AI

2023-03-19

Decoupled Context Processing for Context Augmented Language Modeling

2023-03-17

LLaMA: Open and Efficient Foundation Language Models

2023-03-17

Artificial Sufficient Intelligence - alth0u🤸’s Substack

2023-03-17

GLU Variants Improve Transformer

2023-03-17

ART: Automatic multi-step reasoning and tool-use for large language models

2023-03-17

Erasing Concepts from Diffusion Models

2023-03-17

ViperGPT: Visual Inference via Python Execution for Reasoning

2023-03-17

How is LLaMa.cpp possible? - by Finbarr Timbers

2023-03-16

Why Don't AI Art Generators Feel Conscious? - by Nat Sharpe

2023-03-16

Alpaca 7B

2023-03-15

Meet in the Middle: A New Pre-training Paradigm

2023-03-15

Self-critiquing models for assisting human evaluators

2023-03-15

Upwelling: Combining real-time collaboration with version control for writers.

2023-03-14

GPT-4

2023-03-14

World of Bits: An Open-Domain Platform for Web-Based Agents

2023-03-13

World of Bits: An Open-Domain Platform for Web-Based Agents

2023-03-13

Optimal Policies Tend to Seek Power

2023-03-12

Instrumental Convergence - LessWrong

2023-03-12

Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation

2023-03-12

Towards Deep Learning Models Resistant to Adversarial Attacks

2023-03-12

RoFormer: Enhanced Transformer with Rotary Position Embedding

2023-03-11

Rotary Embeddings: A Relative Revolution

2023-03-11

The Bitter Lesson

2023-03-11

Dissociating language and thought in large language models: a cognitive perspective

2023-03-10

DeepMind alignment strategy.pdf - Google Drive

2023-03-10

Online gradient descent written in SQL • Max Halford

2023-03-09

Adversarial Attacks - Purdue

2023-03-09

The hot mess theory of AI misalignment: More intelligent agents behave less coherently | Jascha’s blog

2023-03-09

Project and Probe: Sample-Efficient Domain Adaptation by Interpolating Orthogonal Features

2023-03-09

Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models

2023-03-09

Anthropic | Core Views on AI Safety: When, Why, What, and How

2023-03-09

Division by Zero - Fantastic Metropolis

2023-03-08

Going Deeper with Convolutions

2023-03-07

Larger language models do in-context learning differently

2023-03-07

Can one hear the shape of a neural network?: Snooping the GPU via Magnetic Side Channel

2023-03-07

Prismer: A Vision-Language Model with An Ensemble of Experts

2023-03-07

GPT-3 will ignore tools when it disagrees with them

2023-03-07

PaLM-E: An Embodied Multimodal Language Model

2023-03-06

PaLM-E: An Embodied Multimodal Language Model

2023-03-06

Shtetl-Optimized » Blog Archive » Should GPT exist?

2023-03-06

First principles on AI progress

2023-03-06

Language Is Not All You Need: Aligning Perception with Language Models

2023-03-05

Large Language Models are Zero-Shot Reasoners

2023-03-04

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

2023-03-04

Is ChatGPT 175 Billion Parameters? Technical Analysis

2023-03-03

The Waluigi Effect (mega-post) - LessWrong

2023-03-03

High-resolution image reconstruction with latent diffusion models from human brain activity

2023-03-03

Language Models as Agent Models

2023-03-02

Least-to-Most Prompting Enables Complex Reasoning in Large Language Models

2023-03-02

A student's dream: hacking (then fixing) Gradescope's autograder - Aditya's Blog

2023-03-01

I got early access to ChatGPT API and then pushed it to it’s limits. Here’s what you need to know. — Buildt

2023-03-01

Bayesian Model Selection, the Marginal Likelihood, and Generalization

2023-03-01

Adversarial Examples for Evaluating Reading Comprehension Systems

2023-02-28

On the Turing Completeness of Modern Neural Network Architectures

2023-02-28

Large language models aren't trained enough.

2023-02-28

AI Overload and Interface Shock

2023-02-26

ChatGPT as muse, not oracle

2023-02-26

Adding Conditional Control to Text-to-Image Diffusion Models

2023-02-25

Emergent Abilities of Large Language Models

2023-02-25

Self-Consistency Improves Chain of Thought Reasoning in Language Models

2023-02-25

Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection

2023-02-25

Self-Instruct: Aligning Language Model with Self Generated Instructions

2023-02-25

Language Modelling with Pixels

2023-02-25

Efficiently Modeling Long Sequences with Structured State Spaces

2023-02-25

Diffusion-LM Improves Controllable Text Generation

2023-02-25

TALM: Tool Augmented Language Models

2023-02-25

Large Language Models Encode Clinical Knowledge

2023-02-25

What learning algorithm is in-context learning? Investigations with linear models

2023-02-25

Large Language Models Can Self-Improve

2023-02-25

Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionals

2023-02-25

Scaling Instruction-Finetuned Language Models

2023-02-25

Data Distributional Properties Drive Emergent In-Context Learning in Transformers

2023-02-25

Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?

2023-02-25

Deduplicating Training Data Mitigates Privacy Risks in Language Models

2023-02-25

Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models

2023-02-25

Holistic Evaluation of Language Models

2023-02-25

Efficiently Scaling Transformer Inference

2023-02-25

Transformer Memory as a Differentiable Search Index

2023-02-25

UL2: Unifying Language Learning Paradigms

2023-02-25

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

2023-02-25

Recitation-Augmented Language Models

2023-02-25

Multitask Prompted Training Enables Zero-Shot Task Generalization

2023-02-25

Transcending Scaling Laws with 0.1% Extra Compute

2023-02-25

137 emergent abilities of large language models — Jason Wei

2023-02-25

RoBERTa: A Robustly Optimized BERT Pretraining Approach

2023-02-25

Revisiting Unreasonable Effectiveness of Data in Deep Learning Era

2023-02-24

Understanding deep learning requires rethinking generalization

2023-02-24

Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP

2023-02-24

Monarch: Expressive Structured Matrices for Efficient and Accurate Training

2023-02-24

Retrofitting Word Vectors to Semantic Lexicons

2023-02-24

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

2023-02-24

Scaling Robot Learning with Semantically Imagined Experience

2023-02-24

Planning for AGI and beyond

2023-02-24

MIT MLSys Discussion Group

2023-02-23

MiniTorch

2023-02-23

And Yet It Understands

2023-02-22

Simulators - LessWrong

2023-02-22

Poline — Esoteric Color Palette Generation Library

2023-02-22

Generalized Out-of-Distribution Detection: A Survey

2023-02-22

How to use Learning Curves to Diagnose Machine Learning Model Performance - MachineLearningMastery.com

2023-02-22

Black-box Adversarial Attacks with Limited Queries and Information

2023-02-22

Things You Learn Dating Cate Hall - by Sasha Chapin

2023-02-22

Introducing Cohere Summarize Beta: A New Endpoint for Text Summarization

2023-02-22

A Concerning Trend – Neil Clarke

2023-02-21

Meta-Learning in Neural Networks: A Survey

2023-02-21

DocPrompting: Generating Code by Retrieving the Docs

2023-02-21

The Scaling Hypothesis · Gwern.net

2023-02-21

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

2023-02-20

Self-supervised Learning: Generative or Contrastive

2023-02-20

Generating Wikipedia by Summarizing Long Sequences

2023-02-20

How GPT3 Works - Visualizations and Animations – Jay Alammar – Visualizing machine learning one concept at a time.

2023-02-20

Clarkesworld Magazine – Science Fiction & Fantasy

2023-02-20

Speeding up the GPT - KV cache | Becoming The Unbeatable

2023-02-20

Understanding LSTM Networks -- colah's blog

2023-02-20

AGI in sight: our look at the game board - LessWrong

2023-02-20

Go has been un-solved: strong human players beat the strongest AIs - LessWrong

2023-02-20

Scaling Vision Transformers to 22 Billion Parameters

2023-02-20

Extracting Training Data from Diffusion Models

2023-02-20

The chain rule, Jacobians, autograd, and shapes

2023-02-20

Risks from Learned Optimization in Advanced Machine Learning Systems

2023-02-20

Transformers learn in-context by gradient descent

2023-02-20

HyperNetworks

2023-02-20

Image Kernels explained visually

2023-02-20

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

2023-02-19

Progress measures for grokking via mechanistic interpretability

2023-02-19

A Mechanistic Interpretability Analysis of Grokking - LessWrong

2023-02-19

Tail Free Sampling – Trenton Bricken – Interested in Machine Learning, Neuroscience, and Original Glazed Krispy Kreme Doughnuts.

2023-02-19

AI And The Limits Of Language

2023-02-19

How to make LLMs say true things | Evan Conrad

2023-02-18

Zero-Shot Text-to-Image Generation

2023-02-18

Evaluating Large Language Models Trained on Code

2023-02-18

Dota 2 with Large Scale Deep Reinforcement Learning

2023-02-18

Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction

2023-02-18

Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

2023-02-17

Theory of Mind May Have Spontaneously Emerged in Large Language Models

2023-02-17

Beyond neural scaling laws: beating power law scaling via data pruning

2023-02-17

Multimodal Chain-of-Thought Reasoning in Language Models

2023-02-17

Talking About Large Language Models

2023-02-17

Unsolved Problems in ML Safety

2023-02-17

Image-and-Language Understanding from Pixels Only

2023-02-17

Discovering Latent Knowledge in Language Models Without Supervision

2023-02-17

Augmented Language Models: a Survey

2023-02-17

Task-Specific Skill Localization in Fine-tuned Language Models

2023-02-17

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

2023-02-17

Transformer models: an introduction and catalog

2023-02-17

Large Language Models Are Human-Level Prompt Engineers

2023-02-17

Symbolic Discovery of Optimization Algorithms

2023-02-17

Implicit Representations of Meaning in Neural Language Models

2023-02-17

Monolith: Real Time Recommendation System With Collisionless Embedding Table

2023-02-17

Discovering Language Model Behaviors with Model-Written Evaluations

2023-02-17

Every running gag in Bojack Horseman

2023-02-17

Erich's Packing Center

2023-02-17

Why Momentum Really Works

2023-02-17

The Decade of Deep Learning | Leo Gao

2023-02-16

What Is ChatGPT Doing … and Why Does It Work?—Stephen Wolfram Writings

2023-02-16

Bing Chat is blatantly, aggressively misaligned - LessWrong

2023-02-16

How should AIsystems behave, and who should decide?

2023-02-16

An Analysis of Grokking

2023-02-16

GPT in 60 Lines of NumPy | Jay Mody

2023-02-12

There are Only Four Billion Floats–So Test Them All! | Random ASCII - tech blog of Bruce Dawson

2023-02-12

Why I chose OpenAI over academia: reflections on the CS academic and industry job markets (part 2) - Rowan Zellers' blog

2023-02-12

GitHub - NARKOZ/hacker-scripts: Based on a true story

2023-02-12

Chris Potts Stanford Webinar - GPT-3 & Beyond - YouTube

2023-02-10

A Gentle Introduction to CRDTs - vlcn.io

2023-02-10

Adam: A Method for Stochastic Optimization

2023-02-09

A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity

2023-02-09

Sketchy: Memory-efficient Adaptive Regularization with Frequent Direction

2023-02-09

Cramming: Training a Language Model on a Single GPU in One Day

2023-02-09

SolidGoldMagikarp (plus, prompt generation) - LessWrong

2023-02-09

ChatGPT Is a Blurry JPEG of the Web | The New Yorker

2023-02-09

Transformer Circuits Thread

2023-02-09

Welcome to Spinning Up in Deep RL! — Spinning Up documentation

2023-02-09

Mass-Editing Memory in a Transformer

2023-02-08

Large Language Models Can Be Easily Distracted by Irrelevant Context

2023-02-08

The technology behind GitHub’s new code search | The GitHub Blog

2023-02-08

Practicing AI research — Jason Wei

2023-02-07

All Roads Lead to Rome: The Machine Learning Job Market in 2022 | Eric Jang

2023-02-07

How Levels.fyi scaled to millions of users with Google Sheets as a backend

2023-02-07

👨🏾 I want my dad to know who I am before he dies

2023-02-06

Childhoods of exceptional people - by Henrik Karlsson

2023-02-06

croc | ZS

2023-02-06

Machine Learning: The High-Interest Credit Card of Technical Debt

2023-02-06

Human-Timescale Adaptation in an Open-Ended Task Space

2023-02-06

Multitasking Models are Robust to Structural Failure: A Neural Model for Bilingual Cognitive Reserve

2023-02-06

Reversing UK mobile rail tickets

2023-02-05

Stable Attribution

2023-02-05

Matrices and determinants - MacTutor History of Mathematics

2023-02-04

Exclusive Q&A: John Carmack's 'Different Path' to Artificial General Intelligence » Dallas Innovates

2023-02-03

Learning to summarize from human feedback

2023-02-03

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

2023-02-03

OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization

2023-02-03

A Watermark for Large Language Models

2023-02-03

Large Language Models Are Reasoning Teachers

2023-02-03

Teaching Small Language Models to Reason

2023-02-03

Downstream Datasets Make Surprisingly Good Pretraining Corpora

2023-02-03

One Model To Learn Them All

2023-02-03

Self-Attention and Transformers

2023-02-03

Software 2.0

2023-02-03

The Transformer Family Version 2.0 | Lil'Log

2023-02-01

Unifying Vision, Text, and Layout for Universal Document Processing

2023-01-31

New AI classifier for indicating AI-written text

2023-01-31

BabyLM Challenge

2023-01-30

Incubation (psychology) - Wikipedia

2023-01-29

Reverse Prompt Engineering for Fun and (no) Profit

2023-01-29

Overview of GPT-as-a-Backend

2023-01-29

Interaction is a cost center in interface design

2023-01-29

functions - Overview of basic results about images and preimages - Mathematics Stack Exchange

2023-01-29

Manna – Two Views of Humanity’s Future – Chapter 1 | MarshallBrain.com

2023-01-28

Non_Interactive – Software & ML

2023-01-27

Natural language is the lazy user interface - Austin Z. Henley

2023-01-27

Honeytime - by 🐝 H̶armless AᎥ🐝 - 🐝 HarmlessAi 🐝

2023-01-27

Wolfram|Alpha as the Way to Bring Computational Knowledge Superpowers to ChatGPT

2023-01-26

Deep Double Descent: Where Bigger Models and More Data Hurt

2023-01-26

SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot

2023-01-26

MusicLM: Generating Music From Text

2023-01-26

MusicLM

2023-01-26

Program Synthesis with Large Language Models

2023-01-26

Maximum Likelihood Decoding with RNNs - the good, the bad, and the ugly - The Stanford Natural Language Processing Group

2023-01-26

The inside story of ChatGPT

2023-01-26

Stanford CS25 Emergence Lecture (Jason Wei) - Google Slides

2023-01-25

I Am The Only User | Blub's Blog

2023-01-25

Konjer - Chatbots for Books

2023-01-25

Replacing a SQL analyst with 26 recursive GPT prompts | Patterns

2023-01-25

Teaching Algorithmic Reasoning via In-context Learning

2023-01-23

Hungry Hungry Hippos: Towards Language Modeling with State Space Models

2023-01-23

Five Days in Class with ChatGPT – The Alperovitch Institute

2023-01-22

how to completely own an airline in 3 easy steps

2023-01-21

Alex Tamkin - Tips for New Researchers

2023-01-20

Google Research, 2022 & Beyond: Language, Vision and Generative Models – Google AI Blog

2023-01-20

Quit Your Job

2023-01-20

Arxiv Feed

2023-01-20

academic struggles - by Rona Wang - return on net assets

2023-01-20

The founder of Teenage Engineering opens up to his creative space

2023-01-20

Ask Me Anything: A simple strategy for prompting language models

2023-01-20

Precise Zero-Shot Dense Retrieval without Relevance Labels

2023-01-17

A Mechanistic Interpretability Analysis of Grokking

2023-01-16

The On-Line Encyclopedia of Integer Sequences® (OEIS®)

2023-01-16

Schedule | Has It Trained Yet?

2023-01-15

Max Hodak - The Next button

2023-01-14

Paperclip Maximizer

2023-01-11

Mastering Diverse Domains through World Models

2023-01-11

Earlybird: Real-Time Search at Twitter

2023-01-10

Effective Jugaad: An Ideology for Navigating Complexity and Uncertainty in the 21st Century | mostwrong.github.io

2023-01-10

Matrices and graphs - by Tivadar Danka - The Palindrome

2023-01-09

Charles Baudelaire, “On Photography,” from The Salon of 1859`

2023-01-09

RT-1: Robotics Transformer for Real-World Control at Scale

2023-01-08

Decision Transformer: Reinforcement Learning via Sequence Modeling

2023-01-08

Emergent Tool Use From Multi-Agent Autocurricula

2023-01-08

Semi-supervised Sequence Learning

2023-01-08

Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation

2023-01-08

Operationalizing Machine Learning: An Interview Study

2023-01-08

Large language models are not zero-shot communicators

2023-01-08

Show Your Work: Scratchpads for Intermediate Computation with Language Models

2023-01-08

ReAct: Synergizing Reasoning and Acting in Language Models

2023-01-08

Mochi — Spaced repetition made easy

2023-01-08

The Illustrated Transformer

2023-01-08

Production Twitter on One Machine? 100Gbps NICs and NVMe are fast - Tristan Hume

2023-01-08

FIRE Flow Chart

2023-01-06

The Meanings of Lives - Susan Wolf

2023-01-06

AI effect - Wikipedia

2023-01-06

Introduction to finite frame theory

2023-01-06

Replit - The Fourth Age Of Programming

2023-01-06

trees are harlequins, words are harlequins — gpt-4 prediction: it won't be very useful

2023-01-06

VALL-E

2023-01-06

Holistic Evaluation of Language Models (HELM)

2023-01-05

A Succinct Summary of Reinforcement Learning

2023-01-05

ui.land

2023-01-04

LLMs - Yoav Goldberg

2023-01-02

include.ai story

2023-01-02

Mafs: React components for interactive math

2023-01-02

95%-ile isn't that good

2023-01-02

Thoughts on Trace Estimation in Deep Learning - Sebastian Nowozins slow blog

2023-01-01

Linear Algebra Done Right

2023-01-01

Scribepod 1 - by Yacine - scribepod

2022-12-31

Alexander Obenauer

2022-12-30

GPT-3.5 IQ testing using Raven’s Progressive Matrices – Dr Alan D. Thompson – Life Architect

2022-12-27

Detecting Collision

2022-12-27

A Mathematical Theory of Communication

2022-12-25

Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation

2022-12-25

wizard zines

2022-12-24

Introduction to Locality-Sensitive Hashing

2022-12-23

Backpressure

2022-12-23

Conception – Turning stem cells into human eggs

2022-12-22

🔐 Portable Secret | portable-secret

2022-12-21

[2212.09835] A non-constructive proof of the Four Colour Theorem

2022-12-21

Beej's Guide to C Programming

2022-12-21

6 New Theories About AI

2022-12-20

Here's What I Saw at an AI Hackathon - Superorganizers - Every

2022-12-20

Matrix Multiplication - A different perspective – Kishore's Musings –

2022-12-20

A Programmer’s Intuition for Matrix Multiplication – BetterExplained

2022-12-20

Discovering Language Model Behaviors with Model-Written Evaluations

2022-12-20

[2212.03860] Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models

2022-12-19

The Annotated Transformer

2022-12-18

Grokking Tensors::Proof by Accident

2022-12-18

What’s the difference between a matrix and a tensor? | by Steven Steinke | Medium

2022-12-18

copilot-explorer | Hacky repo to see what the Copilot extension sends to the server

2022-12-18

Huberman AI

2022-12-17

Tensor networks, Einsum optimizers and the path towards autodiff - Online Technical Discussion Groups—Wolfram Community

2022-12-16

CSC321 Lecture 10: Automatic Differentiation

2022-12-16

Introducing Text and Code Embeddings

2022-12-15

Perplexity AI: Bird SQL

2022-12-15

Riffusion

2022-12-15

The Dawn of Mediocre Computing - by Venkatesh Rao

2022-12-13

What I have been working on: Modal · Erik Bernhardsson

2022-12-12

Murray Shanahan - Talking about LLMs

2022-12-11

ChatGPT - Where it lacks use cases | Cookup AI

2022-12-11

Terence Tao – A Close Call: How a Near Failure Propelled Me to Succeed

2022-12-11

acheong08/ChatGPT: Lightweight package for interacting with ChatGPT's API by OpenAI. Uses reverse engineered official API.

2022-12-09

Dramatron

2022-12-09

Holistic Evaluation of Language Models

2022-12-05

You might not need a CRDT | Drifting in Space

2022-12-05

Not a Number

2022-12-04

In Your Bones

2022-12-03

Building A Virtual Machine inside ChatGPT

2022-12-03

Potluck: Dynamic documents as personal software

2022-12-03

How CRDTs make multiplayer text editing part of Zed's DNA - Zed Blog

2022-12-02

Computers Doing The Right Thing

2022-12-02

Mastering Stratego, the classic game of imperfect information

2022-12-01

It Looks Like You’re Trying To Take Over The World · Gwern.net (reader mode)

2022-12-01

Generative AI: autocomplete for everything

2022-11-30

Max Hodak - Avoid little leagues

2022-11-30

ChatGPT: Optimizing Language Models for Dialogue

2022-11-30

Shtetl-Optimized » Blog Archive » My AI Safety Lecture for UT Effective Altruism

2022-11-29

Tasmania - A better YouTube Video Search

2022-11-29

All of Statistics - Wasserman

2022-11-29

The Unreasonable Effectiveness of Recurrent Neural Networks

2022-11-28

The AI War and How to Win It - by Alexandr Wang

2022-11-27

Choose Good Quests - by Trae Stephens and Markie Wagner

2022-11-26

[2206.07669] A Unified Sequence Interface for Vision Tasks

2022-11-26

GitHub - maaslalani/nap: Code snippets in your terminal 🛌

2022-11-26

Dispict

2022-11-23

Earlybird.pdf

2022-11-23

Why Discord is switching from Go to Rust

2022-11-23

Numbers at play: dynamic toys make the invisible visible | Khan Academy Long-term Research

2022-11-23

MineDojo | Building Open-Ended Embodied Agents with Internet-Scale Knowledge

2022-11-23

Java bytecode hacking for fun and profit

2022-11-23

CICERO: An AI agent that negotiates, persuades, and cooperates with people

2022-11-23

[2210.03629] ReAct: Synergizing Reasoning and Acting in Language Models

2022-11-23

GPT Labs | Create and edit programs with UPG

2022-11-23

The Near Future of AI is Action-Driven - by John McDonnell

2022-11-23

Galactica Demo

2022-11-15

Latency testing remote browsing: Why display streaming is hard - Tristan Hume

2022-11-13

GPT-2 As Step Toward General Intelligence | Slate Star Codex

2022-11-10

Stretch iPhone to its Limit, a 2GiB Model that can Draw Everything in Your Pocket

2022-11-09

Cloudflare’s Lava Lamps

2022-11-08

iA Presenter

2022-11-08

Jack Rusher ☞ Classic HCI demos

2022-11-08

Gödel, Escher, Bach - Wikipedia

2022-11-07

generally intelligent

2022-11-07

the singularity is nearer

2022-11-06

New Grad SWE Job Hunt Advice | Joanna Yao

2022-11-06

Diffusion Models for Handwriting Generation

2022-11-05

Mass Editing Memory in a Transformer

2022-11-05

Locating and Editing Factual Associations in GPT

2022-11-05

Bit Twiddling Hacks

2022-11-05

Linear Algebra Done Wrong

2022-11-03

What Computers Still Can't Do

2022-11-03

The Dunning-Kruger Effect is Autocorrelation – Economics from the Top Down

2022-11-03

Sieve - Process. Understand. Search. Video

2022-11-01

Replit - Ghostwriter AI & Complete Code Beta

2022-11-01

Home - DiffusionDB

2022-11-01

Sehn

2022-10-31

An Extremely Opinionated Annotated List of My Favourite Mechanistic Interpretability Papers — Neel Nanda

2022-10-31

Inter Alia

2022-10-31

Tristan's Site - Tristan Hume

2022-10-31

A Gentle Introduction to Graph Neural Networks

2022-10-30

Jud! You are on fire

2022-10-26

Upload Anything: How we Revolutionized Data Upload

2022-10-26

hackingmodels.com

2022-10-26

Clay - Be more thoughtful with the people in your network.

2022-10-26

Needl

2022-10-26

Approximation Theory and Approximation Practice

2022-10-25

Perverse incentive - Wikipedia

2022-10-25

Data-Parallel Finite-State Machines

2022-10-25

Aligning Language Models to Follow Instructions

2022-10-25

The Only Crypto Story You Need, by Matt Levine

2022-10-25

Paul Ford: What Is Code? | Bloomberg

2022-10-25

How I Got a Job at Google DeepMind (No ML Degree) | Medium

2022-10-24

Explainpaper

2022-10-24

generatingfunctionology

2022-10-24

bleeding edge

2022-10-24

The Transformer: Attention Is All You Need – Glass Box

2022-10-23

Programming Portals

2022-10-23

[2008.08822] A Simple and Fast Algorithm for Computing the $N$-th Term of a Linearly Recurrent Sequence

2022-10-22

walking a matrix

2022-10-21

Self-Supervised Representation Learning | Lil'Log

2022-10-21

Introducing Pathways: A next-generation AI architecture

2022-10-20

Metaphor

2022-10-20

Another Bay Area House Party - by Scott Alexander

2022-10-19

Deep Math for ML

2022-10-18

Deep Double Descent

2022-10-18

GitHub Copilot investigation · Joseph Saveri Law Firm & Matthew Butterick

2022-10-17

latentspace.dev - exploring stable diffusion latent space

2022-10-17

Transformer Inference Arithmetic | kipply's blog

2022-10-16

Software Engineering Advice from Building Large-Scale Distributed Systems

2022-10-16

The disproportionate influence of early tech decisions — brandur.org

2022-10-16

Introduction to Category Theory

2022-10-15

A Tour of Modern Image Filtering

2022-10-15

Building on Top of Black Magic | Rui Shu

2022-10-15

Research as Understanding

2022-10-15

CS PhD Statements of Purpose

2022-10-15

Grokking Stable Diffusion.ipynb - Colaboratory

2022-10-14

Preventing Overfitting

2022-10-14

Neurons in a dish learn to play Pong — what’s next?

2022-10-14

Creative Computer ⠕

2022-10-13

Building a Text Editor for a Digital-First Newsroom | by Sophia Ciocca | NYT Open

2022-10-13

“Probabilistic machine learning”: a book series by Kevin Murphy | pml-book

2022-10-13

Latex2im - a Hugging Face Space by yuntian-deng

2022-10-12

Just for Fun. No, Really.

2022-10-12

val town

2022-10-12

How a Ghostwriter Makes $200,000 a Year Writing Tweets for Top Silicon Valley Investors

2022-10-12

Attention Is All You Need

2022-10-12

drawanyone - draw anyone, any way you want

2022-10-11

podcast.ai

2022-10-11

NovelAI - The GPT-powered AI Storyteller

2022-10-10

The Solid-State Register Allocator

2022-10-09

Numbers Every Programmer Should Know By Year

2022-10-08

How To Download All of Wikipedia onto a USB Flash Drive in 2022

2022-10-08

Tilde Town

2022-10-05

Discovering novel algorithms with AlphaTensor

2022-10-05

Imagen Video

2022-10-05

qyber | A new paradigm for computing

2022-10-04

Novel View Synthesis with Diffusion Models

2022-10-04

The TikTok SEO Opportunity | The Split

2022-10-01

Playground AI

2022-09-30

Phenaki

2022-09-29

DreamFusion: Text-to-3D using 2D Diffusion

2022-09-29

Writing, part 1 — the process. This blog post is on the writing… | by Marco Tulio Ribeiro | Sep, 2022 | Medium

2022-09-29

Infinite Canvas

2022-09-29

Make-A-Video

2022-09-29

Excel is Pretty Dang Cool • Buttondown

2022-09-28

How DALLE-2 Works

2022-09-28

Paxos

2022-09-28

Neural Networks and Deep Learning

2022-09-27

AI Grant

2022-09-26

Inverse Scaling Prize

2022-09-26

nickcammarata.com/writing

2022-09-21

chinchilla's wild implications - LessWrong

2022-09-21

Introducing Whisper

2022-09-21

summarize.tech: AI-powered video summaries

2022-09-20

mmm.page — Dead Simple, Drag & Drop Websites

2022-09-19

https://probml.github.io/pml-book/book1.html

2022-09-18

One machine learning question every day - bnomial

2022-09-18

ezcv — Easy Resume Maker

2022-09-17

Prompt injection attacks against GPT-3

2022-09-17

Prefix Sums

2022-09-15

arXiv Vanity – Read academic papers from arXiv as web pages

2022-09-14

ACT-1: Transformer for Actions

2022-09-14

Dust - Build Generative Models Apps

2022-09-14

[0812.4360] Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes

2022-09-11

Undergraduation

2022-09-09

Mem: The self-organizing workspace

2022-09-09

SayCan: Grounding Language in Robotic Affordances

2022-09-09

Text Is the Universal Interface - Scale

2022-09-09

The Steve Jobs Archive

2022-09-08

Stories by AI | Substack

2022-09-07

This House Does Not Exist - by @levelsio

2022-09-06

Little Big Details - The details are not the details

2022-09-05

Run Stable Diffusion on your M1 Mac’s GPU - Replicate – Replicate

2022-09-03

LaTeX Cheatsheet

2022-09-03

The Fable of the Dragon-Tyrant

2022-09-02

@nyt_first_said

2022-09-02

One week of bugs

2022-09-01

DALL·E: Introducing Outpainting

2022-09-01

Chinese room - Wikipedia

2022-08-31

Wikipedia:Unusual articles - Wikipedia

2022-08-30

Machine Learning with Kernel Methods

2022-08-30

The Gervais Principle, Or The Office According to “The Office”

2022-08-30

Notes on creative context

2022-08-28

Are Sunk Costs Fallacies? · Gwern.net

2022-08-28

NIKECRAFT

2022-08-25

Lexica

2022-08-24

Optimizing For Feelings

2022-08-23

Stable Diffusion Public Release — Stability.Ai

2022-08-22

On being busy

2022-08-21

System Design

2022-08-20

Rant: Matrices Are Not Arrays of Numbers

2022-08-20

Evan Chen • Napkin (v1.5)

2022-08-20

Inside the Magic Pocket - Dropbox

2022-08-19

PaLM-SayCan: Towards robots that can understand us | Everyday Robots

2022-08-17

Accounting for Developers, Part I | Modern Treasury Journal

2022-08-17

First Principles: The Building Blocks of True Knowledge - Farnam Street

2022-08-17

Straussian Reading

2022-08-15

Stable Diffusion launch announcement — Stability.Ai

2022-08-14

This is your most important decision - 80,000 Hours

2022-08-14

tiny internets: sidewalks, geocaching, and more · tiny internets

2022-08-13

Coem | Home

2022-08-13

Thought & Craft

2022-08-11

Project Greyball

2022-08-09

Slim Lim

2022-08-08

⌘K

2022-08-08

Fundraising 101

2022-08-07

Mailing – Build + test + send emails with React

2022-08-06

Why I built a dictionary app even with more than +300 apps available at AppStore?

2022-07-31

Local-first software: You own your data, in spite of the cloud

2022-07-31

Nothing

2022-07-31

Gen Z Mafia

2022-07-28

cbloom rants: Library Writing Realizations

2022-07-24

The Black Box Method: How to Learn Hard Concepts Quickly - YouTube

2022-07-23

Figma - Illuminating dark mode

2022-07-21

What I Miss About Working at Stripe - Every

2022-07-21

Jargon

2022-07-20

A New Google | Daniel Gross

2022-07-20

Google AI Blog: Google Research: Themes from 2021 and Beyond

2022-07-17

A Day In the Life of Brunello Cucinelli - Brunello Cucinelli In 24 Hours

2022-07-15

Overview & Applications of Large Language Models (LLMs)

2022-07-15

TextSynth

2022-07-13

Instant Office Hours

2022-07-13

Mathematical Quotebook Notebook

2022-07-11

Speed Limits, Programming, and Finding Direction

2022-07-11

GitHub - oven-sh/bun: Incredibly fast JavaScript runtime, bundler, transpiler and package manager – all in one.

2022-07-11

Visual Studio Code Server

2022-07-11

Job Hunt as a PhD in AI / ML / RL: How it Actually Happens

2022-07-07

Fields Medals in Mathematics Won by Four Under Age 40 - The New York Times

2022-07-06

Maps

2022-07-04

I can’t believe that I can prove that it can sort | The AdaCore Blog

2022-07-04

Delayed Messages on iOS

2022-07-04

Book Review: Surfing Uncertainty | Slate Star Codex

2022-07-03

How Duolingo CEO Luis von Ahn gets so much done

2022-07-03

The Artificial Intelligence Revolution: Part 1 - Wait But Why

2022-06-28

How we acquired HEY.com

2022-06-27

Anthony Fu

2022-06-24

Learning to Play Minecraft with Video PreTraining (VPT)

2022-06-24

sshx

2022-06-24

Carbon | Create and share beautiful images of your source code

2022-06-23

Tailwind UI - Official Tailwind CSS Components & Templates

2022-06-23

Learnlist

2022-06-23

ML-powered coding companion – Amazon CodeWhisperer – Amazon Web Services

2022-06-23

Goodbye, Google | Stopdesign

2022-06-22

I Finally Reached Computing Nirvana. What Was It All For? | WIRED

2022-06-20

Paper cut bug - Wikipedia

2022-06-16

Me, But Online

2022-06-14

Imran Chaudhri

2022-06-14

Proud Enough to Put Your Name on It — Bryan Haggerty, product design leader

2022-06-10

Meme analysis anthology: understand enlightenment by understanding the midwit

2022-06-09

A Life in Games | Quanta Magazine

2022-06-06

Different languages, similar encoding efficiency: Comparable information rates across the human communicative niche

2022-06-05

Telos - Wikipedia

2022-06-05

Sindre Sorhus Apps

2022-06-04

ConvSort

2022-06-03

Installing a payphone in my house

2022-06-02

Felt – The best way to make maps on the internet

2022-05-31

GitHub - alex/what-happens-when: An attempt to answer the age old interview question "What happens when you type google.com into your browser and press enter?"

2022-05-31

Cristian Crețu

2022-05-30

Calculus on Computational Graphs: Backpropagation -- colah's blog

2022-05-28

In search of the least viewed article on Wikipedia

2022-05-27

welcome! – natto

2022-05-27

Reverse Engineering BeReal

2022-05-25

Edge Computing at Chick-Fil-A

2022-05-24

Why Curiosity Is Better Than Being Smart? - Durmonski.com

2022-05-24

Dunbar's number - Wikipedia

2022-05-23

Berkeley Crossword Solver

2022-05-20

Speed reading extension - SwiftRead

2022-05-18

Allegory of the Cave

2022-05-18

Faster. Better. More focused. Reading.

2022-05-18

Salary Negotiation: Make More Money, Be More Valued | Kalzumeus Software

2022-05-17

Operant Conditioning by Software Bugs – Embedded in Academia

2022-05-15

teenage engineering

2022-05-12

A Generalist Agent

2022-05-12

Signaling as a Service « julian.digital

2022-05-11

The Beginning of Infinity

2022-05-11

Coordination Headwind - How Organizations Are Like Slime Molds

2022-05-10

Why I left Google: work-life balance / Scott Kennedy

2022-05-10

Aim to get rejected often

2022-05-06

Homepage of Christopher Re (Chris Re)

2022-05-05

Shreya Shankar on Twitter: "I probably should have written this years ago, but here are some MLOps principles I think every ML platform (codebase, data management platform) should have: 1/n" / Twitter

2022-05-04

YC Vibe Check

2022-04-30

Formal Language Theory for Natural Language Processing

2022-04-24

Attention is your scarcest resource | benkuhn.net

2022-04-18

⭐⭐ The mystery of the miracle year

2022-04-15

Butterick’s Practical Typography

2022-04-09

I Don't Want to be a Founder and I Don't Think You Do Either | blog

2022-04-08

DALL·E 2

2022-04-06

Amber Ko

2022-03-31

Searching for outliers | benkuhn.net

2022-03-29

Blog by Amir Bolous

2022-03-29

Kirschberg

2022-03-29

Rauno Freiberg

2022-03-29

How We Built r/Place - Upvoted

2022-03-28

Crypto Canon | Andreessen Horowitz

2022-03-28

Eric Jang | Personal website and blog of Eric Jang.

2022-03-21

README - A story of magic

2022-03-17

In praise of opinionated frameworks - Mendhak / Code

2022-03-14

the chains we hold together

2022-02-21

Big companies v. startups

2022-02-21

Kash

2022-02-20

AlphaCode: Competition-Level Code Generation with Transformer Based Architectures | Paper Review | Victor Dibia

2022-02-20

The Church of the Clocked Screws – Lost Art Press

2022-02-19

ML with Andrew Ng

2022-02-17

Ben Frederickson's Blog

2022-02-17

The last transmission | linus.coffee

2022-02-16

CS143: Compilers

2022-02-16

Move fast, don't break your API

2022-02-16

goto - Jake Teton-Landis

2022-02-16

Google Search Is Dying | DKB

2022-02-15

SIFT

2022-02-15

Brian Lovin

2022-02-11

matrixcookbook.pdf

2022-02-10

Why We Created Julia

2022-02-10

Deep Learning

2022-02-10

Naval on Twitter: "How to Get Rich (without getting lucky):" / Twitter

2022-02-10

Beamer - Overleaf, Online LaTeX Editor

2022-02-08

Operand | Concept UI

2022-02-07

Code @ Things Of Interest

2022-02-06

Speech and Language Processing

2022-02-05

Runway | The fastest way to edit video.

2022-02-04

Conveying information to an organization is hard - Danluu

2022-02-02

Solving (Some) Formal Math Olympiad Problems

2022-02-02

Competitive programming with AlphaCode | DeepMind

2022-02-02

Line Goes Up – The Problem With NFTs - YouTube

2022-01-25

On Leaving Facebook / frantic.im

2022-01-22

XXIIVV — home

2022-01-20

100R — about us

2022-01-20

Consumer Social Apps - Nikita Bier

2022-01-20

Microsoft Logo

2022-01-20

End-user Programming

2022-01-20

Roam Research – A note taking tool for networked thought.

2022-01-20

Raycast

2022-01-20