IEEE

Unleashing the Potential of Knowledge Distillation for IoT Traffic Classification

Abstract: The Internet of Things (IoT) has revolutionized our lives by generating large amounts of data, however, the data needs to be collected, processed, and analyzed in real-time. Network Traffic ...
CNBC

Anthropic joins OpenAI in flagging 'industrial-scale' distillation campaigns by Chinese AI firms

Anthropic accused three Chinese AI firms of engaging in concerted "distillation attack" campaigns. U.S. companies like Anthropic and OpenAI are concerned with ceding a competitive advantage to such ...
NBC News

Chinese AI companies 'distilled' Claude to improve own models, Anthropic says

Three Chinese artificial intelligence companies used Claude to improperly obtain capabilities to improve their own models, the chatbot’s creator Anthropic said in a blog post Monday while also making ...
Mashable

Anthropic: Chinese AI firms created 24,000 fraudulent accounts for 'distillation attacks'

Anthropic is accusing three Chinese artificial intelligence companies of "industrial-scale campaigns" to "illicitly extract" its technology using distillation attacks. Anthropic says these companies ...
The New York Times

Anthropic Accuses 3 Chinese Companies of Harvesting Its Data

The San Francisco start-up claimed that DeepSeek, Moonshot and MiniMax used approximately 24,000 fraudulent accounts to train their own chatbots. By Cade Metz Reporting from San Francisco The San ...
IEEE

Pixel Distillation: Cost-Flexible Distillation Across Image Sizes and Heterogeneous Networks

Abstract: Previous knowledge distillation (KD) methods mostly focus on compressing network architectures, which is not thorough enough in deployment as some costs like transmission bandwidth and ...
Reuters

OpenAI says China's DeepSeek trained its AI by distilling US models, memo shows

Feb 12 (Reuters) - OpenAI has warned U.S. lawmakers that Chinese artificial intelligence startup DeepSeek is targeting the ChatGPT maker and the nation's leading AI companies to replicate models and ...
InfoWorld

Researchers propose a self-distillation fix for ‘catastrophic forgetting’ in LLMs

LLMs tend to lose prior skills when fine-tuned for new tasks. A new self-distillation approach aims to reduce regression and simplify model management. A new fine-tuning technique aims to solve ...
The New York Times

Dior Could Use a Distillation

Jonathan Anderson came with some divine inspiration — but was it too much? By Jacob Gallagher Bright and early Wednesday morning, at a preview of the Dior collection I would see six hours later, the ...
Wired

Distillation Can Make AI Models Smaller and Cheaper

The original version of this story appeared in Quanta Magazine. The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it ...
Game Rant

These Tutorials Are So Long, They Hurt Their Games

Ritwik is a passionate gamer who has a soft spot for JRPGs. He's been writing about all things gaming for six years and counting. No matter how great a title's gameplay may be, there's always the ...