Distillation Can Make AI Models Smaller and Cheaper

Much of the news coverage framed this possibility as a shock to the AI industry, implying that DeepSeek had discovered a new, ...
Yahoo

Secrets of Chinese AI Model DeepSeek Revealed in Landmark Paper

DeepSeek says its R1 model did not learn by copying examples generated by other LLMs. R1 is designed to excel at ‘reasoning’ tasks such as mathematics and coding, and is a cheaper rival to tools ...

Researchers find that retraining only small parts of AI models can cut costs and prevent forgetting

Research finds fine-tuning the MLP of some AI models lessens catastrophic forgetting during the fine-tuning process.
TechCrunch

Researchers question AI’s ‘reasoning’ ability as models stumble on math problems with trivial changes

How do machine learning models do what they do? And are they really “thinking” or “reasoning” the way we understand those things? This is a philosophical question as much as a practical one, but a new ...