Computer science
20%
Philosophy
17%
Scott Lowe
@scottclowe.bsky.social
· Jan 3
UIP2P: Unsupervised Instruction-based Image Editing via Cycle Edit Consistency
We propose an unsupervised model for instruction-based image editing that eliminates the need for ground-truth edited images during training. Existing supervised methods depend on datasets containing ...
arxiv.org
There will also be continued interest in methods that allow more controllable manipulation of generated images (e.g. UIP2P arxiv.org/abs/2412.15216, Imagic arxiv.org/abs/2210.09276).
But maybe the pending copyright lawsuits will have major impacts on GenAI.
But maybe the pending copyright lawsuits will have major impacts on GenAI.
Scott Lowe
@scottclowe.bsky.social
· Jan 3
For GenAI, improvements to generation quality are going to come from better data curation and value fns to drive the model toward high-quality outputs. Standard model training results in outputs representative of the training distribution, but users don't want average—we want the best quality.
Scott Lowe
@scottclowe.bsky.social
· Jan 3
Frontier Models are Capable of In-context Scheming
Frontier models are increasingly trained and deployed as autonomous agent. One safety concern is that AI agents might covertly pursue misaligned goals, hiding their true capabilities and objectives - ...
arxiv.org
This is crucial for AGI, and will pose serious safety concerns. Models better at thinking outside the box and coming up with creative solutions will have broader implications than the prompter anticipated arxiv.org/abs/2412.04984.
Scott Lowe
@scottclowe.bsky.social
· Jan 3
Humans solve novel problems on-the-fly using System 2 reasoning: AI needs this too. By learning reasoning steps at training time, at deployment the model can build new sequences of reasoning steps, enabling it to extrapolate.
Scott Lowe
@scottclowe.bsky.social
· Jan 3
Reasoning capabilities are essential to reach robust perf in key ML products e.g. full self-driving. The distribution of driving scenarios is long-tailed, so even a model that covers most situations well may be faced with a novel situation outside its training data, but needs to respond correctly.
Scott Lowe
@scottclowe.bsky.social
· Jan 3
Large Concept Models: Language Modeling in a Sentence Representation Space
LLMs have revolutionized the field of artificial intelligence and have emerged as the de-facto tool for many tasks. The current established technology of LLMs is to process input and generate output a...
arxiv.org
One way to do this is hierarchical LLMs like the Large Concept Model arxiv.org/abs/2412.08821, Byte Latent Transformer arxiv.org/abs/2412.09871, and Block Transformer arxiv.org/abs/2406.02657.
Scott Lowe
@scottclowe.bsky.social
· Jan 3
For agentic models, the focus is shifting to System 2-like reasoning. OpenAI’s o1/o3 models demonstrate reasoning step-by-step can improve output quality by leveraging test-time compute. But impressive results on ARC are expensive, hence there will be a focus on improving test-compute efficiency.
Scott Lowe
@scottclowe.bsky.social
· Jan 3
But the LLM training corpus is now the majority of worthwhile text humanity has ever written, and can't be meaningfully scaled further. As Ilya Sutskever put it at NeurIPS, "big data is the fossil fuel of AI".
With this in mind, what will be the next stage of AI development?
With this in mind, what will be the next stage of AI development?
Scott Lowe
@scottclowe.bsky.social
· Jan 3
The turn of the year is a good time for reflection. Here's my thoughts on where ML is headed.
Advances have been driven by scaling—bigger compute, bigger data: bigger models. Moreover, larger data also gives a solution to OOD generalization—just increase the train set until everything is in domain!
Advances have been driven by scaling—bigger compute, bigger data: bigger models. Moreover, larger data also gives a solution to OOD generalization—just increase the train set until everything is in domain!
Scott Lowe
@scottclowe.bsky.social
· Dec 9
This has some serious AI safety implications. Having an AI model able to classify what is in an image better than a human doesn't pose an existential threat. But when an AI model can perform long-term planning better than a human, "just unplug it" ceases to be a reliable solution
Scott Lowe
@scottclowe.bsky.social
· Dec 9
System 2 Reasoning Capabilities Are Nigh
In recent years, machine learning models have made strides towards human-like reasoning capabilities from several directions. In this work, we review the current state of the literature and describe t...
arxiv.org
In "System 2 Reasoning Capabilities Are Nigh", I lay out comparisons between human reasoning and reasoning in AI models, and argue that all the components needed to create AI models that can perform human-like reasoning already exist.
arxiv.org/abs/2410.03662
arxiv.org/abs/2410.03662
Scott Lowe
@scottclowe.bsky.social
· Dec 9
It's very easy to get started with using the dataset. The commands to download it and load it for PyTorch training fit in less than half a tweet:
!pip install bioscan-dataset
from bioscan_dataset import BIOSCAN5M
ds = BIOSCAN5M("~/Datasets/bioscan-5m", download=True)
!pip install bioscan-dataset
from bioscan_dataset import BIOSCAN5M
ds = BIOSCAN5M("~/Datasets/bioscan-5m", download=True)
Scott Lowe
@scottclowe.bsky.social
· Dec 9
The dataset should be useful for a variety of research topics:
- multimodal learning
- fine-grained classification
- hierarchical labelling
- open-world classification/clustering
- semi- and self-supervised learning
- multimodal learning
- fine-grained classification
- hierarchical labelling
- open-world classification/clustering
- semi- and self-supervised learning
Scott Lowe
@scottclowe.bsky.social
· Dec 9
BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity
As part of an ongoing worldwide effort to comprehend and monitor insect biodiversity, this paper presents the BIOSCAN-5M Insect dataset to the machine learning community and establish several benchmar...
arxiv.org
BIOSCAN-5M is a multimodal dataset for insect biodiversity monitoring. It consists of 5 million insect specimens from around the world, with a high-res microscopy image, DNA barcode, taxonomic labels, size, and geolocation info for each sample.
arxiv.org/abs/2406.127...
arxiv.org/abs/2406.127...
Scott Lowe
@scottclowe.bsky.social
· Dec 9
I'm looking forward to NeurIPS this week! I'll be presenting two papers there. In the main conference, our new dataset BIOSCAN-5M, and in the System 2 Reasoning At Scale workshop my position paper "System 2 Reasoning Capabilities Are Nigh".