Antonis Krasakis
tonylittlewine.bsky.social
Antonis Krasakis
@tonylittlewine.bsky.social
PhD student at University of Amsterdam. Working on information retrieval, LLMs and RAG
Thanks for sharing! Are there any positions that do not require a US work permit (or remote possibility)?
January 18, 2025 at 12:25 PM
I'm excited about this line of work, as it paves the way towards more effective and lexically grounded representations for complex queries!
Many thanks to my co-authors for their support and constructive feedback!
#IR #NLP #research
January 15, 2025 at 11:57 AM
To do so, we introduce a novel activation function (SNReLU) that preserves the desirable properties of splade models (log saturation effect, sparsity). We find that, given enough training data (needed to adapt to the new act fn), retrieval performance for negations improves by +100%!
January 15, 2025 at 11:57 AM
Finally, we focus on negations, a challenging yet under-explored area in IR. The main idea is simple: we allow LSR models attribute negative term scores to terms associated with negated aspects of the query. In practice this allows LSR models to directly penalize documents containing negated aspects
January 15, 2025 at 11:57 AM
First, we construct zero-shot representations
using vector arethmetics designed to encapsulate each compositionality type (eg. intersection or negations). This method often outperforms DR/LSR models trained for compositionality, which struggle for some of these compositionality types
January 15, 2025 at 11:57 AM
I'd like to be added too!
November 24, 2024 at 9:54 AM