Jeremy Jordan
@jeremyjordan.me
product-focused machine learning engineer. broadly curious; amazed by the effectiveness of simple ideas.
jeremyjordan.me
jeremyjordan.me
we should also evaluate our tokens based on “how well does modeling {this set of tokens} improve performance on {other sets of tokens/downstream tasks}”. not all tokens created equal! i would argue yours have been pretty impactful 🙂 at least they have for me!
April 23, 2023 at 12:44 AM
we should also evaluate our tokens based on “how well does modeling {this set of tokens} improve performance on {other sets of tokens/downstream tasks}”. not all tokens created equal! i would argue yours have been pretty impactful 🙂 at least they have for me!
granted, humans hallucinate as an adaptive measure shaped by evolution (our brain tricks us into perceiving things that help us stay alive) so it’s a little different, but still
April 14, 2023 at 1:35 AM
granted, humans hallucinate as an adaptive measure shaped by evolution (our brain tricks us into perceiving things that help us stay alive) so it’s a little different, but still