kasidkhan
@kasidkhan.bsky.social
AI enthusiast and commentators. Follow me if you are interested in Artificial Intelligence.
Wishing you and your family a Christmas filled with joy, peace, and the hope that comes from the birth of all Savior of the past and future. Merry Christmas!!
December 23, 2024 at 9:50 AM
Wishing you and your family a Christmas filled with joy, peace, and the hope that comes from the birth of all Savior of the past and future. Merry Christmas!!
more info here arcprize.org/arc
ARC Prize - What is ARC-AGI?
Learn more about the only AI benchmark that measures AGI progress.
arcprize.org
December 22, 2024 at 6:07 AM
more info here arcprize.org/arc
well. it is not there yet. The www.swebench.com/viewer.html shows Amazon Q is able to solve 55% of complex problem so far and it is improvement from Claude 4.8% in 2024. So, I guess we are not there yet but reaching there.
SWE-bench
SWE-bench: Evaluate Language Models on Open Source Software Tasks
www.swebench.com
December 7, 2024 at 10:32 PM
well. it is not there yet. The www.swebench.com/viewer.html shows Amazon Q is able to solve 55% of complex problem so far and it is improvement from Claude 4.8% in 2024. So, I guess we are not there yet but reaching there.