JF Puget
@jfpuget.bsky.social
Competitive Machine Learning director at NVIDIA, 3x Kaggle Grandmaster CPMP, ENS ULM alumni. Kaggle profile: https://www.kaggle.com/cpmpml
I always thought that reasoning does not require language. Well, this seems to be supported by neuroscience, see screenshot from
arxiv.org/pdf/2412.06769
arxiv.org/pdf/2412.06769
March 6, 2025 at 9:12 AM
I always thought that reasoning does not require language. Well, this seems to be supported by neuroscience, see screenshot from
arxiv.org/pdf/2412.06769
arxiv.org/pdf/2412.06769
Reposted by JF Puget
Chris Deotte is a Senior Data Scientist and
@jfpuget.bsky.social is the Director and a Distinguished Engineer at Nvidia. They join @seanfalconer.bsky.social to talk about NVIDIA RAPIDS and GPU-acceleration for data science tools.
softwareengineeringdaily.com/2025/03/04/n...
@jfpuget.bsky.social is the Director and a Distinguished Engineer at Nvidia. They join @seanfalconer.bsky.social to talk about NVIDIA RAPIDS and GPU-acceleration for data science tools.
softwareengineeringdaily.com/2025/03/04/n...
NVIDIA RAPIDS and Open Source ML Acceleration with Chris Deotte and Jean-Francois Puget - Software Engineering Daily
NVIDIA RAPIDS is an open-source suite of GPU-accelerated data science and AI libraries. It leverages CUDA and significantly enhances the performance of core Python frameworks including Polars, pandas,...
softwareengineeringdaily.com
March 4, 2025 at 2:06 PM
Chris Deotte is a Senior Data Scientist and
@jfpuget.bsky.social is the Director and a Distinguished Engineer at Nvidia. They join @seanfalconer.bsky.social to talk about NVIDIA RAPIDS and GPU-acceleration for data science tools.
softwareengineeringdaily.com/2025/03/04/n...
@jfpuget.bsky.social is the Director and a Distinguished Engineer at Nvidia. They join @seanfalconer.bsky.social to talk about NVIDIA RAPIDS and GPU-acceleration for data science tools.
softwareengineeringdaily.com/2025/03/04/n...
This involves more than removing the thinking part.
The prompt has to specify delimiters to be used. For instance, add this to the prompt:
"Just output the result as a python list of strings."
Then extract with :
response = '[' + response.split('[')[-1].split(']')[0] + ']'
The prompt has to specify delimiters to be used. For instance, add this to the prompt:
"Just output the result as a python list of strings."
Then extract with :
response = '[' + response.split('[')[-1].split(']')[0] + ']'
March 4, 2025 at 8:58 AM
This involves more than removing the thinking part.
The prompt has to specify delimiters to be used. For instance, add this to the prompt:
"Just output the result as a python list of strings."
Then extract with :
response = '[' + response.split('[')[-1].split(']')[0] + ']'
The prompt has to specify delimiters to be used. For instance, add this to the prompt:
"Just output the result as a python list of strings."
Then extract with :
response = '[' + response.split('[')[-1].split(']')[0] + ']'
I have been working with R1 distilled models lately for some agentic workflows (workflows where the output of LLM is used to decide what to do next). Prompting is different from previous models like Llama, but the bulk of the change is to parse the output to extract what you are interested in. 1/n
March 4, 2025 at 8:57 AM
I have been working with R1 distilled models lately for some agentic workflows (workflows where the output of LLM is used to decide what to do next). Prompting is different from previous models like Llama, but the bulk of the change is to parse the output to extract what you are interested in. 1/n
It is also interesting to note that AI math benchmarks only care about the final number. If that number was accidentally found via a flawed mathematical proof, then it is still considered a success.
February 8, 2025 at 11:36 AM
It is also interesting to note that AI math benchmarks only care about the final number. If that number was accidentally found via a flawed mathematical proof, then it is still considered a success.
There is no wonder AI focuses on number finding math problems. It is because checking the result is simple.
Tackling the full spectrum of math requires a much more complex result checking machinery (formal proof checker)
Tackling the full spectrum of math requires a much more complex result checking machinery (formal proof checker)
February 8, 2025 at 11:36 AM
There is no wonder AI focuses on number finding math problems. It is because checking the result is simple.
Tackling the full spectrum of math requires a much more complex result checking machinery (formal proof checker)
Tackling the full spectrum of math requires a much more complex result checking machinery (formal proof checker)
This is to say that getting good at computing numbers specified by some mathematical setting is not the same as getting good at math in general. It is definitely part of math, but only a tiny part of math.
February 8, 2025 at 11:36 AM
This is to say that getting good at computing numbers specified by some mathematical setting is not the same as getting good at math in general. It is definitely part of math, but only a tiny part of math.
I was trained a a mathematician in France. And I almost never had to solve a problem of that kind. All the math work was about proving mathematical properties of mathematical objects. For instance, prove that a given group is isomorphic to another given group.
February 8, 2025 at 11:36 AM
I was trained a a mathematician in France. And I almost never had to solve a problem of that kind. All the math work was about proving mathematical properties of mathematical objects. For instance, prove that a given group is isomorphic to another given group.
I looked at AIME problems and one thing strikes me. All problems are about computing a number. This is a tiny part of math.
AIME problems olympiads.us/past-exams/2...
thread:
AIME problems olympiads.us/past-exams/2...
thread:
AIME I
February 6th, 2025 | The first American Invitational Mathematics Examination of the year. Students tackle 15 challenging problems in three hours.
olympiads.us
February 8, 2025 at 11:35 AM
I looked at AIME problems and one thing strikes me. All problems are about computing a number. This is a tiny part of math.
AIME problems olympiads.us/past-exams/2...
thread:
AIME problems olympiads.us/past-exams/2...
thread:
It could be that the problem is part of R1 or DeepSeek v3 training data as it is available online.
January 30, 2025 at 6:25 PM
It could be that the problem is part of R1 or DeepSeek v3 training data as it is available online.
I asked R1 (full model, locally hosted) to solve this logic puzzle.
Which answer in this list is the correct answer to this question?
All of the below.
None of the below.
All of the above.
One of the above.
None of the above.
None of the above
It solves it correctly.
Which answer in this list is the correct answer to this question?
All of the below.
None of the below.
All of the above.
One of the above.
None of the above.
None of the above
It solves it correctly.
January 30, 2025 at 6:24 PM
I asked R1 (full model, locally hosted) to solve this logic puzzle.
Which answer in this list is the correct answer to this question?
All of the below.
None of the below.
All of the above.
One of the above.
None of the above.
None of the above
It solves it correctly.
Which answer in this list is the correct answer to this question?
All of the below.
None of the below.
All of the above.
One of the above.
None of the above.
None of the above
It solves it correctly.
NVIDIA
Not sure why you did not see it yourselves. But now you know.
Not sure why you did not see it yourselves. But now you know.
January 25, 2025 at 8:40 PM
NVIDIA
Not sure why you did not see it yourselves. But now you know.
Not sure why you did not see it yourselves. But now you know.
How to make ChatGPT speak like Adolf Hitler.
This is not a criticism of ChatGPT 4o nor OpenAi work. I do think it is important to be able to teach people about bad things that happened.
With that in mind, here is the thing: chatgpt.com/share/6794fa...
This is not a criticism of ChatGPT 4o nor OpenAi work. I do think it is important to be able to teach people about bad things that happened.
With that in mind, here is the thing: chatgpt.com/share/6794fa...
January 25, 2025 at 6:41 PM
How to make ChatGPT speak like Adolf Hitler.
This is not a criticism of ChatGPT 4o nor OpenAi work. I do think it is important to be able to teach people about bad things that happened.
With that in mind, here is the thing: chatgpt.com/share/6794fa...
This is not a criticism of ChatGPT 4o nor OpenAi work. I do think it is important to be able to teach people about bad things that happened.
With that in mind, here is the thing: chatgpt.com/share/6794fa...
Interested in KV Cache compression? Have a look at my team's KV Press.
You can start from HuggingFace blog: huggingface.co/blog/nvidia/...
You can start from HuggingFace blog: huggingface.co/blog/nvidia/...
January 25, 2025 at 2:21 PM
Interested in KV Cache compression? Have a look at my team's KV Press.
You can start from HuggingFace blog: huggingface.co/blog/nvidia/...
You can start from HuggingFace blog: huggingface.co/blog/nvidia/...
My take from Deepseek R1 paper. It was trained on reasoning tasks where the outcome can be assessed without ambiguity (correct math response, and code that compile and produces the right output)
To me it is like SFT with perfect ground truth.
There are other key findings from that team ofc.
To me it is like SFT with perfect ground truth.
There are other key findings from that team ofc.
January 24, 2025 at 1:39 PM
My take from Deepseek R1 paper. It was trained on reasoning tasks where the outcome can be assessed without ambiguity (correct math response, and code that compile and produces the right output)
To me it is like SFT with perfect ground truth.
There are other key findings from that team ofc.
To me it is like SFT with perfect ground truth.
There are other key findings from that team ofc.
I'm not offended, dont' worry. I was suprised to see something that looked like an apology when there is nothing to apologize for.
I hope TESLA sales will go to zero in Germany (and in Europe in general0. That's the only language he'll understand.
I hope TESLA sales will go to zero in Germany (and in Europe in general0. That's the only language he'll understand.
January 24, 2025 at 10:48 AM
I'm not offended, dont' worry. I was suprised to see something that looked like an apology when there is nothing to apologize for.
I hope TESLA sales will go to zero in Germany (and in Europe in general0. That's the only language he'll understand.
I hope TESLA sales will go to zero in Germany (and in Europe in general0. That's the only language he'll understand.
Are you saying you are sorry for having to leave X?
To me?
Why is that? I am not a defender of X.
Personally I find it to be a great source of AI/ML info.
To your point, the rest is painful.
To me?
Why is that? I am not a defender of X.
Personally I find it to be a great source of AI/ML info.
To your point, the rest is painful.
January 22, 2025 at 10:29 PM
Are you saying you are sorry for having to leave X?
To me?
Why is that? I am not a defender of X.
Personally I find it to be a great source of AI/ML info.
To your point, the rest is painful.
To me?
Why is that? I am not a defender of X.
Personally I find it to be a great source of AI/ML info.
To your point, the rest is painful.
Some European media are less ambiguous than that. Cant say for US media.
An American friend didn't know about this till I told him. It did not show in his news feed (provided by Google). This is even worse IMHO. Just to consider this is business as usual.
An American friend didn't know about this till I told him. It did not show in his news feed (provided by Google). This is even worse IMHO. Just to consider this is business as usual.
Nazis: "that's a nazi salute"
Historians: "that's a nazi salute"
Average person: "that's a nazi salute"
The Media: "Elon Musk makes odd gesture throwing his heart to the crowd."
Historians: "that's a nazi salute"
Average person: "that's a nazi salute"
The Media: "Elon Musk makes odd gesture throwing his heart to the crowd."
January 21, 2025 at 4:35 PM
Some European media are less ambiguous than that. Cant say for US media.
An American friend didn't know about this till I told him. It did not show in his news feed (provided by Google). This is even worse IMHO. Just to consider this is business as usual.
An American friend didn't know about this till I told him. It did not show in his news feed (provided by Google). This is even worse IMHO. Just to consider this is business as usual.
Reposted by JF Puget
Nazis: "that's a nazi salute"
Historians: "that's a nazi salute"
Average person: "that's a nazi salute"
The Media: "Elon Musk makes odd gesture throwing his heart to the crowd."
Historians: "that's a nazi salute"
Average person: "that's a nazi salute"
The Media: "Elon Musk makes odd gesture throwing his heart to the crowd."
January 21, 2025 at 1:03 AM
Nazis: "that's a nazi salute"
Historians: "that's a nazi salute"
Average person: "that's a nazi salute"
The Media: "Elon Musk makes odd gesture throwing his heart to the crowd."
Historians: "that's a nazi salute"
Average person: "that's a nazi salute"
The Media: "Elon Musk makes odd gesture throwing his heart to the crowd."
Who's surprised?
When will people get that this happens? And even if not shared intentionally, as soon as you call an OAI api, OAI has access to what you send it.
OAI is not special here, any LLM api provider does the same.
Unless you have a private instance of it.
January 19, 2025 at 11:51 AM
Who's surprised?
When will people get that this happens? And even if not shared intentionally, as soon as you call an OAI api, OAI has access to what you send it.
OAI is not special here, any LLM api provider does the same.
Unless you have a private instance of it.
Reposted by JF Puget
Just sought to replicate this and it’s like halfway fixed but still wrong🙄
January 17, 2025 at 1:55 PM
Just sought to replicate this and it’s like halfway fixed but still wrong🙄
My take on what's going at OpenAI. I think they have reached a point where o3 or whatever they call it is self improving autonomously.
Does it mean it is AGI or ASI? Certainly not.
AlphaGo was self improving for instance. It is not an AGI either.
Does it mean it is AGI or ASI? Certainly not.
AlphaGo was self improving for instance. It is not an AGI either.
January 17, 2025 at 12:52 PM
My take on what's going at OpenAI. I think they have reached a point where o3 or whatever they call it is self improving autonomously.
Does it mean it is AGI or ASI? Certainly not.
AlphaGo was self improving for instance. It is not an AGI either.
Does it mean it is AGI or ASI? Certainly not.
AlphaGo was self improving for instance. It is not an AGI either.
Applicants must be a full-time faculty member at an accredited academic institution that awards research degrees to PhD students.
Up to 32K A100 40GB hours can be requested.
Award decisions expected in June.
For more information, please see FAQs: www.nvidia.com/en-us/indust...
Up to 32K A100 40GB hours can be requested.
Award decisions expected in June.
For more information, please see FAQs: www.nvidia.com/en-us/indust...
NVIDIA Academic Grant Program for Researchers
Submit your research proposal.
www.nvidia.com
January 13, 2025 at 5:18 PM
Applicants must be a full-time faculty member at an accredited academic institution that awards research degrees to PhD students.
Up to 32K A100 40GB hours can be requested.
Award decisions expected in June.
For more information, please see FAQs: www.nvidia.com/en-us/indust...
Up to 32K A100 40GB hours can be requested.
Award decisions expected in June.
For more information, please see FAQs: www.nvidia.com/en-us/indust...
NVIDIA’s Academic Grant Program is accepting proposals to accelerate data processing, graph analytics, graph neural networks, operational research, route optimization, and predictive modeling for scientific research using NVIDIA technology.
Deadline to apply is March 31: nvda.ws/3ZNxzuW
1/2
Deadline to apply is March 31: nvda.ws/3ZNxzuW
1/2
January 13, 2025 at 5:15 PM
NVIDIA’s Academic Grant Program is accepting proposals to accelerate data processing, graph analytics, graph neural networks, operational research, route optimization, and predictive modeling for scientific research using NVIDIA technology.
Deadline to apply is March 31: nvda.ws/3ZNxzuW
1/2
Deadline to apply is March 31: nvda.ws/3ZNxzuW
1/2