Taras Trishchuk
@trishchuk.bsky.social
Results:
Improved Qwen2.5-Math-7B accuracy from 58.8% to 90.0% on MATH dataset
The system solved 53.3% of AIME test problems (top 20% among participants)
Outperformed larger models on several key datasets
Improved Qwen2.5-Math-7B accuracy from 58.8% to 90.0% on MATH dataset
The system solved 53.3% of AIME test problems (top 20% among participants)
Outperformed larger models on several key datasets
January 10, 2025 at 5:12 PM
Results:
Improved Qwen2.5-Math-7B accuracy from 58.8% to 90.0% on MATH dataset
The system solved 53.3% of AIME test problems (top 20% among participants)
Outperformed larger models on several key datasets
Improved Qwen2.5-Math-7B accuracy from 58.8% to 90.0% on MATH dataset
The system solved 53.3% of AIME test problems (top 20% among participants)
Outperformed larger models on several key datasets
rStar-Math is a Microsoft technique that enhances the mathematical abilities of small language models using Monte Carlo Tree Search (MCTS) and self-evolution strategies.
Key features:
Key features:
January 10, 2025 at 5:11 PM
rStar-Math is a Microsoft technique that enhances the mathematical abilities of small language models using Monte Carlo Tree Search (MCTS) and self-evolution strategies.
Key features:
Key features:
Monte Carlo Tree Search (MCTS), a method initially developed for game AI, is now used to enhance mathematical reasoning in AI models.
January 10, 2025 at 5:08 PM
Monte Carlo Tree Search (MCTS), a method initially developed for game AI, is now used to enhance mathematical reasoning in AI models.
CAG (Context-Augmented Generation) offers an alternative to the traditional RAG approach. Instead of spending time searching for documents in real time, all necessary information is preloaded into the model's context.
January 10, 2025 at 1:31 PM
CAG (Context-Augmented Generation) offers an alternative to the traditional RAG approach. Instead of spending time searching for documents in real time, all necessary information is preloaded into the model's context.
Sparrow is an open-source solution for extracting and processing data from documents and images using ML, handling forms, invoices, receipts, and other structured data with modules for OCR, ML models, and data labeling
github.com/katanaml/spa...
github.com/katanaml/spa...
December 12, 2024 at 7:53 PM
Sparrow is an open-source solution for extracting and processing data from documents and images using ML, handling forms, invoices, receipts, and other structured data with modules for OCR, ML models, and data labeling
github.com/katanaml/spa...
github.com/katanaml/spa...
The universe is quite literally a song
December 6, 2024 at 10:47 AM
The universe is quite literally a song
It has come to my attention that many of you are unsure what an AI agent is.
Here’s a simple diagram comparing an AI agent (in its most basic form) to an API call with a tool.
Here’s a simple diagram comparing an AI agent (in its most basic form) to an API call with a tool.
December 5, 2024 at 10:15 PM
It has come to my attention that many of you are unsure what an AI agent is.
Here’s a simple diagram comparing an AI agent (in its most basic form) to an API call with a tool.
Here’s a simple diagram comparing an AI agent (in its most basic form) to an API call with a tool.
December 5, 2024 at 10:05 PM
In the 1990s, the Cypherpunks emerged, advocating for digital privacy through encryption. Among them was Hal Finney, a key figure in Bitcoin’s development. The Cypherpunks created tools like PGP for secure communication and inspired technologies like blockchain and cryptocurrencies.
December 5, 2024 at 6:20 PM
In the 1990s, the Cypherpunks emerged, advocating for digital privacy through encryption. Among them was Hal Finney, a key figure in Bitcoin’s development. The Cypherpunks created tools like PGP for secure communication and inspired technologies like blockchain and cryptocurrencies.
Snowflake's frontier embedding model. Arctic Embed 2.0 adds multilingual support without sacrificing English performance or scalability.
Uncompromising quality for English and non-English retrieval
ollama pull snowflake-arctic-embed2
Uncompromising quality for English and non-English retrieval
ollama pull snowflake-arctic-embed2
December 5, 2024 at 5:46 PM
Snowflake's frontier embedding model. Arctic Embed 2.0 adds multilingual support without sacrificing English performance or scalability.
Uncompromising quality for English and non-English retrieval
ollama pull snowflake-arctic-embed2
Uncompromising quality for English and non-English retrieval
ollama pull snowflake-arctic-embed2
Over time, the masses fell into serfdom and disorder, while the state became more authoritarian in response. When the barbarians came in the 5th century, the invaders came to be seen as liberators.
"The empire could no longer afford the problem of its own existence."
"The empire could no longer afford the problem of its own existence."
November 26, 2024 at 9:48 PM
Over time, the masses fell into serfdom and disorder, while the state became more authoritarian in response. When the barbarians came in the 5th century, the invaders came to be seen as liberators.
"The empire could no longer afford the problem of its own existence."
"The empire could no longer afford the problem of its own existence."
Constantine attempted to restore the currency by introducing a new gold solidus into mass circulation. However, subsequent emperors continued to debase the coins, refusing to believe that this led to inflation.
November 26, 2024 at 9:45 PM
Constantine attempted to restore the currency by introducing a new gold solidus into mass circulation. However, subsequent emperors continued to debase the coins, refusing to believe that this led to inflation.
Who pays when a monetary system collapses? People pay with their freedom. The currency became so worthless that the state demanded forced labor instead of accepting coins as tax payments. Merchants were required to supply goods directly to the army, and refusing to trade was made illegal.
November 26, 2024 at 9:45 PM
Who pays when a monetary system collapses? People pay with their freedom. The currency became so worthless that the state demanded forced labor instead of accepting coins as tax payments. Merchants were required to supply goods directly to the army, and refusing to trade was made illegal.
In 301 CE, Diocletian attempted to stabilize the situation by imposing price controls on 1,000 goods and services, but ultimately this failed. A modius of wheat, which had cost 0.5 denarii in the 2nd century, was selling for 10,000 denarii by 338 CE.
November 26, 2024 at 9:43 PM
In 301 CE, Diocletian attempted to stabilize the situation by imposing price controls on 1,000 goods and services, but ultimately this failed. A modius of wheat, which had cost 0.5 denarii in the 2nd century, was selling for 10,000 denarii by 338 CE.
When the state still struggled to pay soldiers' wages, some abandoned the army and went to plunder cities. For half a century, the empire teetered on the brink of destruction: emperors were murdered, barbarians pillaged cities and enslaved citizens.
November 26, 2024 at 9:42 PM
When the state still struggled to pay soldiers' wages, some abandoned the army and went to plunder cities. For half a century, the empire teetered on the brink of destruction: emperors were murdered, barbarians pillaged cities and enslaved citizens.
The administration even began issuing new coins that contained virtually no silver, but had a deceptively silvery surface.
People lost faith in the currency, paid taxes with the new worthless coins, and hoarded the old silver ones.
People lost faith in the currency, paid taxes with the new worthless coins, and hoarded the old silver ones.
November 26, 2024 at 9:41 PM
The administration even began issuing new coins that contained virtually no silver, but had a deceptively silvery surface.
People lost faith in the currency, paid taxes with the new worthless coins, and hoarded the old silver ones.
People lost faith in the currency, paid taxes with the new worthless coins, and hoarded the old silver ones.
Soon, an entire bag of coins contained as much silver as a single coin from a century earlier. By 300 CE, soldiers were being paid 8 times more in denarii compared to a century before, while wheat prices had increased 200-fold.
November 26, 2024 at 9:38 PM
Soon, an entire bag of coins contained as much silver as a single coin from a century earlier. By 300 CE, soldiers were being paid 8 times more in denarii compared to a century before, while wheat prices had increased 200-fold.
When it became impossible to pay soldiers' wages, the only solution left was further currency debasement. Emperors issued new denarii with less and less silver content — by 268 CE, it had dropped to just 0.5% silver.
November 26, 2024 at 9:37 PM
When it became impossible to pay soldiers' wages, the only solution left was further currency debasement. Emperors issued new denarii with less and less silver content — by 268 CE, it had dropped to just 0.5% silver.
In the mid-3rd century, the empire's borders came under attack. Military expenditures sharply increased, provinces were abandoned, tax revenues were lost, and vast quantities of silver and gold were lost through plunder and tribute payments.
November 26, 2024 at 9:36 PM
In the mid-3rd century, the empire's borders came under attack. Military expenditures sharply increased, provinces were abandoned, tax revenues were lost, and vast quantities of silver and gold were lost through plunder and tribute payments.
By the 3rd century, the purity of the denarius had fallen to 60%, and a modius of wheat cost several denarii.
Nevertheless, the state continued to spend money to maintain an illusion of prosperity — until crisis struck...
Nevertheless, the state continued to spend money to maintain an illusion of prosperity — until crisis struck...
November 26, 2024 at 9:33 PM
By the 3rd century, the purity of the denarius had fallen to 60%, and a modius of wheat cost several denarii.
Nevertheless, the state continued to spend money to maintain an illusion of prosperity — until crisis struck...
Nevertheless, the state continued to spend money to maintain an illusion of prosperity — until crisis struck...
Moreover, emperors had other methods of obtaining funds. Commodus confiscated the property of wealthy citizens by accusing them of treason, while Caracalla granted citizenship to 30 million provincials in a single night to subject them to taxation.
November 26, 2024 at 9:32 PM
Moreover, emperors had other methods of obtaining funds. Commodus confiscated the property of wealthy citizens by accusing them of treason, while Caracalla granted citizenship to 30 million provincials in a single night to subject them to taxation.
This seemed like a harmless way to increase the money supply, but the state soon became addicted to solving its problems this way. Emperors continued to gradually devalue or otherwise debase the coins, and for some time everything remained stable...
November 26, 2024 at 9:30 PM
This seemed like a harmless way to increase the money supply, but the state soon became addicted to solving its problems this way. Emperors continued to gradually devalue or otherwise debase the coins, and for some time everything remained stable...
When Nero had to rebuild Rome after the fire in 64 CE, money was scarce (especially due to the war in Armenia). Therefore, he melted down denarii and created more coins from the same silver content, reducing the purity from 98% to 93% while maintaining the same face value.
November 26, 2024 at 9:29 PM
When Nero had to rebuild Rome after the fire in 64 CE, money was scarce (especially due to the war in Armenia). Therefore, he melted down denarii and created more coins from the same silver content, reducing the purity from 98% to 93% while maintaining the same face value.
Emperors like Nero and Commodus spent money lavishly, nearly driving Rome to bankruptcy through their extravagance. For a while, free grain and games kept the lower classes content — "bread and circuses."
November 26, 2024 at 9:27 PM
Emperors like Nero and Commodus spent money lavishly, nearly driving Rome to bankruptcy through their extravagance. For a while, free grain and games kept the lower classes content — "bread and circuses."
The state also spent money on social programs of free and subsidized grain: 200,000 people in Rome received grain allowances.
Note: when the silver denarius was introduced in 211 BCE, a modius of wheat (8.7 L) cost only a fraction of a denarius.
Note: when the silver denarius was introduced in 211 BCE, a modius of wheat (8.7 L) cost only a fraction of a denarius.
November 26, 2024 at 9:25 PM
The state also spent money on social programs of free and subsidized grain: 200,000 people in Rome received grain allowances.
Note: when the silver denarius was introduced in 211 BCE, a modius of wheat (8.7 L) cost only a fraction of a denarius.
Note: when the silver denarius was introduced in 211 BCE, a modius of wheat (8.7 L) cost only a fraction of a denarius.