Allan
@niemerg.bsky.social
With tests, lawyers could finally trust AI assistance because they'd have systematic verification - not just for document creation, but for document correctness.
So I’d love to know: What would you want to test in your contracts?
fullydoxxed.com/to-use-ai-la...
So I’d love to know: What would you want to test in your contracts?
fullydoxxed.com/to-use-ai-la...
To Use AI, Lawyers Should Steal This From Software Developers | Fully Doxxed
Something remarkable has happened in software development over the past few years. Large language models have revolutionized how code gets…
fullydoxxed.com
July 7, 2025 at 8:13 PM
With tests, lawyers could finally trust AI assistance because they'd have systematic verification - not just for document creation, but for document correctness.
So I’d love to know: What would you want to test in your contracts?
fullydoxxed.com/to-use-ai-la...
So I’d love to know: What would you want to test in your contracts?
fullydoxxed.com/to-use-ai-la...
Write tests once, apply them to every document of that type.
Hallucinated case citation? Test catches it.
Violates state statutory requirements? Test catches it.
Wrong client entity details? Test catches it.
It's like always having a fresh pair of eyes on every document.
Hallucinated case citation? Test catches it.
Violates state statutory requirements? Test catches it.
Wrong client entity details? Test catches it.
It's like always having a fresh pair of eyes on every document.
July 7, 2025 at 8:13 PM
Write tests once, apply them to every document of that type.
Hallucinated case citation? Test catches it.
Violates state statutory requirements? Test catches it.
Wrong client entity details? Test catches it.
It's like always having a fresh pair of eyes on every document.
Hallucinated case citation? Test catches it.
Violates state statutory requirements? Test catches it.
Wrong client entity details? Test catches it.
It's like always having a fresh pair of eyes on every document.
Legal tests work just like software tests:
- Run automatically when documents change
- Verify against pre-defined requirements
- Catch regressions from edits
- Show exactly what failed and where
Turn "hope I didn't miss anything" into systematic verification.
- Run automatically when documents change
- Verify against pre-defined requirements
- Catch regressions from edits
- Show exactly what failed and where
Turn "hope I didn't miss anything" into systematic verification.
July 7, 2025 at 8:13 PM
Legal tests work just like software tests:
- Run automatically when documents change
- Verify against pre-defined requirements
- Catch regressions from edits
- Show exactly what failed and where
Turn "hope I didn't miss anything" into systematic verification.
- Run automatically when documents change
- Verify against pre-defined requirements
- Catch regressions from edits
- Show exactly what failed and where
Turn "hope I didn't miss anything" into systematic verification.
The real problem: AI generates documents faster than humans can review them.
Without verification infrastructure, you either:
- Slow down to manually check everything (lose productivity gains)
- Risk missing critical errors (hello, Bar sanctions)
Without verification infrastructure, you either:
- Slow down to manually check everything (lose productivity gains)
- Risk missing critical errors (hello, Bar sanctions)
July 7, 2025 at 8:13 PM
The real problem: AI generates documents faster than humans can review them.
Without verification infrastructure, you either:
- Slow down to manually check everything (lose productivity gains)
- Risk missing critical errors (hello, Bar sanctions)
Without verification infrastructure, you either:
- Slow down to manually check everything (lose productivity gains)
- Risk missing critical errors (hello, Bar sanctions)
When AI writes code, developers can:
- Compile it (immediate feedback)
- Run tests against it (systematic verification)
- Debug it step-by-step (transparent execution)
When AI writes contracts, lawyers have... track changes and hope for the best.
What if lawyers had systematic verification too?
- Compile it (immediate feedback)
- Run tests against it (systematic verification)
- Debug it step-by-step (transparent execution)
When AI writes contracts, lawyers have... track changes and hope for the best.
What if lawyers had systematic verification too?
July 7, 2025 at 8:13 PM
When AI writes code, developers can:
- Compile it (immediate feedback)
- Run tests against it (systematic verification)
- Debug it step-by-step (transparent execution)
When AI writes contracts, lawyers have... track changes and hope for the best.
What if lawyers had systematic verification too?
- Compile it (immediate feedback)
- Run tests against it (systematic verification)
- Debug it step-by-step (transparent execution)
When AI writes contracts, lawyers have... track changes and hope for the best.
What if lawyers had systematic verification too?
This is English but reads as incomprehensible as code in a computer language I do not know—which I guess it is.
June 4, 2025 at 12:38 PM
This is English but reads as incomprehensible as code in a computer language I do not know—which I guess it is.
Feels like you write this to dazzle the audience so they get that the character is crazy smart, it’s not supposed to be comprehensible. For that reason, you need it all tossed in together so you don’t confuse your audience elsewhere.
June 4, 2025 at 2:44 AM
Feels like you write this to dazzle the audience so they get that the character is crazy smart, it’s not supposed to be comprehensible. For that reason, you need it all tossed in together so you don’t confuse your audience elsewhere.
At this rate, Tourette's will be considered an unfair advantage in business writing by 2026. The weirder and more unpredictable you sound, the more human you seem. Language evolves whether we like it or not. I was right about all of this, by the way.
fullydoxxed.com/fuck-chat-gp...
fullydoxxed.com/fuck-chat-gp...
Fuck! ChatGPT Really Is Ruining Writing (And I Told You So)! | Fully Doxxed
Two years ago, I tweeted this: And whaddya know, I was right. ChatGPT written words have so infiltrated human writing that what was once…
fullydoxxed.com
May 28, 2025 at 4:23 PM
At this rate, Tourette's will be considered an unfair advantage in business writing by 2026. The weirder and more unpredictable you sound, the more human you seem. Language evolves whether we like it or not. I was right about all of this, by the way.
fullydoxxed.com/fuck-chat-gp...
fullydoxxed.com/fuck-chat-gp...
The future belongs to wherever ChatGPT can't go. One-sided rants. Emotional language. Stream of consciousness. Inside jokes. Raw, unqualified advice. We're about to deliberately write "worse" just to prove we're human. And it's gonna work.
May 28, 2025 at 4:23 PM
The future belongs to wherever ChatGPT can't go. One-sided rants. Emotional language. Stream of consciousness. Inside jokes. Raw, unqualified advice. We're about to deliberately write "worse" just to prove we're human. And it's gonna work.
Why do we hate AI writing so much? It's like C-3PO - technically correct but nobody wants to hear the protocol droid drone on. No, I don't want to "delve" into your "tapestry" of bullshit, thank you very friggin' much.
May 28, 2025 at 4:23 PM
Why do we hate AI writing so much? It's like C-3PO - technically correct but nobody wants to hear the protocol droid drone on. No, I don't want to "delve" into your "tapestry" of bullshit, thank you very friggin' much.
Napkin math suggests that if you are making methane and extravagantly shipping in the water, that’s still only 10 cents of cost per dollar of methane, so it seems like you are right—very interesting.
May 10, 2025 at 10:46 AM
Napkin math suggests that if you are making methane and extravagantly shipping in the water, that’s still only 10 cents of cost per dollar of methane, so it seems like you are right—very interesting.
A key consideration would be water, so that may make it not economical. But my prediction is that if it becomes economical it will be done.
May 10, 2025 at 3:28 AM
A key consideration would be water, so that may make it not economical. But my prediction is that if it becomes economical it will be done.
I don’t disagree with you on the need to grow and modernize the grid, I’m just pessimistic about it happening. Would be great. Regarding pipelines, it is my understanding that there are networks of underused pipes in many states like Texas and Oklahoma that may be great places for solar.
May 10, 2025 at 3:27 AM
I don’t disagree with you on the need to grow and modernize the grid, I’m just pessimistic about it happening. Would be great. Regarding pipelines, it is my understanding that there are networks of underused pipes in many states like Texas and Oklahoma that may be great places for solar.
Everything you’ve said is correct, and yet, solar has been growing at 26% per year, for many years now. Transmission capacity isn’t growing anywhere near that. We are going to need economic uses of electricity that don’t require transmission and can take TW of energy. What other options do we have?
May 10, 2025 at 2:43 AM
Everything you’ve said is correct, and yet, solar has been growing at 26% per year, for many years now. Transmission capacity isn’t growing anywhere near that. We are going to need economic uses of electricity that don’t require transmission and can take TW of energy. What other options do we have?
True, but impossible if we don’t radically change policy around transmission lines.
May 9, 2025 at 5:19 PM
True, but impossible if we don’t radically change policy around transmission lines.
The solar panel stat is insane. If we could turn solar into hydrocarbons, things would be wild. You could repurpose existing infrastructure to collect from disparate oil wells but with energy from the sun.
May 9, 2025 at 4:52 PM
The solar panel stat is insane. If we could turn solar into hydrocarbons, things would be wild. You could repurpose existing infrastructure to collect from disparate oil wells but with energy from the sun.
If it’s a 100Wh battery, that’s like 1/10th of a cent of electricity? You’d need to do like 200-400 queries to match the daily electricity of usage of a refrigerator?
May 8, 2025 at 12:51 AM
If it’s a 100Wh battery, that’s like 1/10th of a cent of electricity? You’d need to do like 200-400 queries to match the daily electricity of usage of a refrigerator?
To avoid that generic "ChatGPT smell" in final work, I explicitly ask the model to use my voice and words from our conversation. The result? Content that actually sounds like me. fullydoxxed.com/how-i-use-ll...
How I Use LLMs to Write | Fully Doxxed
You've probably seen a lot of skepticism of large language models (LLMs) like ChatGPT and Claude on social media. Often, AI is seen as wor…
fullydoxxed.com
May 5, 2025 at 4:01 PM
To avoid that generic "ChatGPT smell" in final work, I explicitly ask the model to use my voice and words from our conversation. The result? Content that actually sounds like me. fullydoxxed.com/how-i-use-ll...
When I'm stuck or procrastinating, I just start dumping thoughts to an LLM. No organization needed. LLMs are great at helping draw out and organize your thoughts so you can focus on what you *really* want to say.
May 5, 2025 at 4:01 PM
When I'm stuck or procrastinating, I just start dumping thoughts to an LLM. No organization needed. LLMs are great at helping draw out and organize your thoughts so you can focus on what you *really* want to say.