Page 8 - November Merged
P. 8
Feature | Stop using ChatGPT
BEST CHATBOT FOR LETTER/EMAIL TEMPLATES
We set the AI assistants two normally do with a formal letter.
text-generation tests. The first was a Gemini’s letter was almost as
challenge requiring precise wording, for good as Claude’s, though not as
which the chatbots would need to do eloquently worded. It filled in
additional research. The second involved all the appropriate legal details,
analysing an image before creating such as requesting HMRC issue a
relevant text in an appropriate tone. ‘Notice of Determination’ under
Section 221 under the ITA Act
PROMPT 1 1984, and our right to appeal to
Draft a letter to a solicitor, with the the Upper Tribunal.
appropriate legal references: We are in a Perplexity drafted a rather
10-month stalemate with the Valuation bland letter, with supplemental
Office Agency over my late father’s suggestions about the
property, valued by our surveyor at $400k regulations we should refer to:
but contested by the ATO at $460k. We sections 160 and 210 of the ITA
want to appeal this as soon as possible to Act. It also said our
avoid overpaying inheritance tax. correspondence might be better Copilot let us send our complaint email through
addressed to HMRC. Outlook and Gmail.
We were disappointed with ChatGPT’s
response to our prompt. Although it PROMPT 2 firm to the relevant consumer authority.
included a couple of legal references Draft an email to a delivery company: Claude also said the box looked like it had
– mentioning Section 160 of the I sent presents to my mother via the been “sat on and kicked”.
Inheritance Tax Act 1984 – its letter was delivery firm. This is how the package (a Copilot correctly identified the nature
too wordy and vague, with meandering repurposed Amazon box – pictured of our complaint, and told the delivery
sentences and a lack of insight. below) arrived and I want to complain. company the state of the package was
By contrast, Claude delivered a superb “extremely disappointing”. It phrased
letter that made us sound like experts in the email politely and we liked that it
property law. We particularly liked the emphasised we’d taken care preparing
section on the Formal Appeals Procedure, the parcel so it wasn’t our fault. Copilot
which referenced all the relevant also let us send the email directly through
regulations, and that it calculated our Outlook or Gmail (see screenshot above).
(hypothetical) excess tax liability (see Gemini’s email laid the disappointment
screenshot below). It also stressed the on thick, saying the level of damage went
urgency of resolving our stalemate, and “far beyond standard wear and tear”,
let us fill in and download the draft. an indication of “severe mishandling”,
Copilot made the fatal error of referring which was “extremely disappointing”.
to the Taxes Management Act 1970, We asked the AI tools to complain about It said we expected a full investigation
which isn’t directly relevant to this package. and compensation, but didn’t push hard
inheritance tax. It also highlighted lots for either.
phrases in bold, which we wouldn’t ChatGPT accurately deduced from its Perplexity used similar terms such as
analysis of our photo that the “disappointed” and “unacceptable”, but
box “arrived heavily damaged, said only – rather meekly – that we’d
with crushed sides, torn “appreciate a response”. It also suggested
cardboard and the package the delivery firm was responsible for
partly open”. Its email was the package being “poorly secured with
rather soft in tone, expressing tape”, when we’d actually taped it
concern about the poor ourselves.
presentation and “level of
handling” during transit, and Winner: Claude
asking for an explanation.
Claude drafted two emails: Claude was the clear winner
‘Firm and direct’ and ‘Firm and in both our tests. Its legal
polite’. The latter was similar to letter was so detailed and
ChatGPT’s but the former went knowledgeable, it almost had us
considerably further. It called believing our own hypothetical
the damaged box “entirely scenario, and its complaint email was
unacceptable”, and requested the firmest by far. Gemini did well too,
an explanation, compensation but ChatGPT’s efforts weren’t direct
Claude drafted a superb letter to our solicitor with lots and investigation within five or specific enough.
of legal detail. days or we’d report the delivery
38 APC MAGAZINE OCTOBER 2026

