Page 8 - November Merged
P. 8

Feature | Stop using ChatGPT




          BEST CHATBOT FOR LETTER/EMAIL TEMPLATES


         We set the AI assistants two       normally do with a formal letter.
         text-generation tests. The first was a   Gemini’s letter was almost as
         challenge requiring precise wording, for   good as Claude’s, though not as
         which the chatbots would need to do   eloquently worded. It filled in
         additional research. The second involved   all the appropriate legal details,
         analysing an image before creating   such as requesting HMRC issue a
         relevant text in an appropriate tone.   ‘Notice of Determination’ under
                                            Section 221 under the ITA Act
          PROMPT 1                          1984, and our right to appeal to
         Draft a letter to a solicitor, with the   the Upper Tribunal.
         appropriate legal references: We are in a   Perplexity drafted a rather
         10-month stalemate with the Valuation   bland letter, with supplemental
         Office Agency over my late father’s   suggestions about the
         property, valued by our surveyor at $400k   regulations we should refer to:
         but contested by the ATO at $460k. We   sections 160 and 210 of the ITA
         want to appeal this as soon as possible to   Act. It also said our
         avoid overpaying inheritance tax.   correspondence might be better   Copilot let us send our complaint email through
                                            addressed to HMRC.          Outlook and Gmail.
         We were disappointed with ChatGPT’s
         response to our prompt. Although it    PROMPT 2                       firm to the relevant consumer authority.
         included a couple of legal references   Draft an email to a delivery company:    Claude also said the box looked like it had
         – mentioning Section 160 of the    I sent presents to my mother via the   been “sat on and kicked”.
         Inheritance Tax Act 1984 – its letter was   delivery firm. This is how the package (a   Copilot correctly identified the nature
         too wordy and vague, with meandering   repurposed Amazon box – pictured   of our complaint, and told the delivery
         sentences and a lack of insight.   below) arrived and I want to complain.  company the state of the package was
           By contrast, Claude delivered a superb                              “extremely disappointing”. It phrased
         letter that made us sound like experts in                             the email politely and we liked that it
         property law. We particularly liked the                               emphasised we’d taken care preparing
         section on the Formal Appeals Procedure,                              the parcel so it wasn’t our fault. Copilot
         which referenced all the relevant                                     also let us send the email directly through
         regulations, and that it calculated our                               Outlook or Gmail (see screenshot above).
         (hypothetical) excess tax liability (see                                Gemini’s email laid the disappointment
         screenshot below). It also stressed the                               on thick, saying the level of damage went
         urgency of resolving our stalemate, and                               “far beyond standard wear and tear”,
         let us fill in and download the draft.                                an indication of “severe mishandling”,
           Copilot made the fatal error of referring                           which was “extremely disappointing”.
         to the Taxes Management Act 1970,   We asked the AI tools to complain about   It said we expected a full investigation
         which isn’t directly relevant to   this package.                      and compensation, but didn’t push hard
         inheritance tax. It also highlighted lots                             for either.
         phrases in bold, which we wouldn’t   ChatGPT accurately deduced from its   Perplexity used similar terms such as
                                                    analysis of our photo that the   “disappointed” and “unacceptable”, but
                                                    box “arrived heavily damaged,   said only – rather meekly – that we’d
                                                    with crushed sides, torn   “appreciate a response”. It also suggested
                                                    cardboard and the package   the delivery firm was responsible for
                                                    partly open”. Its email was   the package being “poorly secured with
                                                    rather soft in tone, expressing   tape”, when we’d actually taped it
                                                    concern about the poor     ourselves.
                                                    presentation and “level of
                                                    handling” during transit, and   Winner: Claude
                                                    asking for an explanation.
                                                      Claude drafted two emails:   Claude was the clear winner
                                                    ‘Firm and direct’ and ‘Firm and   in both our tests. Its legal
                                                    polite’. The latter was similar to   letter was so detailed and
                                                    ChatGPT’s but the former went   knowledgeable, it almost had us
                                                    considerably further. It called   believing our own hypothetical
                                                    the damaged box “entirely    scenario, and its complaint email was
                                                    unacceptable”, and requested   the firmest by far. Gemini did well too,
                                                    an explanation, compensation   but ChatGPT’s efforts weren’t direct
         Claude drafted a superb letter to our solicitor with lots   and investigation within five   or specific enough.
         of legal detail.                           days or we’d report the delivery
          38  APC MAGAZINE  OCTOBER 2026
   3   4   5   6   7   8   9   10   11   12   13