QA a Chat Bot Relating to UX/CX [on hold]

I've been tasked with checking over a chat bot from a UX/CX perspective. This is the first time I've looked a chat bot from a professional point of view. Are there any key considerations here I should keep an eye out for?

E.g. do we have to declare it's a bot you're talking to rather than a human in order to manage the users expectations?

It's AI capabilities are in the early learning stages so the actual responses aren't that tailored yet but the function is sound enough.