I think UX should play an integral role in the design of LLMs, don't you? Why stop at the interface? LLMs could be designed, linguistically, to engage in mutual or bidirectional prompting with users. Could be designed to engage in a conversational exchange that helps the user get better results, articulate a more precise request, specify sources, styles, even formatting...
I think UX needs to embrace the expressive and informational opportunities and "affordances" of language and speech, talk and conversation, reading and writing.
This'll present a challenge to designers who chose design because it is primarily visual, or who conceive of problems as principally informational/navigational/ architectural.
But this was always the trajectory of UX and UI design: less chrome, more transparency, naturalness, and immediacy.
Will be interesting to see how the field wakes up to the challenge. From what I can see currently the design of AI is largely in the hands of engineers and developers. And UX is on the sidelines.