Csaba Toth
Jul 13, 2024

--

I don't think it's a good idea to repeat the tools in the system prompt, because the model receives that in another way too. I'm looking for a prompt which keeps the ReAct loop, but encourages the native function execution. Native function execution I'd expect could happen at the action phase, even multiple functions. My problem is let's say a questions like "What's the weather today" would involve two function calls: one for determining the current location, and the other is to call the weather API with that location. The modern function call capable models are able to conclude to these two calls on their own without ReAct. ReAct without function calls would explicitly list these steps. The problem that even today a ReAct prompt would result in explicit function calling plans, which will interfere with native function calling and parameter substitution.

--

--

Csaba Toth

Full-stack developer, GDG Fresno co-organizer, Central Cal JUG founder, Central Cal. .NET UG activist, NJUG co-founder.