All the hard stuff nobody talks about when building products with LLMs.

“To be blunt, a lot of that [LLM] hype is just some demo bullshit that would fall over the instant anyone tried to use it for a real task that their job depends on. The reality is far less glamorous: it’s hard to build a real product backed by an LLM. Here’s my elaboration of all the challenges we faced while building Query Assistant.” Don’t let this turn you into an AI bear. Hoards of developers are working on making the hard stuff easier! ~ learn more