56 minutes ago · 5 min read1046 words · Tech · hide

We have a need to hire more AI engineers at Gainwell – so I want to put together my brief notes on what types of skills I expect those individuals to have. Many grad programs in data science have not caught up – the work involves very little fitting of models (either tree-based or deep learning) and is more about integrating LLMs into various products. Understanding the LLM APIs While people often denigrate AI engineers as just gluing API calls together, the LLM APIs are some of the most complicated APIs folks will ever end up interacting with. For just a basic rundown, the things you should understand are: how traditional chat conversations work, e.g., system prompts, user input, and agent responses how tool calling works (and the difference between server-side tool calling and client-side tool calling with locally defined functions) how caching works and how to estimate costs with LLM APIs There are variations of these across different frontier model providers, but they are pretty…

Commenting on Bubbles has been removed. Why? If you want to talk about this post, write to the author, use the comments on their blog if it has them, or reply with a "RE:" post on your own blog. Suggestions? feedback@bubbles.town