Finetuning Qwen for a new Programming Language

We have been working on aeon, a programming language with refinement types. Unliked add-on liquid types (LiquidHaskell, LiquidJava or Flux), it was designed to have them threaded throughout the program. Because of that, it has a very weird syntax that I have lately been changing to be as close to Lean as possible, so people don't have to learn yet another programming language. Because aeon includes program synthesis capabilities, using a bunch of algorithms, my student Su decided to add support for LLM generation of aeon code inside the compiler. Back then, he used a system prompt that explained that the language was and how it related to existing languages. However, this past year I have been using Sonnet, Opus, different GPTs and they have all been able to synthesize aeon code without a problem. The harness is good enough that it detects other .ae files in the repo and loads them into the context, and LLMs can easily learn languages from examples. However, I wanted to understand how…