Sketch2Code

Launched in 2018 by Microsoft AI Lab, Sketch2Code is an open source project designed to help developers easily convert hand-drawn sketches into HTML code. Using Sketch2Code, developers can draw wireframe sketches and export them as source code.Sketch2Code uses artificial intelligence and automation to develop code from wireframe sketches, supporting basic web page visual elements including labels, text fields, text paragraphs, images, and buttons.

At the time of its release in 2018, the model behind the service had been trained with millions of images and could perform object detection on various types of objects. With this information, the tool can generate snippets of HTML code for different elements of a design, which can then infer the layout of the design based on the location of the recognized elements and generate the final HTML code accordingly.

And with a demo demonstration of converting sketches into web pages in the GPT 4 demo, it's likely that Microsoft has already partnered and iterated on the technology with OpenAI, and the latest training image data could be well beyond 2018.