Oddbean new post about | logout
 This marks the emergence of the first AI engineer, enabling user without coding knowledge to transform their ideas into apps. 

The landscape of computer science is poised to undergo significant democratization.
https://video.nostr.build/2a64f8cf51c3179ef5479e91a8588b79b8b712fced850153f69eb8891c4b0d0f.mp4 
 Wild 
 I would love to try this  
 The last time I asked a AI for code was for a code snippet to do orthographic transcription (e.g. Владимир Путин -> Vladimir Putin). The AI responded with a snippet doing a (even pointless) change of encoding that would result in an exception only.
I complained about getting only an exception when executing the code. It then try catch print stack trace the code. After complaining about not wanting a stack trace, the AI removed the stack trace output, so the result was just nothing.
So I complained again and reformulated my requirements. It then corrected the code to a version that did again only change the encoding transitionally resulting in strings containing replacement characters for the ones not available in the target encoding.
I gave up. 🤦‍♂️ 

What I did expect was giving me a solution using some library or telling me a common algorithm or library for orthographic transcription is not available.
This is just one example. Almost always when I ask a AI for non trivial code the response is just wrong, fantasizing about non existing APIs or contains computational errors. Corrections after rejecting responses are so stupid that if I did get from team mates I would have asked them if they want to be kidding me.
 
 Hallucination poses a significant challenge in AI, and no one truly knows how to completely solve it. AI tends to make up information. 

While the ability to run code provides certain advantages, there is still much work to be done, and AI is not replacing developers anytime soon. 

However, it will undoubtedly assist people in building their projects, especially if they are starting from scratch.