UI-POET is a command-line tool that generates frontend code (HTML, CSS, and JavaScript) from user prompts. It uses AI to understand requirements, gather inspiration from images, analyze the desired UI, and generate the code without any manual coding all autonomously.
- Receives user prompt
- Scrapes inspiration images
- Analyzes images with a vision model
- Combines image content and user prompt into a new prompt
- Generates output using an LLM, filters it with regex, and saves it to files
- Generate a chatbot that looks like apple's
- a spotify style music player
What's Next: This approach showed a way how we can use multimodal AI to generate frontend code. The next steps would be to improve the quality of the generated code, add more features, and make it more user-friendly. Will try it with tooling in other products, this will remain as it is.
Available at: pushkarydv/ui-poet also attaching first release tweet below.
✨ Created a CLI-based AI tool! Capable fo making ideas to direct code files in minutes Key features: Scans the internet for visuals matching your input, gathering inspiration and fueling the learning process. Blends your prompt with visual insights, refining code output.