joanrod
Custom Training?
Hello! Super interesting project!
I read that this typically only works for textual descriptions or inages like charts diagrams logos etc. i see you have training script to replicate your results. I have been looking for a "sketch to autocad" type of workflow for the AEC industry, and this is very close! If there were additional examples of hand sketch images and output autocad drawing in svg format, do you think this could work for training data? The other rpossible approach I'm thinking that precludes additional training is using a VLM to describe in detail the hand sketch, and use that in the text to SVG pipeline.
Would live to hear your thoughts on this, and, as always, thank you for your work!
Glad you like the project! Your idea of pairing hand sketches with CAD code for fine-tuning is definitely promising—I’ve fine-tuned StarVector on other types of code with good results. The VLM approach is also interesting, though potentially more challenging. Looking forward to seeing what you come up with!
