It would indeed be much easier if we had some data and code to work with, as ML input and performance really depends on the underlying structure of the data.
I suggest you try and create a reprex and post it here. A reprex consists of the minimal code and data needed to recreate the issue/question you're having. You can find instructions how to build and share one here: