Hi Boleyd
Unfortunately by increasing both at the same time, you haven't given a lot to work with.
As a test, could you try leaving the shadows at your previous setting and then try increasing the tree detail.
Please note, detail sliders are there to provide options to increase or decrease detail in Trainz. If your system is not powerful enough to run Trainz with higher detail settings, then of course it will not look as good when you lower the settings. If it looked as good at either setting, then there would be no advantage for those with more powerful systems, and there would be no reason to have the setting in the first place.
I know it's not what people want to hear, but it is the nature of gaming.
The exact performance will also greatly depend on the route being used; routes that have more detail (or more of a higher detail object) or that use objects that are less efficient will perform worse than routes that are lower detail or use more efficient objects.
Regards