The lora is pretty strong. It will influence the background unless you are very descriptive on what the background should look like.

Recommended Lora Strength: .25 - 1

At lower values, add some additional descriptors of an inkspren to kick the lora into gear while letting the background breathe.