We had a fig tree growing in the backyard of the abandoned, dilapidated house next to house, which had clearly self-sown from someone's messy fruit snack or a passing bird's droppings. We have enjoyed its figs for the last two years since buying and renovating our house, as several branches poked over the wall, but next door is now being renovated as well. This is good news, as it was a real mess, but the first thing the builders did was to chop down the fig interloper, which was rather sad.
Nature always finds a way - but people have a way of getting in its way.