It's particularly unnecessary given the existence of the term 'guys', which has for a long time now been used for both sexes. While it could also imply 'more junior underlings whose work and existence are less important than mine', I think it's more a term that could validly by used among any group to refer to themselves and each other.
If anyone feels the need for an informal term in situations such as the one you describe, switching 'boys' or 'girls' for 'guys' would be one prefereable alternative. Though there is still a latent sexism there in that women are merely granted honorary and conditional membership of the originally male category.
'Gente' in Spanish works really well here as a completely neutral term for any number of people of any kind. 'Esta gente' could be your beloved family, a political rabble you despise, or anything in between.
It initially struck my English (and English-speaking) sensibilities as rather off-hand when seemingly referring to people you are close to as simply 'people'. But it really doesn't have any such implication at all.
Though when it comes to 'cleaners', Spanish and any gender-based language come unstuck, as they have to be assigned a gender and associated genitalia.