The divisions of the bank that provide administration and support services are called the back office. These roles are typically not client-facing. Some examples are clearing and settlement, record maintenance, accounting, and information technology.
The term back office is sometimes also used to describe all functions that do not generate any revenue for the bank.
For more information, please check out: Front Office, Middle Office & Back Office of a Bank: A Simple Explanation for Kids