Would services provided by banks to RBI be also taxable?

Yes. Services provided by banks to RBI would be taxable as these are not covered by any of the exemptions or excluded from the purview of GST under the CGST Act, 2017 or under the IGST Act, 2017.

Q 27 of GST FAQs on Financial Services Sector published by CBIC