Sometimes that can be used as an adverbial.
For example,
A - I can't afford that expensive a book.
B - I can't afford that an expensive book.
Which sentence is correct?
"that" describes the "expensive". It can't be omitted here. It's an adverbial, not a pronoun.