If you're being pedantic about the term infinite requiring finiteness to make sense, I think I'd respond by just saying "infinite" is just the best word we have for it from our context. If not, can you elaborate ?