Generally, physical purity (suchi) is a common requirement for doing pujas which is done by bathing as water acts as a purifier. But apart from bathing pranayama is also an purifier. A simple method for puja is said in Bhagavatam as thus:
After cleansing oneself, purifying the body by prāṇāyāma, bhūta-śuddhi and other processes, and marking the body with sacred tilaka for protection, one should sit in front of the Deity and worship the Supreme Personality of Godhead. [SB - 11.3.49]
But mental purity is the best. So puja can also be done even without bathing. To do so one can sprinkle some Ganga water upon himself and by chanting the following mantra with mentally remembering Vishnu one can proceed to worship:
om apavitraḥ pavitro vā sarvāvasthāṁ gato ’pi vā
yaḥ smaret puṇḍarīkākṣaṁ sa bahyābhyantara-śuciḥ
If there is no scope for bathing, even by doing these minimum things one can proceed to do puja in the evening.