I mean where does Brahmaloka lie? Is there any scripture that tells it's exact location and time difference between different lokas?
A partial answer ...
Skanda Purana says that the distance is 8 crore yojanas.
Quoting from the book "Essence of Skanda Purana":
there was no Place like Bharat which happened to be the ‘Karmabhumi’ or the Place where Noble Deeds were rewarded and there was no Tirtha like Kasi and no Bhagavan like Viswanath Linga in the Universe.’ Having visited Satya Loka, Siva Sharma asked the Vishnu Prashads as to how far he would have to travel farther and the latter replied that from Prithvi to Surya Loka the distance was away by a lakh Yojanas (one Yojana is 13-16 km approx); from Prithvi to Maha Loka is one Crore Yojanas; from Prithvi to Jana Loka is two crore yojanas, four crore yojanas to Jana Loka and eight crore yojanas to Satya Loka; sixteen crore yojanas to Vishnu Loka and sixteen times higher from Vaikuntha to Kailasa Dham; in other words, the distance from Bhu Loka to Kailas is a staggering figure of two arab and fifty six crore yojanas! From Satya Loka Siva Sharma was blessed to travel further to reside at Vaikuntha.
The answer lies in the Vishnu Purana:
Parasara said: The sphere of the earth (or Bhúr-loka), comprehending its oceans, mountains, and rivers, extends as far as it is illuminated by the rays of the sun and moon; and to the same extent, both in diameter and circumference, the sphere of the sky (Bhuvar-loka) spreads above it (as far upwards as to the planetary sphere, or Swar-loka). The solar orb is situated a hundred thousand yojanas from the earth; and that of the moon an equal distance from the sun. At the same interval above the moon occurs the orbit of all the lunar constellations. The planet Budha (Mercury) is two hundred thousand yojanas above the lunar mansions. Śukra (Venus) is at the same distance from Mercury. Angáraka (Mars) is as far above Venus; and the priest of the gods (Vrihaspati, or Jupiter) as far from Mars: whilst Saturn (Sani) is two hundred and fifty thousand yojanas beyond Jupiter. The sphere of the seven Rishis (Ursa Major) is a hundred thousand yojanas above Saturn; and at a similar height above the seven Rishis is Dhruva (the pole-star), the pivot or axis of the whole planetary circle. Such, Maitreya, is the elevation of the three spheres (Bhúr, Bhuvar, Swar) which form the region of the consequences of works. The region of works is here (or in the land of Bhárata). Above Dhruva, at the distance of ton million yojanas, lies the sphere of saints, or Mahar-loka, the inhabitants of which dwell in it throughout a Kalpa, or day of Brahmá. At twice that distance is situated Janaloka, where Sanandana and other pure-minded sons of Brahmá, reside. At four times the distance, between the two last, lies the Tapo-loka (the sphere of penance), inhabited by the deities called Vaibhrájas, who are unconsumable by fire. At six times the distance (a hundred and twenty millions of yojanas) is situated Satya-loka (Brahma-loka), the sphere of truth, the inhabitants of which never again know death. (Vishnu Purana, Book II, Chapter VII)