Probably sleep state on End Devices is resulting in prolonged period of joining. Try changing firmware on End Device to Router instead and see if it gets connected within seconds.
Most likely rest state on End Devices is bringing about delayed time of joining. Give changing firmware a shot End Device to Router rather and check whether it gets associated in practically no time.