Fix issue where we were not applying flex end correctly when justifying

Fix issue where we were not applying flex end correctly when justifying #2621