So if you have a building that takes 6 hours and you use gold to cut the build time in half, Can you use more gold to further cut down the time for the same building?
Yes. You can spend 20 more gold to halve it again and again and again. It usually doesn't help much because you need a lot of resources for each building, but when building your timber camp and mines it can be pretty powerful.